Python异步请求案例
2021/8/11 9:36:32
本文主要是介绍Python异步请求案例,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!
import asyncio import aiohttp import time def test(number): start = time.time() async def get(url): session = aiohttp.ClientSession(connector=aiohttp.TCPConnector(limit=64, verify_ssl=False)) response = await session.get(url) await response.text() await session.close() return response async def request(): url = 'https://static1.scrape.center/' await get(url) tasks = [asyncio.ensure_future(request()) for _ in range(number)] loop = asyncio.get_event_loop() loop.run_until_complete(asyncio.wait(tasks)) end = time.time() print('Number:', number, 'Cost time:', end - start) for number in [1, 3, 5, 10]: test(number)
结果如下:
Number: 1 Cost time: 0.4136490821838379 Number: 3 Cost time: 0.17262792587280273 Number: 5 Cost time: 0.17714190483093262 Number: 10 Cost time: 0.16022205352783203
摘自拉勾教育《52讲轻松搞定网络爬虫》之异步爬虫的原理和解析
这篇关于Python异步请求案例的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!
- 2024-05-08有遇到过吗?同样的规则 Excel 中 比Python 结果大
- 2024-03-30开始python成长之路
- 2024-03-29python optparse
- 2024-03-29python map 函数
- 2024-03-20invalid format specifier python
- 2024-03-18pool.map python
- 2024-03-18threads in python
- 2024-03-14python Ai 应用开发基础训练,字符串,字典,文件
- 2024-03-13id3 algorithm python
- 2024-03-13sum array elements python