python 中的协程
2022/7/7 1:20:20
本文主要是介绍python 中的协程,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!
import aiohttp import aiofiles import asyncio # 协程请求 async def get_page_one(href, pathName): async with aiohttp.ClientSession() as session: async with session.get(href, headers=header) as resp: hm = await resp.text(encoding="utf-8") tree = etree.HTML(hm) data = "".join(tree.xpath('//div[@id="neirong"]/p/text()')) # 将数据写入文件 async with aiofiles.open(pathName, "w", encoding="utf-8") as file: await file.write(data) print(pathName+"数据更新完成") #任务绑定 async def main(result_list): # 循环result_list tasks = [] for i in result_list: if not os.path.exists(i["title"]): os.mkdir(i["title"]) href = i["url"] path_name = i["title"]+"/"+i["name"]+".txt" path_name = path_name.replace("****", " ") #作用去除**** # 创建协程任务 task = asyncio.create_task(get_page_one(href, path_name)) tasks.append(task) await asyncio.wait(tasks) #执行 if __name__ == '__main__': url="https://www.51shucheng.net/jiakong/qingyunian" result_list = get_chapter_info(url) event_loop = asyncio.get_event_loop() event_loop.run_until_complete(main(result_list))
这篇关于python 中的协程的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!
- 2024-11-25Python编程基础:变量与类型
- 2024-11-25Python编程基础与实践
- 2024-11-24Python编程基础详解
- 2024-11-21Python编程基础教程
- 2024-11-20Python编程基础与实践
- 2024-11-20Python编程基础与高级应用
- 2024-11-19Python 基础编程教程
- 2024-11-19Python基础入门教程
- 2024-11-17在FastAPI项目中添加一个生产级别的数据库——本地环境搭建指南
- 2024-11-16`PyMuPDF4LLM`:提取PDF数据的神器