Pytho中urllib的简单应用
2021/10/4 23:13:20
本文主要是介绍Pytho中urllib的简单应用,对大家解决编程问题具有一定的参考价值,需要的程序猿们随着小编来一起学习吧!
简单爬取网页内容
# encoding = 'utf-8' import urllib.request import urllib.parse #解析 # Get请求 # response = urllib.request.urlopen("http://www.baidu.com") # print(response.read().decode('utf-8')) ''' # Post data = bytes(urllib.parse.urlencode({"User":"Password"}), encoding = 'utf-8') response = urllib.request.urlopen("http://httpbin.org/post", data = data) print(response.read().decode("utf-8")) ''' # try : # response = urllib.request.urlopen("http://httpbin.org/get", timeout = 3) # print(response.read().decode("utf-8")) # except urllib.error.URLError as e : # print("timeout") # 超时处理 # 响应头 # response = urllib.request.urlopen("http://www.baidu.com", timeout = 3) # print(response.getheader("Server")) # 状态码 200 404 # 伪装浏览器 ''' # url = "http://www.douban.com" url = "http://httpbin.org/post" headers = { "User-Agent" : "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.61 Safari/537.36" } data = bytes(urllib.parse.urlencode({"name":"eric"}), encoding = 'utf-8') req = urllib.request.Request(url = url, data = data, headers = headers, method = "POST") response = urllib.request.urlopen(req) print(response.read().decode('utf-8')) ''' url = "http://81.68.109.40:30004/" headers = { "User-Agent" : "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.61 Safari/537.36" } req = urllib.request.Request(url = url, headers = headers) response = urllib.request.urlopen(req) print(response.read().decode("utf-8"))
这篇关于Pytho中urllib的简单应用的文章就介绍到这儿,希望我们推荐的文章对大家有所帮助,也希望大家多多支持为之网!
- 2024-10-01基于Python+Vue开发的医院门诊预约挂号系统
- 2024-10-01基于Python+Vue开发的旅游景区管理系统
- 2024-10-01RestfulAPI入门指南:打造简单易懂的API接口
- 2024-10-01初学者指南:了解和使用Server Action
- 2024-10-01Server Component入门指南:搭建与配置详解
- 2024-10-01React 中使用 useRequest 实现数据请求
- 2024-10-01使用 golang 将ETH账户的资产平均分散到其他账户
- 2024-10-01JWT用户校验课程:从入门到实践
- 2024-10-01Server Component课程入门指南
- 2024-09-30Dnd-Kit学习:新手快速入门指南