Python爬虫 爬取优品PPT模板（requests+BeautifulSoup+fake_useragent+os）

本文主要是介绍Python爬虫 爬取优品PPT模板（requests+BeautifulSoup+fake_useragent+os），对大家解决编程问题具有一定的参考价值，需要的程序猿们随着小编来一起学习吧！

好久没来发文章了，来水一下爬虫的，这爬虫还是比较简单的，各位Python小白可以复制粘贴玩玩，但得注意安装导入的前三个库哟，话不多说，上代码：

import requests
from fake_useragent import UserAgent #随机请求头库，比较好用
from bs4 import BeautifulSoup #HTML解析库，用的是lxml解析器，得安装lxml库，当然你也可以使用lxml解析库下的Xpath，因为博主没学，所以用BeautifulSoup了
import os

class APP: #简单的Python类使用，当然你也可以不这样写，博主也就写着玩玩，熟练一下
    def __init__(self,key):
        self.url = "https://www.ypppt.com/p/search.php?kwtype=1&q={}".format(key)

        self.headers = {'User-Agent':str(UserAgent().random)}

        self.path = "./优品PPT/"

    def Path(self):
        if not os.path.exists(self.path):

            os.makedirs(self.path)

    def get_pages(self):
        req = requests.get(self.url,headers=self.headers)

        req.encoding = "utf-8"

        soup = BeautifulSoup(req.text,"lxml")

        urls = soup.find("ul",class_="posts clear").find_all("li")

        for url in urls:

            url_details = "https://www.ypppt.com{}".format(url.a["href"])

            name = url.find("a",class_="p-title").text

            self.details(url_details,name)

    def details(self,url,name):
        req = requests.get(url,headers=self.headers)
        #req.encoding = "utf-8"

        soup = BeautifulSoup(req.text,"lxml")

        url = "https://www.ypppt.com{}".format(soup.find("div",class_="button").a["href"])

        req = requests.get(url,headers=self.headers)
        #req.encoding = "utf-8"
        soup = BeautifulSoup(req.text,"lxml")

        down_url = soup.find("ul",class_="down clear").li.a["href"]

        name = name + down_url[-4:]

        self.save(down_url,name)

    def save(self,url,name):
        response = requests.get(url,headers=self.headers)
        path = self.path + name
        if not os.path.exists(path):
            with open(path,"wb") as fp:
                fp.write(response.content)
            print("正在下载{}".format(name))
        else:
            print("{}已存在，正在跳过...".format(name))

    def main(self):
        self.Path()
        self.get_pages()
        pass


if __name__ == "__main__":
    key = input("请输入PPT分类：\n")
    a = APP(key)
    a.main()
    print("下载完成!!!")

运行效果如下图：

注释就这样吧，有不懂的可以私信博主，实在懒得写注释了

这篇关于Python爬虫 爬取优品PPT模板（requests+BeautifulSoup+fake_useragent+os）的文章就介绍到这儿，希望我们推荐的文章对大家有所帮助，也希望大家多多支持为之网！