标签:type 练习 text fine webkit python pytho index lis
进去后,F12进入开发人员选项,笔者用的是Chrome。
右键所选图片>>检查 在弹出的控制台中找到所需照片的url
然后开始编写代码一步一步的测试往前走
import requests as r import os from lxml import etree #保存的文件名 folder = ‘ym_img.jpg‘ #爬取的地址 url = ‘http://image.baidu.com/search/detail?ct=503316480&z=0&ipn=false&word=%E6%9D%A8%E5%B9%82&step_word=&hs=0&pn=0&spn=0&di=155870&pi=0&rn=1&tn=baiduimagedetail&is=0%2C0&istype=0&ie=utf-8&oe=utf-8&in=&cl=2&lm=-1&st=undefined&cs=1587868577%2C2503777591&os=3415000385%2C72811486&simid=3344418590%2C75758866&adpicid=0&lpn=0&ln=3884&fr=&fmq=1591432458743_R&fm=&ic=undefined&s=undefined&hd=undefined&latest=undefined©right=undefined&se=&sme=&tab=0&width=&height=&face=undefined&ist=&jit=&cg=star&bdtype=0&oriquery=&objurl=http%3A%2F%2Fimage14.m1905.cn%2Fuploadfile%2F2016%2F0830%2F20160830093355110835.jpg&fromurl=ippr_z2C%24qAzdH3FAzdH3Fooo_z%26e3B8lac_z%26e3Bv54AzdH3FgjofAzdH3Fda8mabnaAzdH3F8a089mm_z%26e3Bfip4s%3Fu6%3Dooofpw6_gjof_x2xo_9_da898a80&gsm=1&rpstart=0&rpnum=0&islist=&querylist=‘ #模拟浏览器 header = {‘User-Agent‘:‘Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36‘} #获取网页源码 response = r.get(url,headers=header) html = etree.HTML(response.text) srctext = html.xpath(‘//*[@id="currentImg"]/@src‘)[0] print(srctext) data = r.get(srctext) with open(folder,‘wb‘) as img: r.get(srctext) with r.get(url, stream=True) as resp: with open(‘demo.jpg‘, ‘wb‘) as fd: for chunk in resp.iter_content(): fd.write(chunk)
print(resp.request.headers) print(resp.status_code)
标签:type 练习 text fine webkit python pytho index lis
原文地址:https://www.cnblogs.com/TTTAO/p/13060361.html