大连做网站的企业,专业搜索引擎seo合作,外贸网站优化服务,软件技术工资一般多少Requests库是目前常用且效率较高的爬取网页的库1.一个简单的例子import requests #引入requests库r requests.get(http://www.baidu.com) #调用get方法获取界面print(r.status_code) #输出状态码print(r.text) #输出页面信息通过以下代码#x…Requests库是目前常用且效率较高的爬取网页的库1.一个简单的例子import requests #引入requests库r requests.get(http://www.baidu.com) #调用get方法获取界面print(r.status_code) #输出状态码print(r.text) #输出页面信息通过以下代码便可获取一个response对象2.通用代码框架importrequestsdefgetHtmlText(url):try:r requests.get(url, timeout 30) #设置响应时间和地址r.raise_for_status() #获取状态码如果不是200会引发HTTPERROR异常r.encodingr.apparent_encoding #apparent_encoding是识别网页的编码类型returnr.textexcept:return 产生异常if __name__ __main__:url ‘http://www.baidu.com‘print(getHtmlText(url))3.requests库的具体介绍3.1 response属性介绍属性逻辑结构3.2requests方法介绍requests库对比http协议 ps:在这些方法中大致有三个参数略有差别3.2.1 get方法r requests.get(‘http://www.baidu.com‘)print(r.text)3.2.2head方法r requests.head(‘http://www.baidu.com‘)print(r.headers)3.2.3 post方法payload {‘key1‘: ‘value1‘, ‘key2‘ : ‘value2‘}r requests.post(‘http://httpbin.org/post‘, data payload)print(r.text)#输出结果{...form: {key1: value1,key2: value2},...}3.2.4 put方法payload {‘key1‘: ‘value1‘, ‘key2‘ : ‘value2‘}r requests.put(‘http://httpbin.org/post‘, data payload)print(r.text) #向URL传一个字典自动编码为表单#........字符串........data#输出结果{...form: {key1: value1,key2: value2},...}3.2.5 reuqest方法--构造请求requests.request(method, url, **kwrags)#method:请求方式对应get/put/post等七种#url : 链接#**kwrags : 13个控制访问的参数method请求方式requests.request(‘GET‘, url, **kwrags)requests.request(‘HEAD‘, url, **kwrags)requests.request(‘POST‘, url, **kwrags)requests.request(‘PUT‘, url, **kwrags)requests.request(‘PATCH‘, url, **kwrags)requests.request(‘DELETE‘, url, **kwrags)requests.request(‘OPTIONS‘, url, **kwrags)**kwargs详解:kv {‘key1‘: ‘value1‘, ‘key2‘ : ‘value2‘} #paramsr requests.request(‘POST‘, ‘http://python123.io/ws‘, data kv)data1 ‘hellowrld‘ #datar requests.request(‘POST‘, ‘http://python123.io/ws‘, data data1)jso {‘key1‘: ‘value1‘} #jsonr requests.request(‘POST‘,‘http://python123.io/ws‘, json jso)hd {‘key1‘: ‘value1‘} #headersr requests.request(‘POST‘,‘http://python123.io/ws‘, headers hd)fs {‘file‘ : open(‘data.xls‘,‘rb‘)} #filesr requests.request(‘POST‘,‘http://python123.io/ws‘, files fs)#timeoutr requests.request(‘POST‘,‘http://python123.io/ws‘, timeout 10)#proxiespxs {‘http‘: ‘http://usr:pass10.10.10:1234‘,‘https‘ : ‘https://10.10.10.1:4321‘}r requests.request(‘GET‘,‘http://www.baidu.com‘, proxies pxs)3.2.6 delete方法3.2.7 patch方法3.3PATCH和PUT的区别.4.requests库的异常本文是通过整合慕课网上的资料和网上相关资料完成
