首页 > 代码库 > python

python

2024-09-06 10:58:42   219人阅读

Pythone抓取:抓取大多数情况属于get请求，即直接从对方服务器上获取数据。
Requests：
   
import requests    
response = requests.get(url)    
content = requests.get(url).content  
print "response headers:", response.headers    
print "content:", content
 
Urllib2：
   
import urllib2    
response = urllib2.urlopen(url)    
content = urllib2.urlopen(url).read()    
print "response headers:", response.headers    
print "content:", content
 
Httplib2：    
 
import httplib2    
http = httplib2.Http()    
response_headers, content = http.request(url, ‘GET‘)    
print "response headers:", response_headers    
print "content:", content
 
链接：https://github.com/lining0806/PythonSpiderNotes
 
 

python


联系
我们