怎么获取scrapy,cookies 如何在scrapy中带cookie访问

2025-03-01 21:24:55
推荐回答(1个)
回答1:

session = requests.Session()
session.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36'
}
session.get('https://xueqiu.com')
for page in range(1,100):
url = 'https://xueqiu.com/stock/f10/finmainindex.json?symbol=SZ000001&page=%s&size=1' % page
print url
r = session.get(url)
#print r.json().list
a = r.text