码迷,mamicode.com
首页 > 其他好文 > 详细

coinmarketcap.com爬虫

时间:2018-09-12 20:19:56      阅读:376      评论:0      收藏:0      [点我收藏+]

标签:rap   pat   use   tcap   break   safari   div   request   tps   

coinmarketcap.com爬虫

 

写的真是蛋疼

# -*- coding:utf-8 -*-

import requests
from lxml import etree

headers = {
    ‘user-agent‘:‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36‘
}

def get_tag():
    html = requests.get("https://coinmarketcap.com/zh/rankings/exchanges/",headers=headers).text
    keys = etree.HTML(html)
    keyss = keys.xpath("//td[@class=‘no-wrap currency-name‘]/@data-sort")
    for i in keyss:
        url = "https://coinmarketcap.com/zh/exchanges/"+i
        get_url(url)
def get_url(url):
    html = requests.get(url, headers=headers).text
    keys = etree.HTML(html)
    keyss = keys.xpath("//div[@class=‘col-xs-12‘]/ul[@class=‘list-unstyled‘]/li/a/@href")
    for i in keyss:
        print i
        break


if __name__ == ‘__main__‘:
    get_tag()

  

coinmarketcap.com爬虫

标签:rap   pat   use   tcap   break   safari   div   request   tps   

原文地址:https://www.cnblogs.com/xm17/p/9636418.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!