伯乐在线文章URL

标签：sele   soup   ESS   odi   log   blog   get   style   base   

• 一段代码，可以跑出所有文章的url

• # encoding: utf-8             
  import requests               
  from bs4 import BeautifulSoup 
                                
  base_url = ‘http://blog.jobbol
                                
  session = requests.session()  
  i=0                           
  for i in range(559):          
      url = base_url+str(i)+"/" 
      # print(url)              
      res = session.get(url=url)
      soup = BeautifulSoup(res.t
      post_nodes = soup.select("
      for post_node in post_node
          post_url = post_node.g
          i+=1                  
          print(i,post_url)     

   

伯乐在线文章URL

标签：sele   soup   ESS   odi   log   blog   get   style   base   

原文地址：https://www.cnblogs.com/longbigbeard/p/9195405.html