标签：
|
html_1 = urllib2.urlopen(cityURL,timeout=120).read()
mychar = chardet.detect(html_1)
bianma = mychar[‘encoding‘]
if bianma == ‘utf-8‘ or bianma == ‘UTF-8‘:
html = html_1
else :
html = html_1.decode(‘gb2312‘,‘ignore‘).encode(‘utf-8‘)
|
|
chapter_soup = BeautifulSoup(html)
city = chapter_soup.find(‘div‘,class_ = ‘row-fluid‘).find(‘h1‘).get_text()
province = chapter_soup.find(‘a‘,class_ = ‘province‘).get_text()
pmNum = chapter_soup.find(‘div‘,class_ = ‘row-fluid‘).find(‘span‘).get_text()
suggest = chapter_soup.find(‘div‘,class_ = ‘row-fluid‘).find(‘h2‘).get_text()
rand = chapter_soup.find(‘div‘,class_ = ‘row-fluid‘).find(‘h2‘).find_next_sibling(‘h2‘).get_text()
face = chapter_soup.find(‘div‘,class_ = ‘span4 pmemoji‘).find(‘h1‘).get_text()
conclusion = chapter_soup.find(‘h1‘,class_ = ‘review‘).get_text()
print city.encode(‘utf-8‘)
cur.execute(‘insert into t_pm values(\‘‘+city.encode(‘utf-8‘)
+‘\‘,\‘‘+province.encode(‘utf-8‘)
+‘\‘,\‘‘+pmNum.encode(‘utf-8‘)
+‘\‘,\‘‘+suggest.encode(‘utf-8‘)
+‘\‘,\‘‘+rand.encode(‘utf-8‘)
+‘\‘,\‘‘+conclusion.encode(‘utf-8‘)+‘\‘)‘)
|
标签：
原文地址：http://www.cnblogs.com/hans-201506/p/4875015.html
