码迷,mamicode.com
首页 > 其他好文 > 详细

newspaper安装

时间:2014-08-15 08:14:47      阅读:584      评论:0      收藏:0      [点我收藏+]

标签:style   blog   http   os   io   strong   ar   2014   

安装系统是centos6.5 32位

Python环境 Python2.7

由于直接pip安装时,lmlx安装有问题

1. 安装lmlx

http://mdba.cn/?p=86

yum install libxml* -y
yum install libxslt* -y
 
wget http://lxml.de/files/lxml-3.1.2.tgz
tar xzvf lxml-3.1.2.tgz
cd lxml-3.1.2
python setup.py build
python setup.py install
 
#验证是否安装成功
shell > python
>>> import lxml

2. 安装newspaper
https://github.com/codelucas/newspaper

pip install newspaper
curl https://raw.github.com/codelucas/newspaper/master/download_corpora.py | python2.7

3. 测试

from newspaper import Article
url = ‘http://edition.cnn.com/2014/08/14/world/meast/gaza-couple-wedding-at-unrwa-shelter/index.html?hpt=hp_c2‘

a = Article(url, language=‘zh‘) # Chinese
a.download()
a.parse()
print a.title

url = ‘http://www.tuicool.com/articles/fYneUz‘
a = Article(url, language=‘zh‘) # Chinese
a.download()
a.parse()
print a.title

url = ‘http://www.tuicool.com/articles/AJJ7nu3‘
a = Article(url, language=‘zh‘) # Chinese
a.download()
a.parse()
print a.title

  



 

newspaper安装,布布扣,bubuko.com

newspaper安装

标签:style   blog   http   os   io   strong   ar   2014   

原文地址:http://www.cnblogs.com/huiwq1990/p/3913851.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!