码迷,mamicode.com
首页 > 其他好文 > 详细

Beautiful Soup模块

时间:2018-10-30 12:06:14      阅读:148      评论:0      收藏:0      [点我收藏+]

标签:转换   快速   .com   bottom   数据   bsp   iter   提取数据   cut   

Beautiful Soup 是一个可以从HTML或XML文件中提取数据的Python库,它能够通过你喜欢的转换器实现惯用的文档导航,查找,修改文档的方式.Beautiful Soup会帮你节省数小时甚至数天的工作时间.

快速开始,以如下html作为例子.

html_doc = """
<html><head><title>The Dormouses story</title></head>
<body>
<p class="title"><b>The Dormouses story</b></p>

<p class="story">Once upon a time there were three little sisters; and their names were
<a href="http://example.com/elsie" class="sister" id="link1">Elsie</a>,
<a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
<a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
and they lived at the bottom of a well.</p>

<p class="story">...</p>
"""

使用BeautifulSoup解析这段代码,能够得到一个 BeautifulSoup 的对象,并能按照标准的缩进格式的结构输出:

from bs4 import BeautifulSoup
soup = BeautifulSoup(html_doc,html.parser)
print(soup.prettify())
<html>
 <head>
  <title>
   The Dormouses story
  </title>
 </head>
 <body>
  <p class="title">
   <b>
    The Dormouses story
   </b>
  </p>
  <p class="story">
   Once upon a time there were three little sisters; and their names were
   <a class="sister" href="http://example.com/elsie" id="link1">
    Elsie
   </a>
   ,
   <a class="sister" href="http://example.com/lacie" id="link2">
    Lacie
   </a>
   and
   <a class="sister" href="http://example.com/tillie" id="link3">
    Tillie
   </a>
   ;
and they lived at the bottom of a well.
  </p>
  <p class="story">
   ...
  </p>
 </body>
</html>

几个简单的浏览结构化数据的方法:

soup.title
<title>The Dormouses story</title>

soup.title.name
title

soup.title.string
"The Dormouse‘s story"

soup.title.strings
<generator object _all_strings at 0x0000025B5572A780>

soup.title.parent.name
head

soup.p
<p class="title"><b>The Dormouses story</b></p>

soup.p[class]
[title]

soup.a
<a class="sister" href="http://example.com/elsie" id="link1">Elsie</a>

soup.find_all(a)
[<a class="sister" href="http://example.com/elsie" id="link1">Elsie</a>, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>]

soup.find(id=link3)
<a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>

从文档中找到所有<a>标签的链接:

for link in soup.find_all(a):
    print(link.get(href))
    
http://example.com/elsie
http://example.com/lacie
http://example.com/tillie

从文档中获取所有文字内容:

print(soup.get_text())
The Dormouses story
The Dormouses story
Once upon a time there were three little sisters; and their names were
Elsie,
Lacie and
Tillie;
and they lived at the bottom of a well.

 

Beautiful Soup模块

标签:转换   快速   .com   bottom   数据   bsp   iter   提取数据   cut   

原文地址:https://www.cnblogs.com/saneri/p/9875583.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!