使用Beautiful Soup找到特定的课程

工作范例:

from bs4 import BeautifulSoup
import requests

zpid = "18429834"
url = "http://www.zillow.com/homes/" + zpid + "_zpid/"
response = requests.get(url)
html = response.content
#html = '
 $1,342,144 
'
soup = BeautifulSoup(html, "html5lib")

results = soup.find_all('div', attrs={"class":"home-summary-row"})
print(results)

alecxe.. 5

您的HTML格式不正确,在这种情况下,选择正确的解析器至关重要.在BeautifulSoup,目前有3个可用的HTML解析器,它们以不同的方式处理和处理损坏的HTML:

html.parser (内置,无需额外模块)

lxml(最快,需要lxml安装)

html5lib(最宽松,需要html5lib安装)

该之间差异的解析器文档页面详细描述了差异.在您的情况下,为了证明差异:

>>> from bs4 import BeautifulSoup
>>> import requests
>>> 
>>> zpid = "18429834"
>>> url = "http://www.zillow.com/homes/" + zpid + "_zpid/"
>>> response = requests.get(url)
>>> html = response.content
>>> 
>>> len(BeautifulSoup(html, "html5lib").find_all('div', attrs={"class":"home-summary-row"}))
0
>>> len(BeautifulSoup(html, "html.parser").find_all('div', attrs={"class":"home-summary-row"}))
3
>>> len(BeautifulSoup(html, "lxml").find_all('div', attrs={"class":"home-summary-row"}))
3

正如你所看到的,在你的情况下,无论是html.parser和lxml做的工作,但html5lib没有.

您的HTML格式不正确,在这种情况下,选择正确的解析器至关重要.在BeautifulSoup,目前有3个可用的HTML解析器,它们以不同的方式处理和处理损坏的HTML:

html.parser (内置,无需额外模块)

lxml(最快,需要lxml安装)

html5lib(最宽松,需要html5lib安装)

该之间差异的解析器文档页面详细描述了差异.在您的情况下,为了证明差异:

>>> from bs4 import BeautifulSoup
>>> import requests
>>> 
>>> zpid = "18429834"
>>> url = "http://www.zillow.com/homes/" + zpid + "_zpid/"
>>> response = requests.get(url)
>>> html = response.content
>>> 
>>> len(BeautifulSoup(html, "html5lib").find_all('div', attrs={"class":"home-summary-row"}))
0
>>> len(BeautifulSoup(html, "html.parser").find_all('div', attrs={"class":"home-summary-row"}))
3
>>> len(BeautifulSoup(html, "lxml").find_all('div', attrs={"class":"home-summary-row"}))
3

正如你所看到的,在你的情况下,无论是html.parser和lxml做的工作,但html5lib没有.