首页 > 代码库 > python html parse

python html parse

  1. bs4:转换成unicode编码,http://www.crummy.com/software/BeautifulSoup/
    1. from bs4 import BeautifulSoupsoup = BeautifulSoup(open("index.html"))soup = BeautifulSoup("<html>data</html>")
    2. Beautiful Soup将复杂HTML文档转换成一个复杂的树形结构,每个节点都是Python对象,所有对象可以归纳为4种: Tag , NavigableString ,BeautifulSoup , Comment .
    3. from bs4 import SoupStraineronly_a_tags = SoupStrainer("a")only_tags_with_id_link2 = SoupStrainer(id="link2")def is_short_string(string):    return len(string) < 10only_short_strings = SoupStrainer(text=is_short_string)
    4. BeautifulSoup(html_doc, "html.parser", parse_only=only_a_tags)
  2. lxml: python 对 libxml 的包装
  3. html5lib:纯python实现

python html parse