薛原@爬虫俱乐部

xpdf将pdf转为txt

pdftotext temp.pdf temp.txt

Firefox解析pdf

• Firefox浏览器强大的解析功能能够将pdf的内容转换为网页
• 通过webdriver调用Firefox打开pdf文件并进行提取

webdriver+Firefox

from selenium import webdriver
from lxml import etree
import time
driver = webdriver.Firefox()
driver.get("file:///E:/pdf信息提取/temp.pdf")
time.sleep(5)
html = driver.page_source
tree = etree.HTML(html)
content_xpath = "/html/body/div[1]/div[2]/div[4]/div/div/div[2]/span"
content_list = tree.xpath(content_xpath)
for c in content_list:
    print(c.text)
driver.close()

pdfminer3k

from pdfminer.pdfparser import PDFParser,PDFDocument
from pdfminer.pdfinterp import PDFResourceManager, PDFPageInterpreter
from pdfminer.converter import PDFPageAggregator
from pdfminer.layout import LTTextBoxHorizontal,LAParams
file = open(r'E:/pdf信息提取/temp.pdf', 'rb')
praser = PDFParser(file)
doc = PDFDocument()
praser.set_document(doc)
doc.set_parser(praser)
doc.initialize()
rsrcmgr = PDFResourceManager()
laparams = LAParams()
device = PDFPageAggregator(rsrcmgr, laparams=laparams)
interpreter = PDFPageInterpreter(rsrcmgr, device)
for page in doc.get_pages():
    interpreter.process_page(page)
    layout = device.get_result()
    for x in layout:
        if (isinstance(x, LTTextBoxHorizontal)):
            results = x.get_text()
            print(results)

tabula

from tabula import wrapper
file = r"E:/pdf信息提取/table.pdf"
table = wrapper.read_pdf(file, encoding='gbk', pages='all')
print(table)
wrapper.convert_into(file, "E:/pdf信息提取/table1.csv", pages="all")

wordconvert功能

wordconvert准备工作

配置powershell

• 以管理员身份运行powershell
• 将执行策略(ExecutionPolicy)设置为Remotesigned

set-ExecutionPolicy Remotesigned

wordconvert命令

wordconvert temp.pdf temp.html, replace encoding("gb18030")

解析源代码

clear
set obs 1
gen v = fileread("temp.html")
replace v = ustrfrom(v, "gb18030", 1)
replace v = ustrregexra(v, "\r|\n", "")
replace v = ustrregexra(v, "<style>.*?</style>", "")
replace v = ustrregexra(v, "<.*?>", "")
compress