<divclass="cardback"><DOCUMENT_FRAGMENT><divclass="mw-parser-output"><divclass="thumb tright"><divclass="thumbinner"style="width:152px;"><aclass="image"href="https://pzwiki.wdka.nl/mw-mediadesign/images/thumb/a/a3/Hidden_characters.jpg/960px-Hidden_characters.jpg"><imgalt=""class="thumbimage"decoding="async"src="https://pzwiki.wdka.nl/mw-mediadesign/images/thumb/a/a3/Hidden_characters.jpg/320px-Hidden_characters.jpg"></a><divclass="thumbcaption"><divclass="magnify"><aclass="internal"href="File:Hidden_characters.jpg.html"title="Enlarge"></a></div>Hidden characters (e.g. tabs, spaces, carriage and ‘soft’ returns)</div></div></div>
<h2><spanclass="mw-headline"id="Extracting_text_from_a_PDF">Extracting text from a PDF</span><spanclass="mw-editsection"><spanclass="mw-editsection-bracket">[</span><ahref="/mw-mediadesign/index.php?title=User:Simon/Trim4/Extracting_text_from_PDF&action=edit&section=T-1"title="Edit section: ">edit</a><spanclass="mw-editsection-bracket">]</span></span></h2>
<p>In Al Sweigart's <i>Automate the Boring Stuff with Python</i>, there's a nice section on a Python library called PyPDF2 that allows you to work with the contents of PDFs. To begin with, I thought I'd try extracting text from a PDF of William S. Burrough's <i>The Electronic Revolution</i>. I chose this PDF as the only version I've found of it online is a 40pp document published by ubuclassics (which I suppose is the publishing house for ubuweb.com). There was no identifier other than this (no ISBN etc.), and it was impossible locating any other version online. What's more, the PDF had very small text, which was uncomfortable to read when I ran the booklet.sh script on it.
</p><p>I thought it would be worthwhile laying out this book again for print reading purposes, and the first step is to get the text from the PDF. Pandoc is usually my go to for extracting text, but it doesn't work with PDFs, so I tried <aclass="external text"href="https://pythonhosted.org/PyPDF2/index.html"rel="nofollow">PyPDF2</a>.
<p>I began by copying a file called electronic_revolution.pdf to a folder, then in the terminal <code>cd</code> into that directory. Then I initiated the interactive python interpreter with this command:
</p>
<pre>$ python3</pre>
<p>Next I wrote the following commands in Python 3 (comments above each line):
</p>
<pre># First, import the PyPDF2 module
>>> import PyPDF2
# Then open electronic_revolution.pdf in read binary mode and store it in pdfFileObj
# To get a PdfFileReader object that rep- resents this PDF, call PyPDF2.PdfFileReader() and pass it pdfFileObj. Store this PdfFileReader object in pdfReader
# The total number of pages in the document is stored in the numPages attribute of a PdfFileReader object
>>> pdfReader.numPages
>>> 40
# The PDF has 40 pages. To extract text from a page, you need to get a Page object, which represents a single page of a PDF, from a PdfFileReader object.
# You can get a Page object by calling the getPage() method on a PdfFileReader object and passing it the page number of the page you’re interested in — in our case, 0
>>> pageObj = pdfReader.getPage(0)
# Once you have your Page object, call its extractText() method to return a string of the page’s text
>>> pageObj.extractText()
>>> 'ubuclassics2005WILLIAM S. BURROUGHSTheElectronic\nRevolution'
</pre>
<p>This returns the value for total page count, and the text for the first page (0). What I want to get is the text for the whole document. I have no idea how to do this!!!
<spanclass="lineno"> 4 </span><spanclass="n">filename</span><spanclass="o">=</span><spanclass="nb">input</span><spanclass="p">(</span><spanclass="s2">"name of the file: "</span><spanclass="p">)</span>
<spanclass="lineno"> 9 </span><spanclass="k">for</span><spanclass="n">page_number</span><spanclass="ow">in</span><spanclass="nb">range</span><spanclass="p">(</span><spanclass="n">number_of_pages</span><spanclass="p">):</span><spanclass="c1"># use xrange in Py2</span>
<p>The next step is to then begin cleaning up the text by removing the line-breaks. We wrote a simple shell script for this that runs the Python script, then a command to take out line breaks:
</p>
<pre>$ python3 extract_text.py
$ grep -v "^$" input.txt > output.txt
</pre>
<p>Only problem is that the names of the txt files that are produced will all be "input.txt", which means that if you run this on more than one PDF, you'll have to move input.txt to another directory before running again, rename the file manually, or perhaps I could write another Python script that renames the file and include it in the shell script after the last line.
</p>
<!--
NewPP limit report
Cached time: 20200620130907
Cache expiry: 86400
Dynamic content: false
CPU time usage: 0.018 seconds
Real time usage: 0.177 seconds
Preprocessor visited node count: 21/1000000
Preprocessor generated node count: 70/1000000
Post‐expand include size: 2494/2097152 bytes
Template argument size: 0/2097152 bytes
Highest expansion depth: 2/40
Expensive parser function count: 0/100
Unstrip recursion depth: 0/20
Unstrip post‐expand size: 3957/5000000 bytes
-->
<!--
Transclusion expansion time report (%,ms,calls,template)
