Trafilatura

- faster and more robust text and metadata extraction
- more efficient batch processing (parallel processing, URL queues)
- extraction and processing of ATOM/RSS feeds
- complete command-line tool with corresponding options

- better metadata extraction and integration (XML & XML-TEI)
- more efficient processing
- output directory as CLI-option

- improved "fast" mode (accuracy and speed)
- better fallbacks with readability-lxml and justext
- metadata extraction added
- more robust processing (tests, encoding handling)

- support for Python 3.4 reactivated
- bugs in XML output and discarding sections solved
- new tests and documentation

- code base re-structured for clarity and readability
- streamlined HTML processing and conversion
- internal less-recently-used cache (LRU) for deduplication
- export as CSV
- better test coverage, extraction recall and precision
- further documentation (trafilatura.readthedocs.org)
- optional processing of text formatting
- more complete settings file

- added metadata to the XML output
- production of valid XML TEI for simple documents