Thai-segmenter

Latest version: v0.4.2

Safety actively analyzes 613482 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.4.2

------------------

* Fix signature of ``tasks.tokenize_and_postag`` function
* Update ``tox.ini`` to include newer python version, as well as older parameters and flags
* Reformat und Lint

0.4.1

------------------

* Fix tokenization / tokenization + POS tagging: return words instead of subwords
* Add ``--escape-special`` and ``--subwords`` parameter to CLI script for tokenization.
Allows tokenization to further tokenize unknown words (e. g. names)
as well as escape special characters with angle bracket entities.

0.4.0

------------------

* Add demo webapp with sentence segmentation.
(NOTE: Running both the webapp and (batch) sentence segmentation at the same time from the same installation is not recommeded. It can have unexpected side-effects.)
* Some reformat of ``README.rst``

0.3.3

------------------

* Fix duplicate names (class/method for ``sentence_segment``), rename class to ``sentence_segmenter`` (``.py``).

0.3.2

------------------

* Add ``twine`` to extras dependencies.
* Publish module on **PyPI**. (Only ``sdist``, ``bdist_wheel`` can't be built currently.)
* Fix some TravisCI warnings.

0.3.1

------------------

* Add tasks to ``__init__.py`` for easier access.

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.