------------------- * add `count` optional parameter to `add_term_occurrence` method (jayadison)
0.9.0
------------------ * support non-ascii characters during tokenization (jayadison)
0.8.0
------------------ * Add option to retain punctuation in ``word_tokenize`` (jayadison) * Add option to include whitespace tokens in ``word_tokenize`` results (jayadison)
0.7.1
-------------------- * Fix minor issue in history changelog
0.7.0
-------------------- * Add support for retaining token casing in ``word_tokenize`` (Thanks jayadison)
0.6.0
---------------------
* Add support for running stemming operations with ``word_tokenize`` (Thanks jayaddison) * Add official support for python 3.8