Japanesetokenizer

Latest version: v1.6

Safety actively analyzes 621751 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 4

1.6

For mecab wrapper class, you could call

- jumandic. It's alternative dictionary for mecab tokenizer. jumandic has rich morphological information.
- unidic. It's continuously maintained by NINJA. See more information [here](https://unidic.ninjal.ac.jp/), JP only.

And, in this version, some arguments in mecab wrapper class is deleted because it's not consistent anymore.

1.5

1.4

- could not install some packages in setup.py because `pip.main` function is removed. Now setup.py calls `subprocess.check_call` function instead.
- pyknp package is updated and Jumanpp module is removed in the latest version. Now, JapaneseTokenizer package calls the latest pyknp

1.3.7

The following issue is fixed, which is specific to MacOS, I guess.
https://github.com/Kensuke-Mitsuzawa/JapaneseTokenizers/issues/47

1.3.6

fixed issued in https://github.com/Kensuke-Mitsuzawa/JapaneseTokenizers/issues/44

1.3.5

Fixed this issue -> https://github.com/Kensuke-Mitsuzawa/JapaneseTokenizers/issues/39

Page 1 of 4

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.