* rename package(WhooshJapaneseTokenizer to whooshjp) * no longer import sub modules automatically * Python3 compatibility(3.2, 3.3) * Drop Python2.5 support
0.6
* correct char offsets(TinySegmenterTokenizer)
0.5
* correct char offsets
0.4
* add MeCabTokenizer * add a mode for don't pickle igo tagger to minimize index.