shredder47/Nonspaced-Sentence-Tokenizer

Tokenizes words there are not seperated by space or any delimiter. It is implemented based on Zipf's law.

语言：Scala · GitHub 星标：4 · Fork：1

话题：nlp · split · tokenizer · tokenizes-sentences

在 GitHub 上查看原仓库