A multilingual tokenizer to split a string into tokens
created at Jan. 5, 2016, 7:30 a.m.
6 +0
90 +0
11 +0
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.
created at Jan. 4, 2015, 9 a.m.
16 +0
552 +3
55 +0