pragmatic_segmenter in markets/awesome-ruby, arbox/nlp-with-ruby

Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.

updated at Nov. 16, 2024, 8:44 a.m.

16 +0

552 +3

55 +0

pragmatic_tokenizer in arbox/nlp-with-ruby

A multilingual tokenizer to split a string into tokens

updated at Aug. 11, 2024, 9:25 p.m.

6 +0

90 +0

11 +0