keyvalue
id9028617
nameucto
full_nameLanguageMachines/ucto
html_urlhttps://github.com/LanguageMachines/ucto
descriptionUnicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules for several languages and can be easily extended to suit other languages. It has been incorporated for tokenizing Dutch text in Frog, our Dutch morpho-syntactic processor. http://ilk.uvt.nl/ucto --
created_atMarch 26, 2013, 11:16 a.m.
updated_atApril 27, 2024, 7:15 a.m.
pushed_atApril 27, 2024, 7:15 a.m.
size6,378
stargazers_count60
watchers_count13
forks_count13
open_issues13
languageC++
awesome_list

https://github.com/josephmisiti/awesome-machine-learning