key | value |
---|---|
id | 596667158 |
name | tiktoken-rs |
full_name | zurawiki/tiktoken-rs |
html_url | https://github.com/zurawiki/tiktoken-rs |
description | Ready-made tokenizer library for working with GPT and tiktoken |
created_at | Feb. 2, 2023, 5:20 p.m. |
updated_at | April 27, 2024, 9:03 p.m. |
pushed_at | March 20, 2024, 7:54 p.m. |
size | 2,194 |
stargazers_count | 200 |
watchers_count | 5 |
forks_count | 34 |
open_issues | 13 |
language | Rust |
awesome_list |