zurawiki/tiktoken-rs

GitHub

Ready-made tokenizer library for working with GPT and tiktoken

Rust397 stars74 forksMIT

bpe openai rust tokenizer

Momentum

zurawiki/tiktoken-rs has 397 GitHub stars.

It currently ranks #27828 daily, #28329 weekly, #30216 monthly by momentum on Trending Repos; its best-ever rank is #4846.

Rankings

PeriodRankScore

Daily

#278280.0

Weekly

#283290.0

Monthly

#302160.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #4846

Format

Markdown

[![zurawiki/tiktoken-rs badge](https://trending-repos.com/badge/zurawiki/tiktoken-rs.svg?v=3)](https://trending-repos.com/repositories/zurawiki/tiktoken-rs?utm_source=github&utm_medium=badge)

zurawiki/tiktoken-rs

Momentum

Rankings

Engagement

Similar trending repositories

Embeds

zurawiki/tiktoken-rs

Momentum

Rankings

Engagement

Similar trending repositories

Embeds