openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Python19,162 stars1,606 forksMIT

Rankings

PeriodRankScore

Daily

#251660.0

Weekly

#274420.0

Monthly

#281420.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #41

Format

Markdown

[![openai/tiktoken badge](https://trending-repos.com/badge/openai/tiktoken.svg?v=3)](https://trending-repos.com/repositories/openai/tiktoken?utm_source=github&utm_medium=badge)

Back to trending