openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Python18,271 stars1,477 forksMIT

Rankings

Daily

#2038

Weekly

#1620

Monthly

#1371

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/openai/tiktoken.svg)

HTML

<img src="https://trending-repos.com/badge/openai/tiktoken.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/openai/tiktoken.svg