quantumaikr/quant.cpp

GitHub

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.

C393 stars43 forksApache-2.0

delta-compression embeddable gguf kv-cache llm llm-inference pure-c quantization transformer turboquant

Momentum

quantumaikr/quant.cpp has 393 GitHub stars.

It currently ranks #41014 daily, #41096 weekly, #41886 monthly by momentum on Trending Repos; its best-ever rank is #4530.

Rankings

PeriodRankScore

Daily

#410140.0

Weekly

#410960.0

Monthly

#418860.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #4530

Format

Markdown

[![quantumaikr/quant.cpp badge](https://trending-repos.com/badge/quantumaikr/quant.cpp.svg?v=3)](https://trending-repos.com/repositories/quantumaikr/quant.cpp?utm_source=github&utm_medium=badge)

quantumaikr/quant.cpp

Momentum

Rankings

Engagement

Similar trending repositories

Embeds

quantumaikr/quant.cpp

Momentum

Rankings

Engagement

Similar trending repositories

Embeds