Luce-Org/lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

C++2,893 stars283 forksApache-2.0

cudacuda-kernelsdflashheterogeneous-computingkernelllama-cpplocal-ailucemegakernelpflashpoolsideqwenr9700rocmrtx3090sparkspeculative-decodingspeculative-prefillstrix-halo

Rankings

PeriodRankScore

Daily

#141171.0

Weekly

#439171.0

Monthly

#1070171.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #110

Format

Markdown

[![Luce-Org/lucebox badge](https://trending-repos.com/badge/Luce-Org/lucebox.svg?v=3)](https://trending-repos.com/repositories/Luce-Org/lucebox?utm_source=github&utm_medium=badge)

Back to trending