Luce-Org/lucebox-hub

Fast LLM speculative inference server built for specific consumer hardware.

C++2,226 stars209 forksApache-2.0

cudacuda-kernelsdflashkernelllama-cpplocal-ailuceluceboxmegakernelnvidia-cudapflashqwenrtx3090speculative-decodingspeculative-prefill

Rankings

Daily

#4447

Weekly

#8030

Monthly

#8971

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/Luce-Org/lucebox-hub.svg)

HTML

<img src="https://trending-repos.com/badge/Luce-Org/lucebox-hub.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/Luce-Org/lucebox-hub.svg