Back to trending
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
C++454 stars26 forks
cpu-inferencegguf-model-supportgpu-inferencehigh-performance-inferencehybrid-inferenceinference-engineinference-optimizationlarge-language-modelsllama-cpp-alternativellm-inferencemixture-of-expertstransformer
Rankings
Daily
#12775
0
Weekly
#4059
1
Monthly
#4979
0
Engagement
Total stars
Daily new stars
Get badge
This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.
Markdown
HTML
<img src="https://trending-repos.com/badge/brontoguana/krasis.svg" alt="Trending Repos" />Raw URL
https://trending-repos.com/badge/brontoguana/krasis.svg