wici-ai/inferssd

GitHub

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

C++196 stars35 forksApache-2.0

apple-silicon cuda gguf inference llama-cpp llm metal mixture-of-experts ssd

Momentum

wici-ai/inferssd has 196 GitHub stars.

It currently ranks #48684 daily, #48553 weekly, #48764 monthly by momentum on Trending Repos; its best-ever rank is #4655.

Rankings

PeriodRankScore

Daily

#486840.0

Weekly

#485530.0

Monthly

#487640.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #4655

Format

Markdown

[![wici-ai/inferssd badge](https://trending-repos.com/badge/wici-ai/inferssd.svg?v=3)](https://trending-repos.com/repositories/wici-ai/inferssd?utm_source=github&utm_medium=badge)

wici-ai/inferssd

Momentum

Rankings

Engagement

Similar trending repositories

Embeds

wici-ai/inferssd

Momentum

Rankings

Engagement

Similar trending repositories

Embeds