jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Python14,864 stars1,252 forksApache-2.0

apple-siliconinference-serverllmmacosmlxopenai-api

Rankings

Daily

#339

Weekly

#77

100

Monthly

#161

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/jundot/omlx.svg)

HTML

<img src="https://trending-repos.com/badge/jundot/omlx.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/jundot/omlx.svg