skyzh/tiny-llm

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

Python4,197 stars318 forksApache-2.0

courselarge-language-modelllmpythonqwenqwen2servingvllm

Rankings

Daily

#703

Weekly

#2261

Monthly

#2640

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/skyzh/tiny-llm.svg)

HTML

<img src="https://trending-repos.com/badge/skyzh/tiny-llm.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/skyzh/tiny-llm.svg