A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Lightning-AI/LitServe has 3,923 GitHub stars.
It currently ranks #30304 daily, #30714 weekly, #32382 monthly by momentum on Trending Repos; its best-ever rank is #23311.