High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
NVIDIA/TensorRT-Edge-LLM has 457 GitHub stars.
It currently ranks #36384 daily, #36605 weekly, #37729 monthly by momentum on Trending Repos; its best-ever rank is #4934.