Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
guqiong96/Lsglang has 168 GitHub stars.
It currently ranks #5609 daily, #7089 weekly, #10505 monthly by momentum on Trending Repos; its best-ever rank is #5372.