The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
RunanywhereAI/trnrt has 500 GitHub stars.
It currently ranks #5333 daily, #6542 weekly, #9123 monthly by momentum on Trending Repos; its best-ever rank is #4643.