Search

Development repository for the Triton language and compiler

Triton is a dynamic binary analysis library. Build your own program analysis tools, automate your reverse engineering, perform software verification or just emulate code.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

The Triton backend for the ONNX Runtime.

The core library and APIs implementing the Triton Inference Server.

The Triton backend for the PyTorch TorchScript models.

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

jax-triton contains integrations between JAX and OpenAI Triton

Triton's Dragon's Mouth Yellowstone gRPC service for high-performance Solana streaming

This repository contains tutorials and examples for Triton Inference Server

The Triton TensorRT-LLM Backend

FlagGems is an operator library for large language models implemented in the Triton Language.

Fast low-bit matmul kernels in Triton

A domain-specific language (DSL) based on Triton but providing higher-level abstractions.

Efficient Triton Kernels for LLM Training

RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Triton/CUDA kernels.

Github mirror of trition-lang/triton repo.

AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Cross-platform installer for Triton and SageAttention on ComfyUI. Simplifies GPU-accelerated inference setup for Windows users with automated dependency management and RTX 5090 support.

YiRage (Yield Revolutionary AGile Engine) - Multi-Backend LLM Inference Optimization. Extends Mirage with comprehensive support for CUDA, MPS, CPU, Triton, NKI, cuDNN, and MKL backends.

🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系

The official repository of FlashSinkhorn [ICML 2026 Oral]

Triton language and compiler for Ascend NPU

LLM algorithm practice lab with theory, solutions, and test cases.《大模型算法与系统教程》面向大模型入门到进阶的算法实战教程，覆盖原理讲解、答案解析、测试用例与 CUDA/Triton 实战。

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.