A high-throughput and memory-efficient inference and serving engine for LLMs
7 daysStars96.7k24h gain+66Score53.7
Search
Find trending repositories by name or description.
8 results for “memory-efficient”
RankRepository7 daysStars24h gainScore
Fast and memory-efficient exact attention
7 daysStars25.3k24h gain+7Score2.9
ngx_mruby - A Fast and Memory-Efficient Web Server Extension Mechanism Using Scripting Language mruby for nginx
7 daysStars99824h gain+1Score0.3
Fast and memory-efficient radial basis function (RBF) interpolation
7 daysStars19424h gain-Score0.0
A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.
7 daysStars16324h gain-Score0.0
Fast, memory-efficient self-hosted GitHub Actions cache server written in Rust. Drop-in replacement for the official cache, works with actions/cache unchanged. Supports S3, GCS, Azure Blob or filesystem storage with SQLite, Postgres or MySQL.
7 daysStars45924h gain-Score0.0
Trainable fast and memory-efficient sparse attention
7 daysStars76024h gain-Score0.0
Fast and memory-efficient classical machine learning operators
7 daysStars50024h gain-Score0.0