Search

Your GeForce runs AI at half speed. This fixes it for 20/30/40 series cards. Up to 2× FP16 / BF16 / TF32 tensor throughput

A high-throughput and memory-efficient inference and serving engine for LLMs

Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with existing Redis clients.

Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.

C library for high-throughput sequencing data formats

Specifications of SAM/BAM and related high-throughput sequencing file formats

A synthetic micro-benchmark that measures peak compute, bandwidth, and matrix throughput of GPUs and CPUs

High-throughput columnar serialization in Rust

A Linux network throughput multiple-thread benchmark tool.

Ultra fast and low latency C++ Logging library with flexible configuration and high throughput in multithreaded environment

Raw benchmarks on throughput, latency and transfer of Hello World on popular microservices frameworks

goben is a golang tool to measure TCP/UDP transport layer throughput between hosts.

CellBender is a software package for eliminating technical artifacts from high-throughput single-cell RNA sequencing (scRNA-seq) data.

高吞吐 .NET 分布式任务与实时数据调度平台：时间/数据/消息/Cron/SQL/脚本切片，自动重试与弹性扩缩，回溯补算 + Web 控制台。High‑throughput .NET distributed job & real‑time scheduler with fine‑grained slicing, retries, elastic scaling & web console.

High throughput Go SMTP pool library with graceful handling of idle timeouts, errors, and retries.

C99 library implementation for communicating with the S3 service, designed for maximizing throughput on high bandwidth EC2 instances.

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

The Fastest Unified Streaming SQL Engine in a Single C++ Binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context from streams, logs, metrics, events, and CDC.

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

LLM Benchmark for Throughput via Ollama (Local LLMs)

The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.

ArcticInference: vLLM plugin for high-throughput, low-latency inference

High-throughput, token-authenticated tunneling built in Zig.

Train and serve LLMs at extreme speed and massive throughput.

High-performance LLM inference engine — drop-in replacement for Ollama with faster multi-turn inference, lower TTFT, and higher throughput through prefix caching and continuous batching.

⚡zt — the fastest terminal emulator. 88 MB/s throughput. 5.5ms startup. 2MB memory. Pure Zig.

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.