Search

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

A command-line benchmarking tool

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

ROS 2 LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.

🐰 Bencher - Continuous Benchmarking

minitest provides a complete suite of testing facilities supporting TDD, BDD, and benchmarking.

Powerful .NET library for benchmarking

Deprecated micro-benchmarking library for Java

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper: https://hubs.li/Q01fwRWB0

Simple gRPC benchmarking and load testing tool

Suite for benchmarking malloc implementations.

The Benchmark module provides methods for benchmarking Ruby code, giving detailed reports on the time taken for each task.

S3 benchmarking tool

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.

The open source, pluggable, nosql benchmarking suite.

Formalizing and benchmarking open problems in single-cell genomics

CUDA Kernel Benchmarking Library

A high-performance HTTP benchmarking tool that includes a real-time web UI and terminal display

Multitask Optimization Platform (MToP): A MATLAB Benchmarking Platform for Evolutionary Multitasking

Distributed Synergy AI Benchmarking

Source code for the ECCV 2022 paper "Benchmarking Localization and Mapping for Augmented Reality".

🔎 A simple, tiny and lightweight benchmarking library!

自动更新测试服务器节点列表的网络基准测试脚本(Network benchmarking script that automatically updates the list of the measurement server nodes)

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

[COLM 2025] Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale

XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

GenAI inference performance benchmarking tool

A modular framework for benchmarking LLMs and agentic strategies on security challenges across HackTheBox, TryHackMe, PortSwigger Labs, Cybench, picoCTF and more.

An open source benchmarking framework for IT automation