Search

Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains

Speed and samples benchmark: for all types of text to speech (TTS) models on Windows/Linux/Mac.

Bug Hunt Bench: 105 real bugs in two production repos, frontier coding models (GPT-6, Claude, Grok, Gemini, DeepSeek...) find and fix them in their own CLI, graded blind. Live leaderboard + every receipt.

Suite for benchmarking malloc implementations.

YABS - a simple bash script to estimate Linux server performance using fio, iperf3, & Geekbench

WebRTC Server that plays a file and generates a CPU Usage report

📊 Comparing deno, node and bun HTTP frameworks

GEO-Bench: Toward Foundation Models for Earth Monitoring

SWE-bench: Can Language Models Resolve Real-world Github Issues?

A powerful Node.js benchmark library

An LLM benchmark for Svelte 5 based on the OpenAI methodology from OpenAIs paper "Evaluating Large Language Models Trained on Code".

[NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!

The official repository of ALE-Bench

Gateway API Benchmarks provides a common set of tests to evaluate a Gateway API implementation.

The official repo of GraphRAG-Bench for evaluating GraphRAG models. "When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation". (ICLR'26)

τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

An Alibaba open-source multi-language benchmark for evaluating LLMs in repository-level automatic code review, featuring an AI-assisted and expert-verified dataset.

Measuring and evolving with the frontier of agent work

The Definitive AI Agent Benchmark

VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects

A benchmark for evaluating LLMs on Chinese traditional fortune telling — Bazi (八字) and Ziwei Doushu (紫微斗数).

Official AHE code — Agentic Harness Engineering: observability-driven automatic evolution of coding-agent harnesses (concurrent w/ meta-harness). NexAU-AHE reaches 84.7% ± 2.1 pass@1 on Terminal-Bench 2 (GPT-5.5). Lifts GPT-5.4 69.7→77.0% over 10 iters, beats Codex/ACE/Training-Free GRPO; frozen harness transfers to SWE-bench-Verified.

Code and Data for paper "GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?"

Mixed-capability LLM benchmark for DGX Spark — 57 scenarios, 10 domains, partial-credit grading, trial statistics

A lab bench power supply, but pocket-sized and battery powered.

A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.

Taking the pi coding agent to Claude Code-level performance: 0.539 → 0.773 pass@1 on Terminal-Bench 2.1 with the same self-hosted 27B model, by re-engineering the agent.

Apeireth — a digital companion that grows with you. Pure Safe Rust AGI cognitive microkernel: memory that fades like a person's, human approval before every side effect, honest boundaries. 31-member workspace (30 crates + 1 bench).