openai/evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.