BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Python47,904 stars8,249 forks

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyvertex-ai

Rankings

Daily

—

Weekly

—

Monthly

—

Engagement

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/BerriAI/litellm.svg)

HTML

<img src="https://trending-repos.com/badge/BerriAI/litellm.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/BerriAI/litellm.svg