BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Stars Over Time
54,823 stars by
hBx
PythonOtherai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyvertex-ai
Growth
HOTLast 30 days+923 stars
Owner
B
BerriAI
github.com/BerriAINotable Stargazers
In These Collections
Building BerriAI/litellm?
We track who's paying attention — companies, roles, and the developers most likely to contribute or adopt.
Get in touch