Back to projects
AI & ML

litellm by BerriAI

Go to website ↗View on GitHub
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. Maintained by BerriAI on GitHub, where it has earned 55,577 stars from the community.
BerriAI
BerriAI
Maintainer
55.6k stars
9.7k forks
214 watchers

Install

pip install litellm

Languages

Last updated2mo ago
License—

More LangChain projects

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.