litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]. Maintained by BerriAI on GitHub, where it has earned 53,514 stars from the community.

It's actively developed around ai-gateway, anthropic, azure-openai, and is a solid reference for anyone building with these tools.