sbproxy

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF. Maintained by soapbucket on GitHub, where it has earned 49 stars from the community.

It's actively developed around ai-gateway, anthropic, api-gateway, and is a solid reference for anyone building with these tools.