voidllm

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts. Maintained by voidmind-io on GitHub, where it has earned 125 stars from the community.

It's actively developed around ai, anthropic, api-gateway, and is a solid reference for anyone building with these tools.