voidllm

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts. Maintained by voidmind-io on GitHub, where it has earned 118 stars from the community.

It's actively developed around ai, ai-gateway, anthropic, and is a solid reference for anyone building with these tools.