< cd ../gallery
[AI & ML]
voidllm by voidmind-io
Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts. Maintained by voidmind-io on GitHub, where it has earned 125 stars from the community.
# install
go get github.com/voidmind-io/voidllmmore vLLM repos
AI & ML
Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs. Maintained by bricks-cloud on GitHub, where it has earned 1,221 stars from the community.
1y ago
AI & ML
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Maintained by thushan on GitHub, where it has earned 273 stars from the community.
8w ago
AI & ML
Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs. Maintained by llmariner on GitHub, where it has earned 94 stars from the community.
5mo ago
