go-llm-proxy by yatesdr

AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices. Maintained by Approaching-AI on GitHub, where it has earned 15 stars from the community.

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts. Maintained by voidmind-io on GitHub, where it has earned 125 stars from the community.

Simple LLM service identification - translate IP:Port to Ollama, vLLM, LiteLLM, or 60+ other AI services in seconds. Maintained by praetorian-inc on GitHub, where it has earned 204 stars from the community.