High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Maintained by thushan on GitHub, where it has earned 273 stars from the community.
