< cd ../gallery
[AI & ML]
llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
@openziti
maintainer
★ 75 stars
# README
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti. Maintained by openziti on GitHub, where it has earned 75 stars from the community.
It's actively developed around agentic-ai, ai-gateway, ai-infrastructure, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llm-gatewaymore Ollama repos
