< cd ../gallery
[AI & ML]
sbproxy by soapbucket
Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF. Maintained by soapbucket on GitHub, where it has earned 49 stars from the community.
@soapbucket
maintainer
★ 49 stars
# install
cargo add sbproxymore vLLM repos
AI & ML
Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples. Maintained by slb350 on GitHub, where it has earned 24 stars from the community.
8w ago
AI & ML
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth. Maintained by smg-project on GitHub, where it has earned 442 stars from the community.
2mo ago
AI & ML
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime. Maintained by guoqingbao on GitHub, where it has earned 298 stars from the community.
2mo ago
