< cd ../gallery
Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples. Maintained by slb350 on GitHub, where it has earned 24 stars from the community.
# install
cargo add open-agent-sdk-rustmore vLLM repos
AI & ML
Diagnose vLLM inference servers. Maintained by vllm-doctor on GitHub, where it has earned 16 stars from the community.
2mo ago
AI & ML
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime. Maintained by guoqingbao on GitHub, where it has earned 298 stars from the community.
2mo ago
AI & ML
Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF. Maintained by soapbucket on GitHub, where it has earned 49 stars from the community.
2mo ago
