< cd ../gallery
[AI & ML]
open-agent-sdk-rust
Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples.
@slb350
maintainer
★ 23 stars
# README
Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples. Maintained by slb350 on GitHub, where it has earned 23 stars from the community.
It's actively developed around llamacpp, llm, localllama, and is a solid reference for anyone building with these tools.
# tags
# install
npm install open-agent-sdk-rustmore vLLM repos