< cd ../gallery
[AI & ML]
xinfer
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.
@guoqingbao
maintainer
★ 298 stars
# README
Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime. Maintained by guoqingbao on GitHub, where it has earned 298 stars from the community.
It's actively developed around agent, llm, qwen, and is a solid reference for anyone building with these tools.
# tags
# install
npm install xinfermore vLLM repos
