< cd ../gallery
[AI & ML]
openinfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
@openinfer-project
maintainer
★ 535 stars
# README
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2. Maintained by openinfer-project on GitHub, where it has earned 535 stars from the community.
It's actively developed around cuda, cuda-kernels, deepseek, and is a solid reference for anyone building with these tools.
# tags
# install
npm install openinfermore vLLM repos
