< cd ../gallery
[AI & ML]
photon_infer
A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching
@lumia431
maintainer
★ 118 stars
# README
A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching. Maintained by lumia431 on GitHub, where it has earned 118 stars from the community.
It's actively developed around ai-infra, continuous-batching, inference-engine, and is a solid reference for anyone building with these tools.
# tags
# install
npm install photon_infermore vLLM repos
