< cd ../gallery
[AI & ML]
vidur
Accurate, large-scale, and extensible simulator for LLM inference Systems
@microsoft
maintainer
★ 641 stars
# README
Accurate, large-scale, and extensible simulator for LLM inference Systems. Maintained by microsoft on GitHub, where it has earned 641 stars from the community.
It's actively developed around inference, llm, simulation, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vidurmore vLLM repos
