< cd ../gallery
[AI & ML]
booster
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
@gotzmann
maintainer
★ 169 stars
# README
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers. Maintained by gotzmann on GitHub, where it has earned 169 stars from the community.
It's actively developed around chatgpt, exllama, ggml, and is a solid reference for anyone building with these tools.
# tags
# install
npm install boostermore vLLM repos
