< cd ../gallery
[AI & ML]

llmaz

Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!
InftyAI
@InftyAI
maintainer
★ 307 stars
go to website ↗github
llmaz — preview
llmaz repository preview
# README
Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 307 stars from the community.
It's actively developed around huggingface, inference, inference-platform, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llmaz
languages
Go100%
last commit6 months ago
licenseApache-2.0
more vLLM repos
$ made-with-vllm
rssllmmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.