< cd ../gallery
[AI & ML]

tiny-llm

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.
skyzh
@skyzh
maintainer
★ 4.4k stars
go to website ↗github
tiny-llm — preview
tiny-llm repository preview
# README
A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen. Maintained by skyzh on GitHub, where it has earned 4,441 stars from the community.
It's actively developed around course, large-language-model, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install tiny-llm
languages
C++12%
last commit4w ago
licenseApache-2.0
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.