< cd ../gallery
[AI & ML]

tiny-llm by skyzh

go to website ↗github
A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen. Maintained by skyzh on GitHub, where it has earned 4,441 stars from the community.
skyzh
@skyzh
maintainer
★ 4.4k stars
345 forks
37 watchers

# install

pip install tiny-llm

languages

C++12%
last commit2mo ago
licenseApache-2.0

more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.