< cd ../gallery
[AI & ML]

tiny-llm

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.
skyzh
@skyzh
maintainer
★ 4.4k stars
go to website ↗github
tiny-llm — preview
tiny-llm repository preview
# README
A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen. Maintained by skyzh on GitHub, where it has earned 4,361 stars from the community.
It's actively developed around course, large-language-model, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install tiny-llm
languages
Python100%
last commit1 month ago
licenseApache-2.0
more vLLM repos
$ made-with-vllm
rssllmmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.