< cd ../gallery
[AI & ML]

ssd-llm

Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac
quantumnic
@quantumnic
maintainer
★ 31 stars
github
ssd-llm — preview
ssd-llm repository preview
# README
Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac. Maintained by quantumnic on GitHub, where it has earned 31 stars from the community.
It's actively developed around apple-silicon, gpu, inference, and is a solid reference for anyone building with these tools.
# tags
# install
npm install ssd-llm
languages
Rust91%
last commit5w ago
licenseMIT
more Ollama repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.