< cd ../gallery
[AI & ML]

self-hosted-ai-stack

Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.
hwdsl2
@hwdsl2
maintainer
★ 120 stars
github
self-hosted-ai-stack — preview
self-hosted-ai-stack repository preview
# README
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64. Maintained by hwdsl2 on GitHub, where it has earned 120 stars from the community.
It's actively developed around ai, ai-stack, cuda, and is a solid reference for anyone building with these tools.
# tags
# install
npm install self-hosted-ai-stack
languages
Shell100%
last commit2 weeks ago
licenseMIT
more Ollama repos
$ made-with-ollama
rssllmmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.