< cd ../gallery
[AI & ML]
self-hosted-ai-stack
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.
@hwdsl2
maintainer
★ 120 stars
# README
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64. Maintained by hwdsl2 on GitHub, where it has earned 120 stars from the community.
It's actively developed around ai, ai-stack, cuda, and is a solid reference for anyone building with these tools.
# tags
# install
npm install self-hosted-ai-stackmore Ollama repos