ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation. Maintained by Osmantic on GitHub, where it has earned 3,002 stars from the community.

It's actively developed around ai-agents, amd, comfyui, and is a solid reference for anyone building with these tools.