ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation. Maintained by Osmantic on GitHub, where it has earned 3,960 stars from the community.

It's actively developed around ai-agents, llm, self-hosted, and is a solid reference for anyone building with these tools.