lychee

Universal local LLM runtime. Drop-in Ollama replacement with HuggingFace integration, pipelines, structured output. Free & open source. Maintained by MD-Mushfiqur123 on GitHub, where it has earned 20 stars from the community.

It's actively developed around agent, ai, anthropic, and is a solid reference for anyone building with these tools.