flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP. Maintained by vortico on GitHub, where it has earned 296 stars from the community.

It's actively developed around machine-learning, anthropic, asgi, and is a solid reference for anyone building with these tools.