flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP. Maintained by vortico on GitHub, where it has earned 292 stars from the community.

It's actively developed around anthropic, asgi, chatbot, and is a solid reference for anyone building with these tools.