< cd ../gallery
[AI & ML]
flama by vortico
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP. Maintained by vortico on GitHub, where it has earned 296 stars from the community.
# install
pip install flamamore vLLM repos
AI & ML
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving. Maintained by asprenger on GitHub, where it has earned 79 stars from the community.
2y ago
AI & ML
Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 76 stars from the community.
2mo ago
AI & ML
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code. Maintained by waybarrios on GitHub, where it has earned 1,488 stars from the community.
2mo ago
