vllora by vllora

A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format. Maintained by majiayu000 on GitHub, where it has earned 104 stars from the community.

A work in progress to build out solutions in Rust for MLOPs. Maintained by nogibjj on GitHub, where it has earned 382 stars from the community.

Production-grade RAG API built in Rust. Hybrid search with HNSW dense vectors and BM25 sparse matching, cross-encoder reranking, layout-aware document extraction via Docling, and 94.5% accuracy on Open RAG Bench. Powered by Cerebras, Groq, Milvus, and Jina AI. Maintained by RustyRAG on GitHub, where it has earned 178 stars from the community.