litellm-rs by majiayu000

Debug your AI agents. Maintained by vllora on GitHub, where it has earned 813 stars from the community.

Production-grade RAG API built in Rust. Hybrid search with HNSW dense vectors and BM25 sparse matching, cross-encoder reranking, layout-aware document extraction via Docling, and 94.5% accuracy on Open RAG Bench. Powered by Cerebras, Groq, Milvus, and Jina AI. Maintained by RustyRAG on GitHub, where it has earned 178 stars from the community.

A work in progress to build out solutions in Rust for MLOPs. Maintained by nogibjj on GitHub, where it has earned 382 stars from the community.