< cd ../gallery
From-scratch C++/CUDA inference engine for the NVIDIA RTX 5090 (sm_120a) — the best single-GPU backend for agentic AI: tool calling, long-context loops, reasoning and concurrent sub-agents on top of the fastest single-stream decode on the 5090 (beats llama.cpp, at-or-ahead of vLLM on NVFP4). 100% written by Claude Code. Maintained by kekzl on GitHub, where it has earned 35 stars from the community.
more vLLM repos
AI & ML
Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards. Maintained by notwitcheer on GitHub, where it has earned 26 stars from the community.
8w ago
AI & ML
A high-performance RDMA distributed file system for fast LLM Inference and GPU Training. Maintained by blackbird-io on GitHub, where it has earned 47 stars from the community.
8mo ago
AI & ML
LLM inference engine built from scratch in C++. No PyTorch, no frameworks. Maintained by Anirudh171202 on GitHub, where it has earned 12 stars from the community.
6mo ago
