blackbird by blackbird-io

LLM inference engine built from scratch in C++. No PyTorch, no frameworks. Maintained by Anirudh171202 on GitHub, where it has earned 12 stars from the community.

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features. Maintained by mudler on GitHub, where it has earned 44 stars from the community.

A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching. Maintained by lumia431 on GitHub, where it has earned 120 stars from the community.