vllm.cpp

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features. Maintained by mudler on GitHub, where it has earned 44 stars from the community.

It's actively developed around mlx, vllm, cpp20, and is a solid reference for anyone building with these tools.