llamactl

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard. Maintained by lordmathis on GitHub, where it has earned 135 stars from the community.

It's actively developed around llama-cpp, llama-server, llamacpp, and is a solid reference for anyone building with these tools.