llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc. Maintained by mostlygeek on GitHub, where it has earned 5,268 stars from the community.

It's actively developed around golang, llama, llamacpp, and is a solid reference for anyone building with these tools.