llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc. Maintained by mostlygeek on GitHub, where it has earned 4,992 stars from the community.

It's actively developed around golang, llama, llamacpp, and is a solid reference for anyone building with these tools.