Back to projects
AI & ML

llama-swap by mostlygeek

View on GitHub
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc. Maintained by mostlygeek on GitHub, where it has earned 5,268 stars from the community.
mostlygeek
mostlygeek
Maintainer
5.3k stars
373 forks
23 watchers

Install

go get github.com/mostlygeek/llama-swap

Languages

Go70%
Last updated2mo ago
LicenseMIT

More Gin projects

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.