< cd ../gallery
[AI & ML]

llmhop

Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies
mirkolenz
@mirkolenz
maintainer
★ 11 stars
go to website ↗github
llmhop — preview
llmhop repository preview
# README
Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies. Maintained by mirkolenz on GitHub, where it has earned 11 stars from the community.
It's actively developed around docker, flakes, go, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llmhop
languages
Nix74%
Go26%
last commit4w ago
licenseMIT
more vLLM repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.