< cd ../gallery
[AI & ML]

llmhop

Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies
mirkolenz
@mirkolenz
maintainer
★ 11 stars
go to website ↗github
llmhop — preview
llmhop repository preview
# README
Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies. Maintained by mirkolenz on GitHub, where it has earned 11 stars from the community.
It's actively developed around docker, flakes, go, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llmhop
languages
Nix70.789%
Go29.211%
last commit3 weeks ago
licenseMIT
more vLLM repos
$ made-with-vllm
rssllmmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.