< cd ../gallery
[AI & ML]
tandemn-tuna
A hybrid router that uses Spot GPU instances to reduce costs and Serverless GPUs for making Cold Starts faster.
@Tandemn-Labs
maintainer
★ 26 stars
# README
A hybrid router that uses Spot GPU instances to reduce costs and Serverless GPUs for making Cold Starts faster. Maintained by Tandemn-Labs on GitHub, where it has earned 26 stars from the community.
It's actively developed around gpu, inference, llm-serving, and is a solid reference for anyone building with these tools.
# tags
# install
npm install tandemn-tunamore vLLM repos
