< cd ../gallery
[AI & ML]
SmarterRouter
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
@peva3
maintainer
★ 145 stars
# README
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs. Maintained by peva3 on GitHub, where it has earned 145 stars from the community.
It's actively developed around ai-gateway, docker, fastapi, and is a solid reference for anyone building with these tools.
# tags
# install
npm install SmarterRoutermore FastAPI repos
