< cd ../gallery
[AI & ML]
semantic-router
A programmable Mixture-of-Models router for heterogeneous LLM inference
@vllm-project
maintainer
★ 5.1k stars
# README
A programmable Mixture-of-Models router for heterogeneous LLM inference. Maintained by vllm-project on GitHub, where it has earned 5,116 stars from the community.
It's actively developed around bert-classification, golang, huggingface-candle, and is a solid reference for anyone building with these tools.
# tags
# install
npm install semantic-routermore vLLM repos
