semantic-router

Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference. Maintained by vllm-project on GitHub, where it has earned 4,962 stars from the community.

It's actively developed around ai-gateway, bert-classification, fine-tuning, and is a solid reference for anyone building with these tools.