< cd ../gallery
[AI & ML]
vllm-factory
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
@latenceainew
maintainer
★ 76 stars
# README
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment. Maintained by latenceainew on GitHub, where it has earned 76 stars from the community.
It's actively developed around ai-infrastructure, colbert, colpali, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllm-factorymore vLLM repos
