< cd ../gallery
[AI & ML]
FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
@PaddlePaddle
maintainer
★ 3.7k stars
# README
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle. Maintained by PaddlePaddle on GitHub, where it has earned 3,703 stars from the community.
It's actively developed around serving, ernie, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install FastDeploymore vLLM repos
