< cd ../gallery
[AI & ML]

vllm-ascend

Community maintained hardware plugin for vLLM on Ascend
vllm-project
@vllm-project
maintainer
★ 2.5k stars
go to website ↗github
vllm-ascend — preview
vllm-ascend repository preview
# README
Community maintained hardware plugin for vLLM on Ascend. Maintained by vllm-project on GitHub, where it has earned 2,496 stars from the community.
It's actively developed around ascend, inference, llm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install vllm-ascend
languages
C++52.678%
Python41.761%
CMake2.376%
Shell2.223%
C0.618%
HTML0.264%
Awk0.035%
Jinja0.03%
last commit1 week ago
licenseApache-2.0
more FastAPI repos
$ made-with-fastapi
rssllmmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.