< cd ../gallery
[AI & ML]
llm-vscode-inference-server
An endpoint server for efficiently serving quantized open-source LLMs for code.
@wangcx18
maintainer
★ 59 stars
# README
An endpoint server for efficiently serving quantized open-source LLMs for code. Maintained by wangcx18 on GitHub, where it has earned 59 stars from the community.
It's actively developed around llm, llm-inference, vllm, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llm-vscode-inference-servermore vLLM repos
