< cd ../gallery
[AI & ML]
VindexLLM
VindexLLM is a pure Delphi, GPU-powered LLM inference engine that uses Vulkan compute shaders to run GGUF models entirely on the GPU. It performs full transformer inference without relying on Python, CUDA, or other external runtimes, requiring only vulkan-1.dll, which is typically included with modern GPU drivers.
@tinyBigGAMES
maintainer
★ 69 stars
# README
VindexLLM is a pure Delphi, GPU-powered LLM inference engine that uses Vulkan compute shaders to run GGUF models entirely on the GPU. It performs full transformer inference without relying on Python, CUDA, or other external runtimes, requiring only vulkan-1.dll, which is typically included with modern GPU drivers. Maintained by tinyBigGAMES on GitHub, where it has earned 69 stars from the community.
It's actively developed around delphi, llama-cpp, llm-inference, and is a solid reference for anyone building with these tools.
# tags
# install
npm install VindexLLMmore Ollama repos
