Back to projects
AI & ML

RKLLM-API-Server by GatekeeperZA

Go to website ↗View on GitHub
OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support. Maintained by GatekeeperZA on GitHub, where it has earned 24 stars from the community.
GatekeeperZA
GatekeeperZA
Maintainer
24 stars

Install

pip install rkllm-api-server

Languages

Last updated2w ago
LicenseMIT

More Open WebUI projects

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.