[AI & ML]

ollamaMQ

High-performance Ollama & LM Studio proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

@Chleba

maintainer

★ 112 stars

github

ollamamq — preview

# README

High-performance Ollama & LM Studio proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust. Maintained by Chleba on GitHub, where it has earned 112 stars from the community.

It's actively developed around fair-share, llm-ops, message-queue, and is a solid reference for anyone building with these tools.

# tags

Rust Fair Share Llm Ops Message Queue Ollama

# install

npm install ollamaMQ

languages

Rust100%

last commit2 months ago

licenseMIT

more Ollama repos