[AI & ML]

llmaz by InftyAI

Easy, advanced inference platform for large language models on Kubernetes. Star to support our work!. Maintained by InftyAI on GitHub, where it has earned 308 stars from the community.

@InftyAI

maintainer

★ 308 stars

46 forks

8 watchers

# install

go get github.com/InftyAI/llmaz

# tags

Go Kubernetes Llm Llamacpp Sglang

languages

Go92%

Makefile5%

Python3%

last commit11mo ago

licenseApache-2.0

latest versions

v0.1.4↗v0.1.3↗v0.1.2↗v0.1.1↗v0.1.0↗

more Ollama repos

AI & ML

Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama!. Maintained by nekomeowww on GitHub, where it has earned 240 stars from the community.

@nekomeowww7mo ago

AI & ML

Kubernetes Copilot powered by AI (OpenAI/Claude/Gemini/etc). Maintained by feiskyer on GitHub, where it has earned 237 stars from the community.

@feiskyer11mo ago

AI & ML

A small utility to use Ollama models in LM Studio (and vice versa via symlinking) without duplicating disk space. Maintained by qaribhaider on GitHub, where it has earned 132 stars from the community.

@qaribhaider3mo ago