[AI & ML]

llmariner

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

@llmariner

maintainer

★ 95 stars

go to website ↗github

llmariner — preview

# README

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs. Maintained by llmariner on GitHub, where it has earned 95 stars from the community.

It's actively developed around ai, autoscaling, fine-tuning, and is a solid reference for anyone building with these tools.

# tags

Go Ai Autoscaling Fine Tuning Gpu

# install

npm install llmariner

languages

Go100%

last commit2 months ago

licenseApache-2.0

more vLLM repos