subtitles-ai-ocr by hekmon

Kubernetes-native control plane for scale-to-zero serving of long-tail LLMs. Maintained by noctaya on GitHub, where it has earned 11 stars from the community.

Lightweight proxy for LLM. Maintained by yatesdr on GitHub, where it has earned 33 stars from the community.

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed. Maintained by defilantech on GitHub, where it has earned 185 stars from the community.