stopwatch by modal-labs

Intelligent load balancer for distributed vLLM server clusters vLLM. Maintained by xerrors on GitHub, where it has earned 19 stars from the community.

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Maintained by spark-arena on GitHub, where it has earned 422 stars from the community.

Open-source tools for training and evaluating Vision Language Models for OCR. Maintained by Roots-Automation on GitHub, where it has earned 190 stars from the community.