vast-coding-llm by anqorithm

GPU Service Manager for LLM workloads on Linux/NVIDIA systems. Maintained by jaigouk on GitHub, where it has earned 13 stars from the community.

TokenPowerBench: Benchmarking the power consumption of LLM inference across engines and deployment configurations. Maintained by chenxuniu on GitHub, where it has earned 15 stars from the community.

Kubernetes scanner that discovers LLMs running on vLLM and extracts their deployment and runtime facts. Maintained by paralleliq on GitHub, where it has earned 13 stars from the community.