dspark-vllm-gx10 by Anemll

An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters. Maintained by jranaraki on GitHub, where it has earned 66 stars from the community.

GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K depth, serving 316K context. Maintained by tonyd2wild on GitHub, where it has earned 12 stars from the community.

Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard. Maintained by niklasfrick on GitHub, where it has earned 86 stars from the community.