haru by arkorlab

Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized. Maintained by rh-aiservices-bu on GitHub, where it has earned 61 stars from the community.

General Information, model certifications, and benchmarks for nm-vllm enterprise distributions. Maintained by neuralmagic on GitHub, where it has earned 11 stars from the community.

Spark Pulse is a web control plane for spark-vllm-docker. Maintained by kharkevich-engineering-lab on GitHub, where it has earned 11 stars from the community.