apex by pensarai

Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized. Maintained by rh-aiservices-bu on GitHub, where it has earned 61 stars from the community.

GPU orchestrator with vLLM sleep mode. Maintained by arkorlab on GitHub, where it has earned 11 stars from the community.

Code for building self-expanding knowledge graphs with Outlines, vLLM, neo4j, and Modal. Maintained by just-cameron on GitHub, where it has earned 38 stars from the community.