Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized. Maintained by rh-aiservices-bu on GitHub, where it has earned 61 stars from the community.
