burn-lm

Democratizing large model inference and training on any device. Maintained by tracel-ai on GitHub, where it has earned 265 stars from the community.

It's actively developed around burn, large-model-inference, open-webui, and is a solid reference for anyone building with these tools.