quaynor

AI inference library for mobile devices. Maintained by iBz-04 on GitHub, where it has earned 31 stars from the community.

It's actively developed around flutter, gguf, inference-engine, and is a solid reference for anyone building with these tools.