quaynor

AI inference library for mobile devices. Maintained by iBz-04 on GitHub, where it has earned 34 stars from the community.

It's actively developed around inference-engine, llm-inference, local-ai, and is a solid reference for anyone building with these tools.