LEANN

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device. Maintained by StarTrail-org on GitHub, where it has earned 12,678 stars from the community.

It's actively developed around ai, faiss, gpt-oss, and is a solid reference for anyone building with these tools.