LEANN

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device. Maintained by StarTrail-org on GitHub, where it has earned 12,761 stars from the community.

It's actively developed around ai, faiss, langchain, and is a solid reference for anyone building with these tools.