CASALIOY

Tiny toolkit for air-gapped LLMs on consumer-grade hardware. Maintained by su77ungr on GitHub, where it has earned 222 stars from the community.

It's actively developed around langchain, llamacpp, llm, and is a solid reference for anyone building with these tools.