llama2gptq

Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization. Maintained by seonglae on GitHub, where it has earned 31 stars from the community.

It's actively developed around langchain, quantization, transformers, and is a solid reference for anyone building with these tools.