LlamaIndex-RAG-Linux-CUDA

Examples of RAG using Llamaindex with local LLMs in Linux - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B. Maintained by marklysze on GitHub, where it has earned 10 stars from the community.

It's actively developed around cuda, gemma, gemma-2b, and is a solid reference for anyone building with these tools.