LLMinator

Gradio based tool to run opensource LLM models directly from Huggingface. Maintained by Aesthisia on GitHub, where it has earned 99 stars from the community.

It's actively developed around chatbot, cpu, cuda, and is a solid reference for anyone building with these tools.