< cd ../gallery
[AI & ML]
localharness by ahwurm
An open-source, model-agnostic agent harness for local LLMs. Define agents in YAML (tools, memory, deny-first permissions) and run them against any OpenAI-compatible endpoint: vLLM, Ollama, LM Studio, or llama.cpp. Maintained by ahwurm on GitHub, where it has earned 17 stars from the community.
# install
pip install localharnessmore vLLM repos
AI & ML
Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop. Maintained by outsourc-e on GitHub, where it has earned 44 stars from the community.
4mo ago
AI & ML
DocMind AI is a powerful, open-source Streamlit application leveraging LlamaIndex, LangGraph, and local Large Language Models (LLMs) via Ollama, LMStudio, llama.cpp, or vLLM for advanced document analysis. Analyze, summarize, and extract insights from a wide array of file formats, securely and privately, all offline. Maintained by BjornMelin on GitHub, where it has earned 147 stars from the community.
3mo ago
AI & ML
Python SDK for Agent Vector Protocol – transfer KV-cache between LLM agents instead of text. Maintained by VectorArc on GitHub, where it has earned 25 stars from the community.
5mo ago