< cd ../gallery
[AI & ML]
local-llm-autotune
Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.
@tanavc1
maintainer
★ 31 stars
# README
Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x. Maintained by tanavc1 on GitHub, where it has earned 31 stars from the community.
It's actively developed around apple-silicon, cli, inference-optimization, and is a solid reference for anyone building with these tools.
# tags
# install
npm install local-llm-autotunelanguages
Python84.276%
TypeScript7.259%
HTML6.754%
PLpgSQL0.748%
Shell0.507%
Ruby0.306%
Dockerfile0.052%
CSS0.039%
Go Template0.039%
JavaScript0.019%
last commit3 weeks ago
licenseMIT
more FastAPI repos