< cd ../gallery
[AI & ML]
cascade by tirdyhouse
Extend LLM context windows beyond GPU memory limits with disk-backed KV cache. Maintained by tirdyhouse on GitHub, where it has earned 11 stars from the community.
@tirdyhouse
maintainer
★ 11 stars
# install
pip install cascademore vLLM repos
AI & ML
TokenPowerBench: Benchmarking the power consumption of LLM inference across engines and deployment configurations. Maintained by chenxuniu on GitHub, where it has earned 15 stars from the community.
6mo ago
AI & ML
agentsculptor is an experimental AI-powered development agent designed to analyze, refactor, and extend Python projects automatically. It uses an OpenAI-like planner–executor loop on top of a vLLM backend, combining project context analysis, structured tool calls, and iterative refinement. It has only been tested with gpt-oss-120b via vLLM. Maintained by Perpetue237 on GitHub, where it has earned 11 stars from the community.
1y ago
AI & ML
[CVPR2025] Official Repository for IMMUNE: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment. Maintained by itsvaibhav01 on GitHub, where it has earned 29 stars from the community.
1y ago