< cd ../gallery
[AI & ML]
context-compressor by Huzaifa785
AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning with advanced compression strategies. Maintained by Huzaifa785 on GitHub, where it has earned 87 stars from the community.
# install
pip install context-compressormore FastAPI repos
AI & ML
OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service. Maintained by Nayjest on GitHub, where it has earned 148 stars from the community.
2mo ago
AI & ML
Drop-in prompt compression for production LLM apps. Cut your token bill 40-60% without changing your code. Python SDK, LLMLingua-2, MIT. Maintained by jia-gao on GitHub, where it has earned 316 stars from the community.
8w ago
AI & ML
LLM orchestration toolkit for agent workflows: planner + workers + synthesis, optional router (LLM + learned fallback), supports OpenAI/Anthropic/Ollama/llama.cpp, real scraping with caching, MCP server integration, and a TUI chat UI. Maintained by llm-use on GitHub, where it has earned 53 stars from the community.
8mo ago