< cd ../gallery
[AI & ML]
InferenceX by SemiAnalysisAI
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，™ TPUv6e/v7/Trainium2/3. Maintained by SemiAnalysisAI on GitHub, where it has earned 1,318 stars from the community.
more vLLM repos
AI & ML
An local, offline (after initial setup), portable OCR software that can process images and PDF files, using DeepSeek-OCR-2 AI (running directly on your machine). Maintained by th1nhhdk on GitHub, where it has earned 778 stars from the community.
3mo ago
AI & ML
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer. Maintained by LMCache on GitHub, where it has earned 11,024 stars from the community.
2mo ago
AI & ML
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers. Maintained by containers on GitHub, where it has earned 2,987 stars from the community.
2mo ago
