orpheus-streaming by taresh18

Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards. Maintained by notwitcheer on GitHub, where it has earned 26 stars from the community.

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. LLM、Embedding Reranker OpenAI API. Maintained by hcd233 on GitHub, where it has earned 18 stars from the community.

OpenAI-compatible, vLLM-served OCR API for the Surya-OCR-2 model — multilingual document OCR (layout + text recognition) with request batching, a local CLI, and Docker packaging. Maintained by wuxuedaifu on GitHub, where it has earned 21 stars from the community.