vllm-factory by latenceainew

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve. Maintained by modelship-ai on GitHub, where it has earned 37 stars from the community.

PDF Parsing Tool: GOT's vLLM acceleration implementation, MinerU for layout recognition, and GOT for table formula parsing. Maintained by liunian-Jay on GitHub, where it has earned 66 stars from the community.

Qwen2+SFT+DPO， SFTTrainer/DPOTrainer/TRPOTrainer，，（neo4j, milvus, LDA, ）。， vllm, vllm API embedder + Reranker RAG 。 MDAgents ， vllm api 。. Maintained by NJUxlj on GitHub, where it has earned 89 stars from the community.