autonomous-grid by autonomous-ai

Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill. Maintained by slwang-ustc on GitHub, where it has earned 95 stars from the community.

Python SDK for Agent Vector Protocol – transfer KV-cache between LLM agents instead of text. Maintained by VectorArc on GitHub, where it has earned 25 stars from the community.

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving. Maintained by asprenger on GitHub, where it has earned 79 stars from the community.