< cd ../gallery
[AI & ML]
TD-Pipe
[ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
@MLSysU
maintainer
★ 52 stars
# README
[ICPP'25] TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference. Maintained by MLSysU on GitHub, where it has earned 52 stars from the community.
It's actively developed around high-throughput, llm-inference, pipeline-parallelism, and is a solid reference for anyone building with these tools.
# tags
# install
npm install TD-Pipemore vLLM repos
