Made withvLLMTutorial
Low-Latency Strix Halo Cluster with RDMA (RoCE/Intel E810) and vLLM, Framework Desktop Boards

51K views16:18 runtime
This video demonstrates a 2-node Strix Halo cluster utilizing RDMA (RoCE/Intel E810) and vLLM for tensor parallelism. It covers hardware integration, including direct-attached RDMA and custom cooling, alongside software configurations, addressing RCCL support for gfx1151 in ROCm…
#vllm#tutorial#aillm