Low-Latency Strix Halo Cluster with RDMA (RoCE/Intel E810) and vLLM, Framework Desktop Boards

51K views16:18 runtime

This video demonstrates a 2-node Strix Halo cluster utilizing RDMA (RoCE/Intel E810) and vLLM for tensor parallelism. It covers hardware integration, including direct-attached RDMA and custom cooling, alongside software configurations, addressing RCCL support for gfx1151 in ROCm…

#vllm#tutorial#aillm

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.