Microsoft Releases RDMA Over USB4 Preview, Cuts Latency 4x, Tests 120B Model

Microsoft released a developer preview of RDMA over USB4 on Windows Thursday, letting three or four Core Ultra Series 3 PCs pool memory to run the 120-billion-parameter GPT-OSS-120B model.

Microsoft released a developer preview of RDMA over USB4 on Windows Thursday, letting two or more USB4 PCs pool memory and GPU compute for AI models that exceed a single machine’s capacity.

USB4 RDMA Cuts Latency Fourfold

Windows has supported RDMA for years via the NetworkDirect interface, but only with server-grade Ethernet and InfiniBand adapters rarely found in consumer PCs. The new provider implements RDMA in software on the USB4 host router’s DMA rings, creating a faster path on top of Windows’ existing USB4 host-to-host networking.

In Microsoft’s tests between two PCs, RDMA over USB4 reduced round-trip latency for small messages to 28–50 microseconds—roughly four times lower than Ethernet (UDP) over the same USB4 link. The 80 Gbps ports also deliver twice the bandwidth of 40 Gbps connections.

AMD Backs the Driver

At AMD, we believe clustering is a critical part in a developer's experience to unlocking new possibilities for local AI and high-performance compute. We're excited to be working alongside Microsoft to support their new RDMA over USB4 driver to enhance the experience. Andrej Zdravkovic

Intel Tests 120-Billion-Parameter Model

Intel measured GPT-OSS-120B, a roughly 120-billion-parameter model that does not fit in a single 64 GB PC, on three and four Core Ultra Series 3 PCs with 64 GB of memory at 9,600 MT/s each in a full USB4 mesh.

AMD, founded in 1969 by Jerry Sanders and fellow Fairchild Semiconductor alumni, entered the microprocessor market in 1975 by reverse-engineering Intel’s 8080. A seven-year legal battle over Intel’s i386 blueprint ended in AMD’s favor in 1994, but required the company to develop its own x86 designs in-house. After outsourcing manufacturing with the 2009 GlobalFoundries spin-off and acquiring Xilinx in 2022 for FPGA technology, AMD surpassed Intel in market capitalization for the first time in 2022.

Preview Demands 40 Gbps USB4 Ports and Matching Insider Builds

The preview requires USB4 ports at 40 Gbps or faster, enough ports to connect every PC directly—two ports per PC for a three-node cluster—one USB4 cable for each pair of PCs connected directly without daisy-chaining, and the same RDMA-enabled Windows Insider build from the Experimental Channel on every machine.

The NetworkDirect provider, samples and link-test tools are open source and available at https://aka.ms/usb4-rdma-nd-provider. Microsoft says it is exploring bringing RDMA over USB4 to more PCs, silicon partners and a future Windows release based on preview feedback.

Earlier coverage: NVIDIA, Microsoft Extend Full-Stack AI Collaboration From Azure to Windows PCs

Photo of author

Technology Desk

Technology Desk at Archyde.

Reigns Lobbied for Femi vs. Lesnar to Main-Event SummerSlam Night One, Thompson Reports

Disabling Cellular Recycling Gene Boosts Membrane Protein Yields for Drug Discovery