"A huge benefit is that the radix of the device can lead to 524,288 accelerators on a 2 layer switched network... multiple links from the GPU to the network exist. If a link fails, the GPU might see a performance blip, but the packets would find another path which can be better for reliability."