I recently started getting hands-on with GPU infrastructure. Before running any workloads on the cluster, I wanted to benchmark the network and see what the hardware was actually capable of. The setup was two servers with eight NVIDIA H200s in each, so sixteen GPUs. I’ve spent about twenty years in ordinary IT infrastructure, but I’m […]
