Connected to a single Nvidia DGX A100 via five 200Gbe/HDR ports, standard performance and GPUDirect tests were run, both showing the same 118GB/sec. However, consecutive deep learning jobs run by Eyal ...