Rob Farber from the Pacific Northwest National Laboratory writes that multi-GPU and hybrid system performance is heavily dependent upon the vendor implementation of the PCIe bus on the computer motherboard.
All this information points to a simple, common-sense solution: purchase vendor hardware that does not compromise on the PCIe bus. Instead, look for hardware that will fully support high-performance PCIe data transfers to multiple GPUs. Even if your applications do not utilize multiple GPUs at the moment, don’t limit your application possibilities. Adding additional GPUs to increase performance by two to four times is a viable path forward.
Read the Full Story at Scientific Computing.