Why are multiple-gpu slower than single gpu

156 Views Asked by At

I trained textsum at 4-gpus and 1-gpu ,I found 4-gpus is slower than single gpu , and they all have low utilization, anyone can help me resolve this problem?

0

There are 0 best solutions below