Running this benchmark I get 50% slower performance than the author on practically all deep learning sub problems (SINGLE precision and on TRAINING only):

enter image description here

I tested this on a GeForce 1080 GTX Ti and am using PyTorch 1.0.1 with Cuda 10.0.13 (cudnn version 7402) running on an AMD Ryzen 7 1700 Eight-Core Processor (with 16 threads). OS is arch linux. The GPU temperature remains below 80 degrees at full volatile usage.

Would anyone have an idea what causes the lower performance? Can someone else with the same gfx run this and let me know what differences they see?


My guess is that the reduction in performance is due to differences in versions PyTorch. The published benchmark uses torch==0.4.1 (even though the README states something different). You are using PyTorch 1.0.1.

PyTorch 1.0 speed is sometimes slower than lower than 0.4. PyTorch 1.0 can be speed-up by adding torch.backends.cudnn.benchmark = True and compiling from source.

Often times published benchmark are heavily tuned from the "off-the-shelf" version.

  • $\begingroup$ Thanks, this seems like a sensible idea, but I would love to have someone else with a 1080ti to test this ideally, so I can be sure it's not just this. The whole question arose from the need to figure out why my ML based calcs seem slower than what others experience. $\endgroup$ – Muppet May 16 '19 at 18:05

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.