Skip to main content
4 events
when toggle format what by license comment
Nov 9, 2017 at 13:21 comment added Green Falcon Actually I have seen this in the paper of SGD but it as the authors of the paper claimed it is the reason of convergence not the shuffling. I saw the link and I doubt it a bit. for more clarity look this amazing paper. The authors have mentioned the point there, but as you will see there is no exact reason for shuffling
Nov 9, 2017 at 13:14 comment added OmG @Media The most related answer in the provided link is: "Shuffling mini-batches makes the gradients more variable, which can help convergence because it increases the likelihood of hitting a good direction"
Nov 9, 2017 at 12:04 history edited OmG CC BY-SA 3.0
added 148 characters in body
Nov 9, 2017 at 11:54 history answered OmG CC BY-SA 3.0