Skip to main content

All Questions

Filter by
Sorted by
Tagged with
3 votes
2 answers
637 views

The central idea behind SGD

Pr. Hinton in his popular course on Coursera refers to the following fact: Rprop doesn’t really work when we have very large datasets and need to perform mini-batch weights updates. Why it doesn’t ...
Green Falcon's user avatar
  • 14.2k
3 votes
2 answers
483 views

Explanations about ADAM Optimizer algorithm

I'm a beginner in Machine learning and I'm searching for some optimizer for the gradient descent. I've searched many topics about that, and did a state of art of all these optimizers. I have just one ...
Sabrina Tesla's user avatar