All Questions
2 questions
3
votes
2
answers
637
views
The central idea behind SGD
Pr. Hinton in his popular course on Coursera refers to the following fact:
Rprop doesn’t really work when we have very large datasets and need to perform mini-batch weights updates. Why it doesn’t ...
3
votes
2
answers
483
views
Explanations about ADAM Optimizer algorithm
I'm a beginner in Machine learning and I'm searching for some optimizer for the gradient descent. I've searched many topics about that, and did a state of art of all these optimizers. I have just one ...