Questions tagged [convergence]
The convergence tag has no usage guidance.
2
questions
21
votes
2answers
6k views
local minima vs saddle points in deep learning
I heard Andrew Ng (in a video I unfortunately can't find anymore) talk about how the understanding of local minima in deep learning problems has changed in the sense that they are now regarded as less ...
2
votes
1answer
2k views
Convergence of vanilla or natural policy gradients (e.g. REINFORCE)
I am reading in a lot of places that policy gradients, especially vanilla and natural, are at least guaranteed to converge to a local optimum (see, e.g., pg. 2 of Policy Gradient Methods for Robotics ...