Can someone explain RMSprop in layman's terms? I have tried reading various resources but they don't talk about the intuition on couple of things:
1) Why is is different from SGD with momentum? 2) Why does it actually work?
The only literature I could find were the slides of the professor who wrote this optimization technique and the slides didn't make a lot of sense to me.