All Questions
1 question
2
votes
1
answer
905
views
What does it mean for a method to be invariant to diagonal rescaling of the gradients?
In the paper which describes Adam: a method for stochastic optimization, the author states:
The method is straightforward to implement, is computationally
efficient, has little memory requirements, ...
- 121