Questions tagged [gradient]
The gradient tag has no usage guidance.
3 questions
3
votes
3
answers
2k
views
Why a sign of gradient (plus or minus) is not enough for finding a steepest ascend?
Consider a simple 1-D function $y = x^2$ to find a maximum with the gradient ascent method.
If we start in point 3 on x-axis:
$$ \frac{\partial f}{\partial x} \...
13
votes
4
answers
24k
views
How to prevent vanishing gradient or exploding gradient?
What's causing the vanishing gradient or exploding gradient, and what are the measures to be taken to prevent it?
- 169
1
vote
1
answer
926
views
vanishing gradient and gradient zero
There is a well known problem vanishing gradient in BackPropagation training of ...
- 127