Questions tagged [glorot-initialization]
The glorot-initialization tag has no usage guidance.
4
questions with no upvoted or accepted answers
2
votes
0
answers
105
views
TF: What is the difference between the 'kernel weights' and the 'recurrent kernel weights' in LSTMs/GRUs?
Context:
I am trying to understand the differences between the GRU/LSTM cells from tensorflow and pytorch (for research reproducibility) and noticed that TensorFlow differentiates between the ...
- 160
1
vote
0
answers
15
views
confusion with Xavier Initiliazation definition
When researching online, I keep finding that Xavier/Glorot initialization is:
however, the original paper by Glorot said that this was a common initialization strategy that they soon found did not ...
- 11
0
votes
0
answers
8
views
How to derive the formula 13 in the Xavier Initialization paper
How to derive the formula 13 in the Xavier Initialization paper Understanding the difficulty of training deep feedforward neural networks from the formula 6?
- 771
0
votes
0
answers
30
views
Clarifying the arguments of "Understanding the difficulty of training deep feedforward neural networks"
I made the decision to try to push through the paper "Understanding the difficulty of training deep feedforward neural networks". (The paper is given as a reference in "Hands-On Machine ...
- 101