Questions tagged [glorot-initialization]
The glorot-initialization tag has no usage guidance.
2
questions with no upvoted or accepted answers
2
votes
0
answers
74
views
TF: What is the difference between the 'kernel weights' and the 'recurrent kernel weights' in LSTMs/GRUs?
Context:
I am trying to understand the differences between the GRU/LSTM cells from tensorflow and pytorch (for research reproducibility) and noticed that TensorFlow differentiates between the ...
- 164
1
vote
0
answers
12
views
confusion with Xavier Initiliazation definition
When researching online, I keep finding that Xavier/Glorot initialization is:
however, the original paper by Glorot said that this was a common initialization strategy that they soon found did not ...
- 11