All Questions
Tagged with intuition activation-function
1 question
1
vote
0
answers
135
views
Why does scaled dot-product attention use softmax?
I am trying to understand the reasoning behind the Transformer architecture.
In "Attention is all you need", the weights for the scaled dot-product attention is defined as the scaled dot-...
- 111