1
vote
Tensorflow diagram for attention mechanism
This is a diagram of the attention layer that appears in the English version of the Tensorflow Transformer tutorial (other languages do not have this figure).
The ingoing arrows are inputs to the ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
attention-mechanism × 150transformer × 80
deep-learning × 53
nlp × 46
machine-learning × 26
neural-network × 25
keras × 16
lstm × 16
sequence-to-sequence × 16
tensorflow × 13
rnn × 12
bert × 11
machine-translation × 7
cnn × 6
word-embeddings × 6
pytorch × 5
encoding × 5
python × 4
time-series × 4
computer-vision × 4
autoencoder × 4
image-classification × 3
convolutional-neural-network × 3
convolution × 3
language-model × 3