I want to use sequence-to-sequence architecture to generate sequences.
My data has such structure
[0, 0, 1, 0, ..., 0, 1] --> [12.34, 0.78, 1.54, 6.90, ..., 5.32]
I follow this tutorial to achieve it.
After forwarding through
encoder_hidden is used as a
decoder_hidden. But what should I use as a first
decoder_input to Decoder network?
The original tutorial uses a
Start Of the Sequence token, but I can't use it because it is encoded as
0 as a number will give some additional information for decoder.