1
vote
Out-of-Range Target Variable in Sequence-based Machine Learning Model
"Interpolation is easy. Extrapolation is hard."
Extrapolating might be the right thing to do.
But always be suspect of a model that is leading
you to big unexplored regions of the state ...
- 473
1
vote
LSTM For Predicting Vector Sequences
There are many problems with that code:
It uses a lot of LSTM layers. Instead, start with a single LSTM.
As you are working with text:
Use token indices as input and have an initial embedding layer
...
- 23.8k
1
vote
Converting a Standard LSTM RNN over to a Transformer Model
With a bit of elastic net, dynamic gradient clipping and adjustments to the transformer model build training is progressing nicely now.
Here is the build that fixed it:
...
- 111
Only top scored, non community-wiki answers of a minimum length are eligible