Hot answers tagged

1 vote

Out-of-Range Target Variable in Sequence-based Machine Learning Model

"Interpolation is easy. Extrapolation is hard." Extrapolating might be the right thing to do. But always be suspect of a model that is leading you to big unexplored regions of the state ...
J_H's user avatar
  • 473
1 vote

LSTM For Predicting Vector Sequences

There are many problems with that code: It uses a lot of LSTM layers. Instead, start with a single LSTM. As you are working with text: Use token indices as input and have an initial embedding layer ...
noe's user avatar
  • 23.8k
1 vote

Converting a Standard LSTM RNN over to a Transformer Model

With a bit of elastic net, dynamic gradient clipping and adjustments to the transformer model build training is progressing nicely now. Here is the build that fixed it: ...
Ted Wilmont's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible