If loss is decreasing but val_loss not, what is the problem and how can I fix it?
This indicates that model is not generalizing (it is over-fitting). Few options are :
- Get more training data
- Reduce complexity of model (Number of LSTM layers, complexity of dense layers)
Andrew NG has a good video on this topic :
A tutorial specific to LSTM :