I am currently building a Encoder Decoder Model for Next Phrase Prediction, but only using this model is just giving satisfactory results. So I chose to attach a Attention Layer to the same architecture. Currently I found many use cases and implementations of Attention Layer for NMT(Neural Machine Translation) but none for next word prediction or next phrase prediction. Can we have such a model?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.