In Natural language processing, what are the major applications of Hidden Markov Chain (HMM), and what are the alternatives that usually can outperform HMM, is RNN and LSTM always the choice right now?
1 Answer
Transformer based architectures are some of the most popular in NLP right now. You can check this blog post for more information:
https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html
Other than performance, one major advantage of transformers is that operations can be parallelized, making it much faster than RNNs/LSTMs.