2
$\begingroup$

I'm new to deep learning, I am learning LSTM for my PhD work. This is a simple LSTM network for sequence classification. This code is from MATLAB tutorial: layers = [sequenceInputLayer(1) lstmLayer(5,'OutputMode','last') fullyConnectedLayer(3) softmaxLayer classificationLayer];

For simplicity, the dimension of the input sequence is 1, there are 3 classes.

I am trying to draw the diagram of this network. This is my attempt: enter image description here

Is this right? Should the LSTM blue units be connected? The orange units are the softmax layer, is there any symbol the should be on each unit (like ∑)? The same question for each layer? Should be any extra layer to represent the "classificationLayer"? The fullyConnectedLayer is represented implicitly in the full connection in the last layer, Do I need to add any extra layer for this? Any other comments, please?

$\endgroup$
  • $\begingroup$ Chris Olah has some excellent LSTM diagrams here: colah.github.io/posts/2015-08-Understanding-LSTMs $\endgroup$ – redhqs Jul 8 '18 at 10:58
  • $\begingroup$ That's right, I passed by this link before. But, it only illustrates the LSTM 'unit' diagram. I need to illustrate the whole layer and the whole network. $\endgroup$ – Osama Talaat Jul 8 '18 at 11:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.