0
$\begingroup$

I'm trying to visualise a neural network schematic and found a great tool for building schematics here http://alexlenail.me/NN-SVG/index.html. I've edited the SVG file to change one of the dense layers into a LSTM layer, and the input to time series instead of singular neurons.

At the bottom of the image there is some set notation detailing how many neurons is in each layer. I'm not too familiar with set notation. I'm not quite sure how to represent the LSTM layers the number of neurons in accordance with the set notation given?

Its a singular LSTM layer with hidden_size=8 and the input/output size is obviously just the previous/next layers (5 and 8).

Also, the same question applies for the initial time series inputs; how to represent 5 time series of (say 100 points long) in set notation?

Any additional advice on how it might be better to represent the architecture would also be appreciated! Thanks!

Neural Architecture

$\endgroup$
0
$\begingroup$

Within the recurrent cell, you can add the hidden units- often, we se this notated as:

Unit 1
  ...  
Unit n

Where n is the dimensionality of the recurrent representation.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.