In order to train a recurrent neural network, you have to unfold it say 50 times and treat it like a chain of RNN cells.

Now if you are using this RNN to train in realtime, then it seems you may as well just have a chain of 50 cells. Maybe fix their weights to all be the same as in a convolutional neural network.

So are RNN's any use in learning in realtime for temporal data?


1 Answer 1


I think you misunderstood the fundamental of RNN.

fix their weights to all be the same".

Yes that's exact what RNN is suppose to be. In any type of RNN, you always only have one real RNN cell. The unrolled RNN cells are merely representations of that RNN cell overtime. In a single training step, the weights of those unrolled RNN cells are always the same.

Sp are RNN's any use in learning in real-time for temporal data?

Yes, you can train an RNN in real-time with a catch. Although in theory the sequence is arbitrary long, but in practice we can only backprop a certain step back due to

  • $\begingroup$ I think you misunderstand what I misunderstand. $\endgroup$
    – zooby
    Commented Nov 17, 2017 at 20:56

Not the answer you're looking for? Browse other questions tagged or ask your own question.