Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 24119

A recurrent neural network (RNN) is a class of artificial neural network where connections between units form a directed cycle.

1 vote
1 answer
215 views

LSTMs - Carousel of Error

Is there any other materials that derives the LSTM back propagation and carousel of error except the original paper? (I could not understand it, sorry). I tried deriving and got stuck, and asked the …
user1157751's user avatar
1 vote
1 answer
519 views

Sequence Batching in RNNs

I'm wondering why sequence batching in RNNs's target value loops back (I'm not sure what you call it), but let's take for example: We want to learn a sequence of numbers (our input) from 1 to 16: $$ …
user1157751's user avatar
14 votes
1 answer
7k views

Forget Layer in a Recurrent Neural Network (RNN) -

I'm trying to figure out the dimensions of each variables in an RNN in the forget layer, however, I'm not sure if I'm on the right track. …
user1157751's user avatar
8 votes
1 answer
4k views

Need help understanding LSTMs' backpropagation and carousel of error

I'm having a hard time trying to derive the maths behind LSTMs and vanishing gradients. I had a of help from LSTM forward and backward pass, but I got stuck in page 11 from LSTM forward and backward …
user1157751's user avatar