5
$\begingroup$

Long short-term memory is a recurrent neural network architecture introduced in the paper Long short-term memory.

Can you please tell me where the name comes from?

("Memory", as the network can store information because of the recurrence - but where does the "Long short-term" come from?)

$\endgroup$
6
$\begingroup$

In Sepp Hochreiter's original paper on the LSTM where he introduces the algorithm and method to the scientific community, he explains that the long term memory refers to the learned weights and the short term memory refers to the gated cell state values that change with each step through time t.

edit: quote from paper "Recurrent networks can in principle use their feedback connections to store representations of recent input events in the form of activations ("short-term memory", as opposed to "long-term memory embodied by slowly changing weights)"

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.