How is the data classified as long-term memory and short-term memory? Is there some standards programmers set?


I recommend you to read http://colah.github.io/posts/2015-08-Understanding-LSTMs/

Basically, the long-term memory and short-term memory are reflected in the structure of the LSTM Network. Please take a look at the diagram from the website I've mentioned. enter image description here

The long-term memory is constructed in the "bus" on the top, where the previous value can be passed, depends on the $\sigma$ value. The $\sigma$ is between $[0,1]$ and $0$ means- forget the last value, $1$ means- get all (exact) the value from the last state. Sigmas for each cell are established during the training phase.

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.