I understand that the formula for the gradient of W and U is this: figure 1

How might I go around programming ds/dst-1 for example?

  • $\begingroup$ It is not very clear what you mean but if you are looking for the formulas of RNNs,I recommend you take a look at Alex Grave's implementation. $\endgroup$ – Media Aug 19 '18 at 6:17
  • $\begingroup$ @Media the issue is I’m not sure how you would code ds/dst-1 specifically. Also would you be able to link me the the implementation as I cannot find it. Thank you $\endgroup$ – Finn Williams Aug 19 '18 at 13:15
  • $\begingroup$ here. $\endgroup$ – Media Aug 19 '18 at 19:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.