I am trying to understand neural networks and how they work, by programming my own one from scratch in nodejs. Currently, i managed to build a network, that has weights, layers and neurons. I also understood what an activation function is and i am using the sigmoid function.

I've now come to the point of back propagation with the gradient descent algorithm. My Problem is, that i only know 10th grade Math and every tutorial/explanation i managed to find, uses complex functions and math which i cannot manage to understand.

I would really like to finish this project and get back propagation to work, so if someone could explain me how to use the back propagation without using too complex math (e, derivatives, functions, etc.) or explaining the complex math it would be greatly appreciated.

My source Code: https://gitlab.com/milan44/node (Training is happening in Network.prototype.train)

  • $\begingroup$ (+1) without 'complex' math backprop cannot be implemented. You will have to get a handle on the complex maths somehow. $\endgroup$ – Amitabh-G Feb 26 '19 at 11:17

How about this video, which explains backpropagation intuitively?


Title: "What is backpropagation really doing? | Deep learning, chapter 3"

Author: "3Blue1Brown"

| improve this answer | |
  • $\begingroup$ Thank you very much for your answer, but i didnt manage to get it working (see gitlab.com/milan44/node/blob/master/Network.js)... $\endgroup$ – Twoot Feb 24 '19 at 21:40
  • $\begingroup$ @Michal Please add a summary of the video you linked to. Links go dead in course of time. $\endgroup$ – Amitabh-G Feb 26 '19 at 11:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.