1
$\begingroup$

I am trying to understand neural networks and how they work, by programming my own one from scratch in nodejs. Currently, i managed to build a network, that has weights, layers and neurons. I also understood what an activation function is and i am using the sigmoid function.

I've now come to the point of back propagation with the gradient descent algorithm. My Problem is, that i only know 10th grade Math and every tutorial/explanation i managed to find, uses complex functions and math which i cannot manage to understand.

I would really like to finish this project and get back propagation to work, so if someone could explain me how to use the back propagation without using too complex math (e, derivatives, functions, etc.) or explaining the complex math it would be greatly appreciated.

My source Code: https://gitlab.com/milan44/node (Training is happening in Network.prototype.train)

$\endgroup$
1
  • $\begingroup$ (+1) without 'complex' math backprop cannot be implemented. You will have to get a handle on the complex maths somehow. $\endgroup$
    – naive
    Feb 26, 2019 at 11:17

1 Answer 1

1
$\begingroup$

How about this video, which explains backpropagation intuitively?

https://www.youtube.com/watch?v=Ilg3gGewQ5U

Title: "What is backpropagation really doing? | Deep learning, chapter 3"

Author: "3Blue1Brown"

$\endgroup$
2
  • $\begingroup$ Thank you very much for your answer, but i didnt manage to get it working (see gitlab.com/milan44/node/blob/master/Network.js)... $\endgroup$
    – Twoot
    Feb 24, 2019 at 21:40
  • $\begingroup$ @Michal Please add a summary of the video you linked to. Links go dead in course of time. $\endgroup$
    – naive
    Feb 26, 2019 at 11:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.