2
$\begingroup$

My question is in regards to an MIT course example.

NN Schematic

The instructor delves into the backpropagation of this simple NN.

NN with derivative chain and equations

I have two questions.

  1. Why do we seem to disregard the weights of the second layer (in blue)?
  2. The red circle, should this not be $\partial y_2$ (followed by $\frac{\partial y_2}{\partial P_3}$)?
$\endgroup$

1 Answer 1

1
$\begingroup$
  • Why do we seem to disregard the weights of the second layer (in blue)? -----because activation function is after that block, so differential with the o/p y is as good as with the weight.

  • The red circle, should this not be ∂y2 (followed by ∂y2∂P3)? -----y2 and y1 is the o/p of the same block i.e. both must be same

$\endgroup$
1
  • $\begingroup$ Wow thanks, I feel silly now. Thanks again! $\endgroup$
    – Shinobii
    Oct 20, 2019 at 17:25

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.