1
$\begingroup$

As i understand for the output layer the error rate is used with the mean squared error function to update the weights. For the hidden layers as well? Does that make sense?

$\endgroup$
1
  • $\begingroup$ Note that mean squared error is just one example of a function that can be used to as a loss function. For classification tasks, typically the negative log likelihood is used. $\endgroup$ – timleathart Oct 14 '19 at 23:38
3
$\begingroup$

A Multilayer Perceptron changes your weights by an algorithm called "backpropagation". This algorithm uses gradient descent combined with a learning rate to change every weight in your MLP.

Basically the backpropagation functions by chaining together all functions that are called when calculating the output of one particular node (so chaining together all possible ways). Now using the chain rule a gradient is calculated which directs into the direction of minimal error and changes all weights accordingly.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.