It is given that:

MSE = bias$^2$ + variance

I can see the mathematical relationship between MSE, bias, and variance. However, how do we understand the mathematical intuition of bias and variance for classification problems (we can't have MSE for classification tasks)?

I would like some help with the intuition and in understanding the mathematical basis for bias and variance for classification problems.

Any formula or derivation would be helpful.

  • $\begingroup$ I don't fully understand the question, what are you looking for exactly? $\endgroup$ – Djib2011 Jun 19 '19 at 13:32
  • $\begingroup$ oops sorry. Updated in the question itself. What to know mathematical intuition of bias variance for classification problem. Fore regression it has relation with MSE but classification how to relate them.? $\endgroup$ – IamTheRealFord Jun 21 '19 at 8:51
  • $\begingroup$ WHAT classification? Logit? $\endgroup$ – Peter Jun 21 '19 at 20:01
  • $\begingroup$ If you are looking for the concept, see datascience.stackexchange.com/questions/53758/… and deeplearningbook. $\endgroup$ – Fatemeh Asgarinejad Jun 25 '19 at 6:43
  • 1
    $\begingroup$ ya already gone through that. But how will it work for classification problem.? (we dont have mse there know) $\endgroup$ – IamTheRealFord Jun 25 '19 at 7:17

My opinion is that the bias variance trade off is rooted in the Uncertainty principle. It behaves absolutely the same.

  • 1
    $\begingroup$ yes. I am currently reading this to decompose bias-variance for general loss function. www-bcf.usc.edu/~gareth/research/bv.pdf.. Also searching(both intuition and mathematically) why decreasing bias increases variance and vice versa! $\endgroup$ – IamTheRealFord Jun 25 '19 at 11:13

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.