3
$\begingroup$

For machine learning, we need to normalized the inputs (features) for good results. Do we need to normalize the output as well during training?

$\endgroup$
5
$\begingroup$

First you do not always need to normalize (standardize) the input vectors (feature vectors), sometimes is good, sometimes is bad. In general you scale your feature vector when the magnitude of a feature dominates the others, so the model cannot pick up the contribution of the smaller magnitude features. Read here for a detailed explanation.

Second there are two general classes of machine learning problems: classification and regression. In a classification type problem the output (dependent variable) is discrete, so you do not need to normalize it.

In a regression type problem scaling the output do not affect the shape of your function see here. Moreover it does not affect error functions like Mean Squared Error, i.e. the error is also scaled.

$\endgroup$
  • $\begingroup$ so is it yes or no? $\endgroup$ – HAL9000 Nov 26 '19 at 21:34
  • 1
    $\begingroup$ No, you don't need to normalize the output $\endgroup$ – Dani Mesejo Nov 26 '19 at 21:50

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.