Skip to main content
7 votes
Accepted

How do regression loss functions like MAE and MSE work although they remove the plus/minus sign?

You're absolutely right that these loss functions seemingly discard the sign information by taking the absolute value. The key insight, however, is that while the loss function itself discards the ...
Ansh Tandon's user avatar
3 votes

How do regression loss functions like MAE and MSE work although they remove the plus/minus sign?

But the loss itself has removed this plus/minus information. From the loss value, you can't tell which direction to go in. However, we also have the loss gradient, which does include directional ...
MuhammedYunus's user avatar
1 vote
Accepted

Is it appropriate to use KL Divergence as a loss function for a 1x3 regression model?

KL divergence is defined as the number of bits required to convert one distribution into another. The lower bound value is zero and is achieved when the distributions under observation are identical. ...
xabash's user avatar
  • 86

Only top scored, non community-wiki answers of a minimum length are eligible