enter image description hereI am working on an object detection problem where the final loss that is being optimized is the sum of an L2 loss (for the error in the predicted w, h values), and three binary cross entropy losses (for the predicted class error, the object/no-object confidence error and the x,y coordinate error).

I see that during the training phase, the x,y and w,h losses are overfitting (validation losses go up while the training losses go down). The other losses all do seem to be optimized normally.

How do I solve this, and why am I seeing this? The overall loss seems to be going down, as the trend is influenced by the confidence loss which is substantially higher than the rest of the losses.

For a bit more context, I'm using a YOLOv3-based object detection setup.

Edit: Attaching a picture showing the xy training and validation losses overfitting. The wh losses behave in a similar fashion.

Edit 2: The setup is to detect objects on a custom dataset of ~9000 train images and ~1000 validation images. I believe the dataset and its distribution is proper because it was validated using other YOLO-based object detection models with a couple of different backend networks, all of which gave me high accuracies. This particular problem began when I switched to a different backend network with a similar number of parameters and layers as one of the previous ones that were tested and deemed proper.

  • $\begingroup$ Can you provide some plot of your loss? That would help interpretation $\endgroup$
    – Leevo
    Nov 27, 2019 at 8:48
  • $\begingroup$ Sure. Edited to add a plot of the xy-losses overfitting. $\endgroup$
    – mallochio
    Nov 27, 2019 at 9:01
  • $\begingroup$ Could you please tell us about your problem and the data? YOLO is rather deep architecture. Do you have enough data? $\endgroup$ Nov 27, 2019 at 12:50
  • $\begingroup$ Edited to add more information like you requested. $\endgroup$
    – mallochio
    Nov 28, 2019 at 7:29


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.