I'm training two ResNet models on an image dataset. The first one has been trained with random weights, while the other has been pre-trained on ImageNet before.
The second model starts overfitting after 12 epochs for which the training loss is 1.47e-3. On the other hand, the first model does not show clear overfitting behaviour after 70 epochs for which the training loss is 1.17e-3 (hence lower).
Is there a paradox ? How could I explain this ?