When training the model, I understand
- If I supply too many on a certain category, it may become overfitted and treat almost all predictions as the overfitted category. This can lead to false positives in the overfitted directory.
- If instead, I supply the least amount of photos to equally distribute, is the probability of of a rarer category appearing is now equal to a category that would be common to find? This can lead to false positives in the rare category but may turn my false positives in #1 to be true negatives.
- If instead I skip training the rare category, I get false positives in other categories.
How do we account for the natural distribution of our target classifications (for example, types of common lesion vs rare lesions)?
Is it best practice to equally distribute? If so, what should we do if we have so little of the rare category, the sample images are orders of magnitude smaller?