What's the best strategy to train a CNN with images that only have labels for positive characteristics?

Question

I have a large database of images that are only partially labeled for multiple, non-exclusive characteristics or objects present on them. For instance, an underwater scene might feature the labels water, swimsuit and fish on it.

Problem is it's only partially labeled, meaning that the fact the label cat is absent doesn't mean there's no cat on the image.

What'd be the best strategy to train a CNN able to tell the missing labels on the dataset?

The image base has 230 thousand images on it, but given that multiple labels are possible, it's hard to tell the ratio of images that are fully labeled. I'm able to code python and managed to use keras to train on mnist dataset on gpu.

Answer 1

I think your best bet would be transfer learning. Start with a model that has already been trained with a wider dataset such as the ones presented here. From there you can train the model with your specific dataset. You can then use output nodes for the labels which you have available to you, and you can get the predictions for the other images from the pre-trained model which are usually trained for thousands of different classes.

Alternatively, you can train a model with all the output classes you have in your label set and another output for "other". Then when an output node is selected you can pass that same input to the pre-trained model which was trained with your data as well.