Suppose have two 'image classification' models created by transfer learning on the same base model, each producing a different set of labels/classes. Trained at different times, with different training images. Just Transfer learning, not fine-tuning.
As understand it when training, the initial layers are extracted from the base model, and 'frozen' so only the final layers are retrained, so in concept it seems the both final models will have common initial layers, with different output dimensions.
Is there a way to join or combine the final models, to create a single model that can predict all the labels. The input would be the same but output would be a single longer list of labels?
Say each model produced predictions for 5 labels/classes. The new combined model would produce 10 labels. The output layer would be bigger. Penultimate layers may need to grow too, although the input and initial layers would be unchanged.
Expect this is a relatively common operation, but unsure on terminology, merge/combine/concatenate? Ultimately would be doing it in python, on ready created models.
 EfficientNet B0 using liner.ai