Regarding a classification problem where for example given an image which depicts a human and we are trying to predict their stance and their behavior. For example Human 1: 'Sitting' and 'Eating' in the first image whilst Human 2: 'Standing up' and 'laughing' in the second. What is the appropriate way of applying the confusion matrix on the predictions. Do I have to unify the predictions?
E.g we have 5 different stances and 5 different behaviors, as a result the confusion matrix is of size 25x25 because we have 25 different classes. Or is there any other way of dealing with such problems?
Is it possible to do the same with multiple objects on an image and how?