I am training a classifier (e.g, animals), and since many categories are too similar (e.g., insects), I am grouping some categories together (e.g., bugs and mosquitoes as insects). Then, I will train a classifier to distinguish between the different insects.
How can I evaluate the performance of the two together?
Let's say that the first level is
['cat', 'dog', 'insects'] with accuracy of 90%
And the second level is
['mosquito', 'bug'] with accuracy of 80%
What's the overall accuracy?