Lets say i have a samples taken from veterinary hospital , one of my feature will be the type of the animal and some other features such as fever , size,symptom etc.. , my labels are the medicine given to that animal.
if each medicine is unique to that type of animal (Medicine A should be given to animal A , and there are no Animal B that taken Medicine A) . What will be the cons and pros to building one classifier for the whole data set vs split classifier for each animal (since there wont be valid generalization between animals)