Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.
Sign up to join this community
I have a dataset of 1000 labels. I would like to build a custom model from this dataset with three labels, say Dog, Cat, and Others. Obviously, Others will be large in number for this approach. I understand that this could be an issue since the classifier has seen more Others examples.
Pipeline
Large dataset --> Seperate to Dogs, Cats and others --> Classifier --> Predicts Dogs, Cats or Others.
What are the other approaches which can be taken in this situation?
One option is to change the label distributions. If you want Others to be proportional to Dog and Cat, you can randomly drop instances that are not Dog and Cat.
Another option is to pick a classifier that is not influenced by the number of instances, such as support vector machine (SVM).
Yet another option is to use evaluation metrics to examine performance at the individual category level (e.g., precision for Dog, Cat, Others separately).
