I have read that the SMOTE package is implemented for binary classification. In the case of n classes, it creates additional examples for the smallest class. Can I balance all the classes by running the algorithm n-1 times?
$\begingroup$
$\endgroup$
Add a comment
|
3 Answers
$\begingroup$
$\endgroup$
4
Yes that is what SMOTE does, even if you do manually also you get the same result or if you run an algorithm to do that.
There are couple of other techniques which can be used for balancing multiclass feature. Attaching those 2 links for your reference.
Link 3 is having implementation of couple of oversampling techniques:
ROSE also can be used for Oversampling.
Hope my answer is helpful. Do let me know of you have any additional questions.
-
$\begingroup$ Ok, but it's all about undersampling. I'm trying to find a solution to oversampling all minority classes. $\endgroup$– atosNov 13, 2017 at 17:53
-
$\begingroup$ appended a new link in the answer as Link , most likely that would be helpful! $\endgroup$– Toros91Nov 14, 2017 at 1:54
-
-
$\begingroup$ It turned out that SMOTE from Python by default uses oversampling of all minority classes. $\endgroup$– atosFeb 2, 2018 at 16:02
$\begingroup$
$\endgroup$
2
I am pretty sure that the SMOTE package in python can also be used for multi-class as well.
Just you can check its implementation for iris dataset-
http://contrib.scikit-learn.org/imbalanced-learn/stable/auto_examples/plot_ratio_usage.html
-Please correct me if I am wrong.
-
$\begingroup$ Well, first of all it's not about SMOTE. Secondly, I see there only methods for creating unbalanced collections from balanced and undersampling techniques. $\endgroup$– atosNov 12, 2017 at 15:44
-
$\begingroup$ Is this not the correct link contrib.scikit-learn.org/imbalanced-learn/stable/generated/… $\endgroup$– KeithNov 20, 2017 at 6:21
$\begingroup$
$\endgroup$
1
The SMOTE implementation provided by imbalanced-learn, in python, can also be used for multi-class problems.
Check out the following plots available in the docs:
Also, the following snippet:
from imblearn.over_sampling import SMOTE, ADASYN
X_resampled, y_resampled = SMOTE().fit_resample(X, y)
print(sorted(Counter(y_resampled).items()))
[(0, 4674), (1, 4674), (2, 4674)]
