1
$\begingroup$

I've searched everywhere and still couldn't figure this one out. This post mentioned that Gradient Boosting is better than Random Forest for unbalanced data. Why is that? Is Random Forest worse because of bootstrapping (perhaps this wouldn't get a stratified sample during training, idk)?

Any thoughts?

Thanks in advance

$\endgroup$
1
  • $\begingroup$ I'd highly recommend to check out this stack exchange question. Although it's a general approach comparing Random Forest results versus Gradient Boosting, it contains a lot insights. $\endgroup$
    – Miss.Alpha
    Oct 17, 2022 at 21:42

1 Answer 1

1
$\begingroup$

Boosting is the method of creating ensemble by increasing the importance of wrongly predicted instances in each iteration. RandomForest works by creating ensemble using Bootstrap Aggregating which involves 'sampling with replacement'. So, when you have imbalanced dataset random sampling is less likely to work than when you are increasing the importance of misclassified (in imbalanced dataset) instances as in Boosting.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.