Skip to main content
2 votes
Accepted

How is the weight of each new weak learner is calculated in Xgboost?

Your description sounds a bit more like AdaBoost than Gradient Boosting (XGBoost and others). AdaBoost trains its weak estimators on the original targets, just weighting/sampling the observations ...
Ben Reiniger's user avatar
  • 11.9k
1 vote

XGB predict_proba estimates don't match sum of leaves

When you call predict_proba in XGBoost, it returns the probability estimates calculated by averaging the predictions of all the ...
Multivac's user avatar
  • 2,999
1 vote

randomness in lightgbm model training

What can be the other factors adding randomness to the training process that I did not notice? By "adding randomness to the training process", I'm assuming that you mean things that could ...
James Lamb's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible