New answers tagged

0 votes

XGBoost prints trees beyond n_estimator

It's because you're doing multiclass classification, and xgboost does that by building parallel models for each class. So the total number of trees is actually $512\cdot (\text{# classes})$. I don't ...
  • 10.8k
0 votes

Decision tree vs logistic regression feature importances

The difference in the importance of the 'Total day charge' coefficient between the decision tree and logistic regression models is due to the way that each model ...
  • 2,981
0 votes

Why do we need XGBoost and Random Forest?

First Question: XGBoost converts weak learners to strong learners. What's the advantage of doing this? Combining many weak learners instead of just using a single tree? Just to get the vocabulary ...
  • 191
0 votes

How does XGBoost compute the probabilities in predict_proba()?

XGBoost is a gradient-boosting algorithm, which means it builds an ensemble of weak decision trees in a sequential manner, where each tree learns to correct the mistakes of the previous trees. To ...
  • 2,981
0 votes

Noisy Data Robustness - NN vs Decision Tree

It is not fair to say that Decision Trees are more sensitive to noise in the data comparing to NN. It really depends on your model type (DT, NN, SVM, ... etc) and the model complexity. in general, ...

Top 50 recent answers are included