New answers tagged random-forest
0
votes
Why do we need XGBoost and Random Forest?
First Question: XGBoost converts weak learners to strong learners. What's the advantage of doing this? Combining many weak learners instead of just using a single tree?
Just to get the vocabulary ...
- 191
0
votes
How far or close would feature importance information from an ML model is from causal diagrams?
Very var in general - they capture different things
The crucial part of causal diagrams is identifying a graph encoding predictive relationships between variables that agree with their conditional ...
- 111
0
votes
How does XGBoost compute the probabilities in predict_proba()?
XGBoost is a gradient-boosting algorithm, which means it builds an ensemble of weak decision trees in a sequential manner, where each tree learns to correct the mistakes of the previous trees. To ...
- 2,981
0
votes
How to interpret importance of random forest model, Mean Decrease Accuracy and Mean Decrease Gini?
Good afternoon @FOH, making a quick summary of the selection of resources would be to remove the resources that are not useful for anything. It does not improve model accuracy. It has no relationship ...
- 1
2
votes
Accepted
Random Forest on high correlated data
Welcome to the data science sector. Your three points seem to relate to different aspects. I will try to address all three:
1. Feature Importance
To explain the effect, I would go the other way and ...
- 523
-1
votes
ValueError: Input contains NaN, infinity or a value too large for dtype('float32')
Once Check X and y types. Both should be of the same kind.
- 1
0
votes
How a Random forest "learns" or How loss (objective function value) is propagated back so that a random forest can "Improve"?
In a random forest classifier, there is no backpropagated loss. Instead, the N trees are grown independently from each other and then, for a new prediction, a ...
- 126
Top 50 recent answers are included
Related Tags
random-forest × 829machine-learning × 299
scikit-learn × 177
python × 159
decision-trees × 124
classification × 120
r × 73
feature-selection × 68
regression × 63
predictive-modeling × 63
xgboost × 57
cross-validation × 38
machine-learning-model × 33
class-imbalance × 31
neural-network × 28
logistic-regression × 27
svm × 26
overfitting × 25
hyperparameter-tuning × 23
ensemble-modeling × 20
time-series × 18
accuracy × 18
feature-engineering × 17
prediction × 17
grid-search × 17