Questions tagged [random-forest]

Random forest is a machine-learning classifier based on choosing random subsets of variables for each tree and using the most frequent tree output as the overall classification.

Filter by
Sorted by
Tagged with
2
votes
1answer
27 views

Random Forest workflow?

I have a data-set comprised of a fairly large number of columns (over 1000) relative to the number of rows (370) that I am currently running a random forest regression on. I am a little confused with ...
1
vote
0answers
10 views

What toolbox to use to create multi-output random forest(reggression) with custom spltting function at each node?

I am trying to implement "Real Time Head Pose Estimation fromConsumer Depth Cameras" by Fanelli et al. I need to train a random forest(regression) with the following criterion The predicted output is ...
1
vote
1answer
21 views

Which decision tree model is used in “standard” random forest?

Is that CART? Why not using C5.0 tree? A perhaps more general question: Since C5.0 tree frequently have better performance than CART, why people still use CART to build random forest (or people ...
1
vote
2answers
43 views

is it ok to get 100% accuracy in random forest classifier algorithm?

while i was building the model to predict the performance of machine using the features like OEF,working time,performance/head etc... I splitted the training data using ...
1
vote
1answer
16 views

is there any rule to apply pca to the imbalance data? [closed]

Is there any rule to apply PCA to imbalanced data? (randomforest, xgboost) I used multiclass imbalance data to pca but the log-loss accuracy getting decrease any theoritical background of this?
0
votes
1answer
18 views

random forest and log_loss metric?

Light gbm has the metric with log_loss for binary or multi classification. is Random Forest also has the loss function with log_loss?
0
votes
1answer
11 views

when my RF log_loss socre is different then submit score?

I train the RF and I sumbit to the data competition but my train score is so much different then their submit socre is there way to decrease this gap? Here is my code with RF ...
1
vote
1answer
25 views

order of features for model tuning vs model fitting

Assuming that the same columns (i.e., features) are used for hyperparameter tuning and model fitting, and ensemble models are used for modeling (e.g., Random forest or XGboost), then does the order of ...
0
votes
0answers
10 views

box plot and the anomaly detection?

i'm doing a classification problem with 50000 rows × 5000 columns of dataset. calssification label is 300 labels 1. This is the few example of box plot of some feature. what can I inference from ...
1
vote
0answers
13 views

Do you need to perform variables reduction for tree-based models?

I know for methods and linear regression, GLM, Logistic regression, we typically run through a lot of variable reduction methods, i.e, forward/backward/stepwise, univariate analysis; variable ...
4
votes
0answers
45 views

Why gradient boosting uses sampling without replacement?

In Random Forest each tree is built selecting a sample with replacement (bootstrap). And I assumed that Gradient Boosting's trees were selected with the same sampling technique. (@BenReiniger ...
0
votes
0answers
25 views

Keras : How to Connect CNN ResNet50 with svm/random forest classifier?

I want to classify multiclass (10 classes) images with random forest and SVM classifier, that is, make a hybrid model with ResNet+SVM , ResNet+random forest. My ResNet code is below: ...
1
vote
1answer
24 views

LIME Random Forest explanations:

I'm using LIME to explain my random forest model. Everything is working great. However, I don't quite understand the image that is generated. Taking the example from the Readme: How can it predict ...
0
votes
1answer
21 views

Techniques for increase random forest classifier accuracy

I build basic model for random forest for predict a class. below mention code which i used. ...
1
vote
0answers
14 views

Multiclass AUC score higher than binary

I just built a random forest classifier and wondered about the results. I have 4 classes: A, B, C and control. When I compare A vs control, B vs control, C vs control I get a lower average AUC score ...
1
vote
1answer
20 views

imbalanced target dataset(multi class)

I have a multi-class prediction problem but the 300classes is imbalanced should I make it balance all 300 class will predict the better result? is there an easier method to do this job? if I'm using ...
0
votes
1answer
45 views

Feature Importance from a GridSearchCV

I created a GridSearchCV for a Random Forest Regressor. Now i want to check the feature importance. I searched around and I found this ...
5
votes
1answer
40 views

Search for hyperparameters whith different features using Random Forest

I have a dataset in which I would like to perform a classification model, so I have decided to use Random Forest. The number of features that I have is approximately 200 and I would like to test which ...
2
votes
0answers
27 views

Confused about the MSE ERROR

I am created a random forest regressor and calculate my own error. I want also to calculate MAE, MSE and RMSE to compare my results to similar usecases. But the results of the MAE, MSE, RMSE are ...
1
vote
2answers
29 views

How many trees does a random forest need?

At first, I did a GridsearchCV and the best parameter is a random forest with just 100 trees. My trainset has 80.000 rows and 669 columns. My test set has 20.000 rows and 669 columns. How is it ...
4
votes
2answers
44 views

It is alright to split a GridSearchCV?

Is it ok to split a GridsearchCV? At first, I would try estimators from 100 - 300 (100 steps) for a random forest regressor and some other parameters and after that GridsearchCV I would start the ...
2
votes
1answer
32 views

Why does my GridSearcCV always break up?

My GridSearchCV for my random forest breaks up. I need to know the reason and the solution to make it work: ...
2
votes
1answer
37 views

Bagging or Random Subspace Method for Random Forest?

I am reading a lot about the random forest regressor. I reading about bagging (bootstrap and aggregation) and random subspace. But I am not sure if the random forest regressor just using bagging or ...
1
vote
1answer
30 views

Should I transform my feature into normal distrubition before Isolation Forest

I have a anomaly detection problem and my features are following exponential distrubition. Should I first transform my features into normal distrubition before feed into isolation forest?
3
votes
1answer
45 views

Make a random forest estimator the exact same of a decision tree

The idea is to make one of the trees of a Random Forest, to be built exactly equal to a Decision Tree. First, we load all libraries, fit a decision tree and plot it. ...
0
votes
1answer
67 views

How many features does (Random Forest) need for the trees? [closed]

How can I determine how many features Random Forest needs to create a tree?
1
vote
0answers
26 views

Validation curve/RandomizedSearchCV difference train and test score

Ive build a RF model for an imbalanced data set that after feature selection has an F1 score of 54.26%. I am now trying to do hyper parameter tuning using RandomizedSearchCV, after creating validation ...
5
votes
2answers
377 views

RandomForest and tree feature importance in scikit-learn

What is the difference between model.feature_importances_ and tree.feature_importances_ in the following code: ...
1
vote
1answer
68 views

Random Forest prediction fails due to unseen Features

I have trained a Random Forest Model on some dataset and like to predict outcomes on other data which were not seen in training. When doing this, I get ...
2
votes
0answers
26 views

How to tune the hyperparameters of XGBoost and RF? [closed]

How to tune the hyperparameters of XGBoost and RF in python? There are several methods to tune hyperparameteres of XGBoost and RF such as Bayesian Optimization and meta learning and gridseachcv? ...
0
votes
1answer
45 views

Feature importance and deriving rules using tree based classification models

I have a dataset where I have categorical and continuous values with targets 0/1 (binary classification task). Since I need to find patterns and relationships in the occurrence of the event or target, ...
1
vote
1answer
55 views

How is the 'feature_importance_' value calculated (in sklearn modules) for each variable in a random forest regressor?

I have 9000 sample, with five features, and one output variable (all are numerical, continuous values). I used random forest regression method using scikit modules. ...
2
votes
2answers
80 views

How to plot number of Trees and OOBs score with Grid Search

I searched to find the answer but I don´t find something with Grid Search. I create a random forest and gradient boosting regressor with grid search. Now I want to make a visualization to see if the ...
1
vote
1answer
24 views

Making sense of a accuracy plot for a 5 fold training using random forest

I'm using sklearn.model_selection.learning_curve for 5 fold training of data. The code is as given below. ...
1
vote
1answer
27 views

How to use random forest model to new data?

I am new to this Data Science field. I have a question to apply Random forest to new data. I have this table. ...
2
votes
3answers
72 views

Is over-fitting a matter of features engineering or a matter of parameters set?

I am using sklearn package to make models. I tried randomly to set some paramater to a sklearn.ensemble.RandomForestClassifier ...
3
votes
2answers
291 views

How do tech-companies employ Random Forest on large data sets?

The algorithm takes quite a long time to train on large data sets with a moderate number of parameters: https://stats.stackexchange.com/questions/37370/random-forest-computing-time-in-r https://...
1
vote
0answers
18 views

Calculate a Rank function from Regression features

I am using 3 features (x1, x2, x3) for regression. Some of my features are continuous some are categorical. My dependent variable are lets number of bookings. And I can predict the number of bookings....
2
votes
2answers
81 views

in which case can I say that the data are bad and I ll achieve nothing using machine learning on it

general Infos about my dataset: I have 40k data points and 5 features. I'm doing regression and trying to build a model that can predict the error of a GPS. for example imagine that your vehicle GPS ...
-1
votes
1answer
35 views

Implementation explanation for predict_proba in RandomForestClassifier- sklearn

Attached is an extract from the RandomForestClassifier documentation of sklearn. The last line,"The class probabilities of a single tree is the fraction of samples of the same class in a leaf." is ...
0
votes
1answer
43 views

How to understand clearly the feature importance computing in random forest model

I want to know the details of feature importance computing of random forest with gini index. I refer to this Chinese blog:https://www.jianshu.com/p/7a876bb876b9. But I don't understand clearly these ...
0
votes
0answers
19 views

Ensemble two models

I have regression task and I am predicting here with linear regression and randomforest models. Need some hints or code example how to ensemble them (averaging already done). Here are my model ...
-1
votes
1answer
30 views

Number of features of the model must match the input. Model n_features is 994 and input n_features is 471

I Use the random foraest model for the text classification below is the code: ...
2
votes
1answer
12 views

Thoughts on Feature Engineering of a duration_in_program Variable

So I am trying to predict which customers would leave a loyalty program sponsored by X firm, using an ML classification model. I further believe that the duration for which a customer has been in the ...
1
vote
0answers
9 views

How to use “related” and “unrelated” as classes rather than multiple classes?

I have a dataset with about 15 feature columns and about 1000 rows that I'd like to use for supervised training. Every row can be classified as "related" or "unrelated" to another row. About fifteen ...
1
vote
1answer
25 views

Random Forest Model Giving Same Accuracy for different feature sets after tuning

I am having this weird issue and cannot seem to find a solution. I am trying to tune a different random forest model for every different feature-set. Basically from a given data set, I have created 3 ...
0
votes
1answer
79 views

Random Forest Overfitting, issues with mtry=1?

I am constructing what is known as an 'Expected Goals' model for football. This metric measures shot quality and a probability is assigned to a shot to achieve this, i.e. the chance a shot will be ...
2
votes
3answers
54 views

Big difference in randomTree accuracy with train and test sets

I've created a model using randomForest for the following dataset: https://archive.ics.uci.edu/ml/datasets/Contraceptive+Method+Choice The thing i'm questioning is that the results of the model when ...
3
votes
2answers
74 views

Am I overfitting my random forest model (more information in description)?

First off, sorry if this a novice question! Relatively new to all this stuff. Posted this in Stack Overflow and someone sent me here! Hope it's the right place. Anyway, I'm working with 22 datasets ...
1
vote
1answer
356 views

Random Forest VS LightGBM

Random Forest VS LightGBM Can somebody explain in-detailed differences between Random Forest and LightGBM? And how the algorithms work under the hood? As per my understanding from the documentation: ...

1 2 3 4 5 10