Questions tagged [feature-importances]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
1answer
50 views

Feature Interactions vs Feature Importances

What are the differences between Feature Interactions and Feature Importances?
1
vote
2answers
59 views

Why is XGBClassifier in Python outputting different feature importance values with the same data across different repetitions?

I am fitting an XGBClassifier to a small dataset (32 subjects) and find that if I loop through the code 10 times the feature importances (gain) assigned to the features in the model varies slightly. I ...
0
votes
0answers
22 views

Why do random continuous and binary features rank highly in sklearn's RandomForestClassifier feature_importances_?

Goal: I'm trying to wrap my head around understanding the output of my random forest classifier's feature_importances_, which I believe is based on mean Gini decrease. Overview of dataset: ...
0
votes
0answers
17 views

Features importance in model

I've been using azure's auto ML platform for a couple of weeks now and recently I've trained a model and came across a strange looking aggregate feature importance chart in the explanations tab. The ...
0
votes
2answers
26 views

aggregation of feature importance

I have more of a conceptual question I was hoping to get some feedback on. I am trying to run a boosted regression ML model to identify a subset of important predictors for some clinical condition. ...
0
votes
2answers
29 views

difference between feature effect and feature importance

Is there a difference between feature effect (eg SHAP effect) and feature importance in machine learning terminologies?
0
votes
0answers
94 views

Var_Imp Algorithms in Pred/Class Problems: Can I use it in TS Problems?

OBJECTIVE OF THIS POST: Solve a query about the possibility of use prediction/classification variable importance tools in a time series type dataframe. Collect the largest number of variable ...
0
votes
2answers
19 views

Concerns regarding small dataset with too many features

I have dataframe with 322 observations with 224 features. The observations has two classes, 0 or 1,which i'm trying to predict. class 0 has 168 observations and class 1 has 154 observations. I was ...
0
votes
0answers
76 views

Variable importance and correlation PC's - variables

Can I relate features importance output of RF and the correlation's values between principal components and features? After RF, I used clustering (useful for my purpose). To find the features that ...
0
votes
1answer
12 views

Does it make sense to use feature importances based in gini index for other classifiers?

I would like to know if makes sense running yellowbrick.features.FeatureImportances with a RandomForestClassifier model in order ...
2
votes
2answers
56 views

Node Importance in scikit learn

I'm trying to understand exactly how feature_importances in scikit-learn's RandomForestClassifier works. I managed to find this helpful link explaining most of the process: https://towardsdatascience....
1
vote
1answer
33 views

Shapley value, conditional expectation vs reference point

In Shapley, the marginal contribution of a feature is computed by comparing the performance of a model with and without a feature over all possible subsets of features. A common choice is using the ...
1
vote
0answers
19 views

Revealing the causal structure in time-dependent data

We have a data table that accumulates the control and monitoring parameters of the High-Temperature Superconductor (HTS) production process: such that the rows represent the observations and columns ...
1
vote
0answers
18 views

How marginal contributions of adding a variable in a model is calculated in determining SHAP feature importance?

I was trying to find feature importance using SHAP values in python for Isolation Forest. SHAP calculates the feature importance of a feature($i$) pertaining to a model($f$) for a datapoint($x$) using ...
2
votes
1answer
127 views

Feature importance with Text features

I would like to determine features importance in several models: support vector machine logistic regression Naive Bayes random forest I read that I will need an agnostic model, so I have thought to ...
0
votes
0answers
38 views

Why are random forest permutation importances almost all zero?

I have built a random forest binary classification model with 18 input variables. Gini importance (MDI) shows that all variables have positive importance, although some are very small. According to ...
0
votes
0answers
26 views

Is it possible that shap feature importance result will be more accurate than gain?

XGboost build the boosted tree in the following way: Each level of each tree (the phase of selecting the next feature with conditional value) selected according ...
1
vote
1answer
39 views

Is feature importance from classification a good way to select features for clustering?

I have a large data set with many features (70). By doing preprocessing (removing features with too many missing values and those that are not correlated with the binary target variable) I have ...