Questions tagged [feature-importances]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
15 views

Why does an unimportant feature has a big impact on R2 in XGBoost?

I am training an XGBoost model, xgbr, using xgb.XGBRegressor() with 13 features and one numeric target. The R2 on the test set ...
0
votes
0answers
9 views

Feature importance by removing all other features?

For neural network feature importance, can I zero-out all features except one in order to gauge that feature's importance? I know shuffling a feature is one approach. For example, leaving in the 4th ...
0
votes
0answers
23 views

Feature importance in binary classification

I am wondering if there is a way to check the feature importance for each class in a binary classification task separately. Or any way to check the correlation between features and both target classes ...
0
votes
0answers
26 views

Feature Importance interpretation

I want to audit the results of regressions I ran, and hopefully gain more insights about a treatment effect through sklearn's feature importance function (...
0
votes
0answers
29 views

Assess feature importance in Keras for one-hot-encoded categorical features

An important aspect of tuning a model is assessing feature importance. In Keras, how to assess the importance of a categorical feature which is one-hot encoded? E.g. if a categorical feature is ...
1
vote
0answers
13 views

What kind of model to use to find drivers when data is aggregated and not on user level?

I have a website and have info from Google Analytics. So I can see the following "features": page url country device category (phone, desktop, etc.) Number of sessions Number of users: ...
0
votes
0answers
28 views

Why do random continuous and binary features rank highly in sklearn's RandomForestClassifier feature_importances_?

Goal: I'm trying to wrap my head around understanding the output of my random forest classifier's feature_importances_, which I believe is based on mean Gini decrease. Overview of dataset: ...
0
votes
0answers
27 views

Features importance in model

I've been using azure's auto ML platform for a couple of weeks now and recently I've trained a model and came across a strange looking aggregate feature importance chart in the explanations tab. The ...
0
votes
2answers
265 views

difference between feature effect and feature importance

Is there a difference between feature effect (eg SHAP effect) and feature importance in machine learning terminologies?
0
votes
0answers
116 views

Var_Imp Algorithms in Pred/Class Problems: Can I use it in TS Problems?

OBJECTIVE OF THIS POST: Solve a query about the possibility of use prediction/classification variable importance tools in a time series type dataframe. Collect the largest number of variable ...
0
votes
2answers
71 views

aggregation of feature importance

I have more of a conceptual question I was hoping to get some feedback on. I am trying to run a boosted regression ML model to identify a subset of important predictors for some clinical condition. ...
0
votes
2answers
32 views

Concerns regarding small dataset with too many features

I have dataframe with 322 observations with 224 features. The observations has two classes, 0 or 1,which i'm trying to predict. class 0 has 168 observations and class 1 has 154 observations. I was ...
0
votes
1answer
15 views

Does it make sense to use feature importances based in gini index for other classifiers?

I would like to know if makes sense running yellowbrick.features.FeatureImportances with a RandomForestClassifier model in order ...
0
votes
0answers
136 views

Variable importance and correlation PC's - variables

Can I relate features importance output of RF and the correlation's values between principal components and features? After RF, I used clustering (useful for my purpose). To find the features that ...
1
vote
1answer
41 views

Shapley value, conditional expectation vs reference point

In Shapley, the marginal contribution of a feature is computed by comparing the performance of a model with and without a feature over all possible subsets of features. A common choice is using the ...
1
vote
1answer
22 views

Revealing the causal structure in time-dependent data

We have a data table that accumulates the control and monitoring parameters of the High-Temperature Superconductor (HTS) production process: such that the rows represent the observations and columns ...
1
vote
0answers
24 views

How marginal contributions of adding a variable in a model is calculated in determining SHAP feature importance?

I was trying to find feature importance using SHAP values in python for Isolation Forest. SHAP calculates the feature importance of a feature($i$) pertaining to a model($f$) for a datapoint($x$) using ...
2
votes
1answer
191 views

Feature importance with Text features

I would like to determine features importance in several models: support vector machine logistic regression Naive Bayes random forest I read that I will need an agnostic model, so I have thought to ...
2
votes
2answers
72 views

Node Importance in scikit learn

I'm trying to understand exactly how feature_importances in scikit-learn's RandomForestClassifier works. I managed to find this helpful link explaining most of the process: https://towardsdatascience....
0
votes
0answers
67 views

Why are random forest permutation importances almost all zero?

I have built a random forest binary classification model with 18 input variables. Gini importance (MDI) shows that all variables have positive importance, although some are very small. According to ...
0
votes
0answers
64 views

Is it possible that shap feature importance result will be more accurate than gain?

XGboost build the boosted tree in the following way: Each level of each tree (the phase of selecting the next feature with conditional value) selected according ...
0
votes
2answers
105 views

Why is XGBClassifier in Python outputting different feature importance values with the same data across different repetitions?

I am fitting an XGBClassifier to a small dataset (32 subjects) and find that if I loop through the code 10 times the feature importances (gain) assigned to the features in the model varies slightly. I ...
1
vote
1answer
48 views

Is feature importance from classification a good way to select features for clustering?

I have a large data set with many features (70). By doing preprocessing (removing features with too many missing values and those that are not correlated with the binary target variable) I have ...
2
votes
1answer
53 views

Feature Interactions vs Feature Importances

What are the differences between Feature Interactions and Feature Importances?