Questions tagged [feature-importances]
The feature-importances tag has no usage guidance.
24
questions
1
vote
1answer
15 views
Why does an unimportant feature has a big impact on R2 in XGBoost?
I am training an XGBoost model, xgbr, using xgb.XGBRegressor() with 13 features and one numeric target. The R2 on the test set ...
0
votes
0answers
9 views
Feature importance by removing all other features?
For neural network feature importance, can I zero-out all features except one in order to gauge that feature's importance? I know shuffling a feature is one approach.
For example, leaving in the 4th ...
0
votes
0answers
23 views
Feature importance in binary classification
I am wondering if there is a way to check the feature importance for each class in a binary classification task separately. Or any way to check the correlation between features and both target classes ...
0
votes
0answers
26 views
Feature Importance interpretation
I want to audit the results of regressions I ran, and hopefully gain more insights about a treatment effect through sklearn's feature importance function (...
0
votes
0answers
29 views
Assess feature importance in Keras for one-hot-encoded categorical features
An important aspect of tuning a model is assessing feature importance.
In Keras, how to assess the importance of a categorical feature which is one-hot encoded?
E.g. if a categorical feature is ...
1
vote
0answers
13 views
What kind of model to use to find drivers when data is aggregated and not on user level?
I have a website and have info from Google Analytics. So I can see the following "features":
page url
country
device category (phone, desktop, etc.)
Number of sessions
Number of users: ...
0
votes
0answers
28 views
Why do random continuous and binary features rank highly in sklearn's RandomForestClassifier feature_importances_?
Goal:
I'm trying to wrap my head around understanding the output of my random forest classifier's feature_importances_, which I believe is based on mean Gini decrease.
Overview of dataset:
...
0
votes
0answers
27 views
Features importance in model
I've been using azure's auto ML platform for a couple of weeks now and recently I've trained a model and came across a strange looking aggregate feature importance chart in the explanations tab. The ...
0
votes
2answers
265 views
difference between feature effect and feature importance
Is there a difference between feature effect (eg SHAP effect) and feature importance in machine learning terminologies?
0
votes
0answers
116 views
Var_Imp Algorithms in Pred/Class Problems: Can I use it in TS Problems?
OBJECTIVE OF THIS POST:
Solve a query about the possibility of use prediction/classification variable importance tools in a time series type dataframe.
Collect the largest number of variable ...
0
votes
2answers
71 views
aggregation of feature importance
I have more of a conceptual question I was hoping to get some feedback on. I am trying to run a boosted regression ML model to identify a subset of important predictors for some clinical condition. ...
0
votes
2answers
32 views
Concerns regarding small dataset with too many features
I have dataframe with 322 observations with 224 features. The observations has two classes, 0 or 1,which i'm trying to predict. class 0 has 168 observations and class 1 has 154 observations.
I was ...
0
votes
1answer
15 views
Does it make sense to use feature importances based in gini index for other classifiers?
I would like to know if makes sense running yellowbrick.features.FeatureImportances with a RandomForestClassifier model in order ...
0
votes
0answers
136 views
Variable importance and correlation PC's - variables
Can I relate features importance output of RF and the correlation's values between principal components and features?
After RF, I used clustering (useful for my purpose).
To find the features that ...
1
vote
1answer
41 views
Shapley value, conditional expectation vs reference point
In Shapley, the marginal contribution of a feature is computed by comparing the performance of a model with and without a feature over all possible subsets of features.
A common choice is using the ...
1
vote
1answer
22 views
Revealing the causal structure in time-dependent data
We have a data table that accumulates the control and monitoring parameters of the High-Temperature Superconductor (HTS) production process: such that the rows represent the observations and columns ...
1
vote
0answers
24 views
How marginal contributions of adding a variable in a model is calculated in determining SHAP feature importance?
I was trying to find feature importance using SHAP values in python for Isolation Forest. SHAP calculates the feature importance of a feature($i$) pertaining to a model($f$) for a datapoint($x$) using ...
2
votes
1answer
191 views
Feature importance with Text features
I would like to determine features importance in several models:
support vector machine
logistic regression
Naive Bayes
random forest
I read that I will need an agnostic model, so I have thought to ...
2
votes
2answers
72 views
Node Importance in scikit learn
I'm trying to understand exactly how feature_importances in scikit-learn's RandomForestClassifier works. I managed to find this helpful link explaining most of the process: https://towardsdatascience....
0
votes
0answers
67 views
Why are random forest permutation importances almost all zero?
I have built a random forest binary classification model with 18 input variables. Gini importance (MDI) shows that all variables have positive importance, although some are very small. According to ...
0
votes
0answers
64 views
Is it possible that shap feature importance result will be more accurate than gain?
XGboost build the boosted tree in the following way:
Each level of each tree (the phase of selecting the next feature with conditional value) selected according ...
0
votes
2answers
105 views
Why is XGBClassifier in Python outputting different feature importance values with the same data across different repetitions?
I am fitting an XGBClassifier to a small dataset (32 subjects) and find that if I loop through the code 10 times the feature importances (gain) assigned to the features in the model varies slightly.
I ...
1
vote
1answer
48 views
Is feature importance from classification a good way to select features for clustering?
I have a large data set with many features (70). By doing preprocessing (removing features with too many missing values and those that are not correlated with the binary target variable) I have ...
2
votes
1answer
53 views
Feature Interactions vs Feature Importances
What are the differences between Feature Interactions and Feature Importances?
