Questions tagged [feature-importances]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

How to calculate the feature importance of variables synthesized with EFB in LightGBM?

I've been studying LightGBM recently. I have a question. Feature Importance can be extracted when running the LightGBM library in Python. LightGBM has an Exclusive feature bundling feature that allows ...
user avatar
  • 1
1 vote
2 answers
71 views

Global feature importance for classification problem where some values are irrelevant

I have a binary classification problem where most of the features are categorical with 4 possible values: yes, no, irrelevant, nan. I am trying to find the modular global feature importance of those ...
user avatar
  • 61
0 votes
0 answers
11 views

RandomForestRegressor.feature_importances_ applied on classification problem

friends! I am new to the machine learning field, but so motivated to study more. I am currently conducting a study on the Wisconsin Breast Cancer Dataset and I apply some ML algorithms to study their ...
user avatar
  • 1
0 votes
0 answers
36 views

Feature importance of a linear regression

What is the easiest and easy to explain feature importance calculation for linear regression? I know I can use Shap to compute feature importance, but I find it difficult to explain it to stakeholders,...
user avatar
  • 231
0 votes
1 answer
69 views

Interpreting the variance of feature importance outputs with each random forest run using the same parameters

I noticed that I am getting different feature importance results with each random forest run even though they are using the same parameters. Now, I know that a random forest model takes observations ...
user avatar
  • 3
0 votes
0 answers
12 views

How to get significativity for tabular data in machine learning?

Im using fastai to train a network on tabular data (https://docs.fast.ai/tutorial.tabular.html). I have a table with 5 columns, each of these is the specific attribute that describes a galaxy and ...
user avatar
2 votes
1 answer
28 views

How to interpret importance of random forest model, Mean Decrease Accuracy and Mean Decrease Gini?

A random forest model outputs the following importance values. How do I interpert them for feature selection? If it's the mean decreased accuracy does that mean that by removing them from the model ...
user avatar
  • 21
0 votes
0 answers
20 views

Searching machine learning algorithm for regression problem with many features

I have a machine learning problem with about 160 features and 400 cases and I want to find the best predictors for a continuous outcome. The dataset contains variables of psychotherapists and clients. ...
user avatar
1 vote
1 answer
27 views

Is it possible for a feature not correlated with a dependent variable to become important in a machine learning model?

Is it possible for a feature not correlated (or faintly correlated) with a dependent variable to become important in a machine learning model?
user avatar
  • 231
0 votes
0 answers
34 views

How does missing an important feature affects the feature importance of remaining features in the model?

I am creating a linear regression model for energy usage in a food processing plant. Unfortunately, I don't have the historical data for one of the critical features (I know it is important from ...
user avatar
  • 231
1 vote
0 answers
367 views

Differences between Feature Importance and SHAP variable importance graph

I have run an XGBClassifier using the following fields: ...
user avatar
1 vote
1 answer
44 views

Understanding which variables impact your variable of interest the most (correlation, linear regression) and correctly interpreting results

How do you ascertain which variables lead to the greatest increase in another variable of interest? Let's say you have a correlation matrix. You look at the row of the variable you are particularly ...
user avatar
0 votes
1 answer
225 views

XGBoost model has features whose feature importance equal zero

I ran into this problem: A XGBoost model(.pickle file , constrcuted under V0.7.post3) with 100 features in it ; But I found 55 features in model (model.feature_importances_) show 0 feature importance ...
user avatar
1 vote
1 answer
25 views

Why does an unimportant feature has a big impact on R2 in XGBoost?

I am training an XGBoost model, xgbr, using xgb.XGBRegressor() with 13 features and one numeric target. The R2 on the test set ...
user avatar
0 votes
0 answers
14 views

Feature importance by removing all other features?

For neural network feature importance, can I zero-out all features except one in order to gauge that feature's importance? I know shuffling a feature is one approach. For example, leaving in the 4th ...
user avatar
  • 476
0 votes
0 answers
60 views

Feature importance in binary classification

I am wondering if there is a way to check the feature importance for each class in a binary classification task separately. Or any way to check the correlation between features and both target classes ...
user avatar
0 votes
0 answers
35 views

Feature Importance interpretation

I want to audit the results of regressions I ran, and hopefully gain more insights about a treatment effect through sklearn's feature importance function (...
user avatar
0 votes
0 answers
75 views

Assess feature importance in Keras for one-hot-encoded categorical features

An important aspect of tuning a model is assessing feature importance. In Keras, how to assess the importance of a categorical feature which is one-hot encoded? E.g. if a categorical feature is ...
user avatar
  • 165
1 vote
0 answers
13 views

What kind of model to use to find drivers when data is aggregated and not on user level?

I have a website and have info from Google Analytics. So I can see the following "features": page url country device category (phone, desktop, etc.) Number of sessions Number of users: ...
user avatar
0 votes
0 answers
45 views

Why do random continuous and binary features rank highly in sklearn's RandomForestClassifier feature_importances_?

Goal: I'm trying to wrap my head around understanding the output of my random forest classifier's feature_importances_, which I believe is based on mean Gini decrease. Overview of dataset: ...
user avatar
0 votes
0 answers
35 views

Features importance in model

I've been using azure's auto ML platform for a couple of weeks now and recently I've trained a model and came across a strange looking aggregate feature importance chart in the explanations tab. The ...
user avatar
1 vote
2 answers
2k views

difference between feature effect and feature importance

Is there a difference between feature effect (eg SHAP effect) and feature importance in machine learning terminologies?
user avatar
  • 11
0 votes
2 answers
145 views

aggregation of feature importance

I have more of a conceptual question I was hoping to get some feedback on. I am trying to run a boosted regression ML model to identify a subset of important predictors for some clinical condition. ...
user avatar
  • 1
0 votes
2 answers
83 views

Concerns regarding small dataset with too many features

I have dataframe with 322 observations with 224 features. The observations has two classes, 0 or 1,which i'm trying to predict. class 0 has 168 observations and class 1 has 154 observations. I was ...
user avatar
  • 349
0 votes
1 answer
31 views

Does it make sense to use feature importances based in gini index for other classifiers?

I would like to know if makes sense running yellowbrick.features.FeatureImportances with a RandomForestClassifier model in order ...
user avatar
1 vote
1 answer
96 views

Shapley value, conditional expectation vs reference point

In Shapley, the marginal contribution of a feature is computed by comparing the performance of a model with and without a feature over all possible subsets of features. A common choice is using the ...
user avatar
  • 45
1 vote
1 answer
22 views

Revealing the causal structure in time-dependent data

We have a data table that accumulates the control and monitoring parameters of the High-Temperature Superconductor (HTS) production process: such that the rows represent the observations and columns ...
user avatar
1 vote
0 answers
35 views

How marginal contributions of adding a variable in a model is calculated in determining SHAP feature importance?

I was trying to find feature importance using SHAP values in python for Isolation Forest. SHAP calculates the feature importance of a feature($i$) pertaining to a model($f$) for a datapoint($x$) using ...
user avatar
2 votes
1 answer
500 views

Feature importance with Text features

I would like to determine features importance in several models: support vector machine logistic regression Naive Bayes random forest I read that I will need an agnostic model, so I have thought to ...
user avatar
  • 151
2 votes
2 answers
108 views

Node Importance in scikit learn

I'm trying to understand exactly how feature_importances in scikit-learn's RandomForestClassifier works. I managed to find this helpful link explaining most of the process: https://towardsdatascience....
user avatar
  • 33
0 votes
2 answers
207 views

Why is XGBClassifier in Python outputting different feature importance values with the same data across different repetitions?

I am fitting an XGBClassifier to a small dataset (32 subjects) and find that if I loop through the code 10 times the feature importances (gain) assigned to the features in the model varies slightly. I ...
user avatar
1 vote
1 answer
63 views

Is feature importance from classification a good way to select features for clustering?

I have a large data set with many features (70). By doing preprocessing (removing features with too many missing values and those that are not correlated with the binary target variable) I have ...
user avatar
2 votes
1 answer
93 views

Feature Interactions vs Feature Importances

What are the differences between Feature Interactions and Feature Importances?
user avatar
  • 2,376