Skip to main content

Questions tagged [interpretation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
42 views

Am I suppose to do any statistical test on results?

I am doing an email campaign. Before sending emails to users I divided my user base into treatment and control groups (50-50). Divided the groups in such a way that no difference in user behaviour. I ...
0 votes
0 answers
15 views

Interpreting Centered 2-Way PDP

I have recently used scikit-learn's PartialDependenceDisplay.from_estimator function to display cICE plots in combination with PDPs using the ...
4 votes
1 answer
224 views

Why do Shapley value solutions remain consistent when the value function of the empty set changes in the ML context?

Hey there data science stack exchange - question about SHAP. In the original Shapley value formulation from Lloyd, one assumption is that the value function of the empty set equals zero, $v(\emptyset) ...
0 votes
1 answer
648 views

Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$

(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model? Relative contributions from a linear (additive) model E.g., there are 3 contributors to $y$ (given by ...
5 votes
2 answers
165 views

How to interpret two continous variables output using GAM?

I really need help with GAM. I have to find out whether association is linear or non-linear by using GAM. The predictor variable is temperature at lag0 and the output is cardiovascular admissions (...
0 votes
1 answer
458 views

how to visualize segmented labels in a already existing graph?

I am working on a project where I have to segment the image using multi-class segmentation (3 classes) on microscopic images. Now let's say that I am segmenting solid, liquid and gas images (this is ...
2 votes
3 answers
1k views

How to interpret Correlation along with Coefficients of multiple linear regression?

I have 10000 samples. There are 4 independent variables and 1 dependent variable. The independent variables are all centered with 0 mean. I found the correlation coefficients between each of these ...
0 votes
0 answers
20 views

Which method is better to understand key drivers/feature importance in prediction?

After applying two different classifiers (EBM Classifier and Random Forest Classifier) and getting similar scores, I used InterpretML functionality to identify the most relevant features in each model....
1 vote
2 answers
1k views

How to interpret my logistic regression result with statsmodels

so I'am doing a logistic regression with statsmodels and sklearn. My result confuses me a bit. I used a ...
2 votes
1 answer
109 views

Drastic drop in Somers' D ? Why?

I came across to find the correlation between the ratings assigned by two coaches to a same group of 40 players. I have tabulated the results as below: The Somers' D is 50%. However, for the case ...
1 vote
0 answers
34 views

Standard Error interpretation help

I performed a standard error on my machine learning model to predict protein structure. The graph Im showing here is a snippet of the actual data and I deleted some irrelevant info. The y axis is the ...
0 votes
1 answer
26 views

SHAP values are explaining the wrong output value

I was checking the local accuracy property of the SHAP values. It states that for a data point $(X,y)$, the SHAP values $(s_1,s_2,s_3,...)$ of features $(x_1,x_2,x_3,...)$ sum up to the difference of ...
0 votes
0 answers
41 views

What does the shap interaction value of a feature with itself mean?

SHAP allows us to compute interaction effects by considering pairwise feature attributions. This leads to a matrix of attribution values representing the impact of all pairs of features on a given ...
0 votes
0 answers
17 views

What is the complexity of ICE (Individual conditional expectation) on ensemble trees

I'm evaluating different model-agnostic methods on gradient boosting or random forest model. For Shapley, specifically TreeSHAP, the complexity is O(TLD^2) according to Lundberg et al. 2018. T: #trees,...
0 votes
0 answers
12 views

How to specify and interpret control variables in the model?

I'd like to build a classification model on customers across different countries, but not sure how to interpret the coefficient of those countries and other features, especially features that could be ...
0 votes
0 answers
15 views

What does positive value in LIME mean?

I'm exploring the workings of LIME in NLP models to understand how it elucidates positive and negative words. I possess a trove of documents resembling this excerpt: The UN children’s agency says the ...
0 votes
0 answers
51 views

Help with multinomial logistic regression

I am a data science student and have the opportunity to work on an article regrading cardiac arrests in our country. For now I performed the multinomial regression model and I also plan on doing a ...
0 votes
0 answers
27 views

How do I interpret a Scatter Plot of probabilities?

Help me with interpretation of the following scatter plot
0 votes
0 answers
73 views

Shapley value calculation in the case of absent features

The basic assumption in Shapely value calculation (which is also known as situational importance) is the following: $$ v_i(x) = f(x_1, ..., x_n) - E[f(x_1, ...,X_i,..., x_n)] $$ that is, the ...
0 votes
1 answer
805 views

ValueError: X has 54 features, but DecisionTreeClassifier is expecting 53 features as input

I am analysing and prediction 2023 Cricket World Cup based on previous given dataset. This is Exploratary analysis: Feature selection and Training model: Applying Random forest classifier algorithm: ...
0 votes
0 answers
7 views

Is ALE curve value constant for observations in the same interval?

I have been reading Chapter 8.2 of the Interpretable Machine Learning about Accumulated Local Effects (ALE) plots. It includes the following formula which defines the ALE value for a given value of ...
1 vote
0 answers
27 views

Is there a statistical test for comparing my dataset percentages with published percentages?

I have a clinical dataset which is showing the percentage of A is 57% and B is 35% for where an tumours is initially found. However the literature is showing it is A is 73% and B is 23%. Is there a ...
1 vote
2 answers
643 views

A neural network with more output neurons than labels

When we train a neural network model for a classification problem, we usually have a dense output layer of a size equal to the number of labels (classes) we have. If the layer size was greater, the ...
0 votes
0 answers
28 views

Logistic regression negative coefficient interpretation (reciprocal of negative logistic coefficient )

Suppose if a dependent variable is having a disease (1) and not having a disease (0). similarly , independent variable is smoking and not smoking. here , not smoking as reference group. Again, if ...
0 votes
0 answers
21 views

classification with rejection and how to interpret a 2D ambiguous data

Let's say we're going to train a classifier with the full data set. There's also a reject logic for ambiguous regions in the data. So, at the end, the final system outputs reject or 0 or 1. That is, ...
1 vote
3 answers
303 views

Does Karl Pearson correlation indicate linear relationship between two variables?

Wikipedia and literature do not seem to convey correct interpretation of Karl Pearson correlation. Also, some of the authors interpret it as a linear correlation or association. To me it simply tells ...
1 vote
1 answer
194 views

Correlation analysis yields conflicting results. Positive Pearson and Negative Spearman

I have four features x1,x2,x3,x4. All of their correlation with y are similar in Pearson correlation and in Spearman rank correlation separately. However, all these are +0.15 in Pearson and -0.6 in ...
0 votes
2 answers
711 views

How do I combine two different measures of correlation coefficients?

In the dataset, we have a numerical feature and a numerical target. We are calculating the Pearson coefficient and Spearman rank correlation. Pearson to track the linear relationship and Spearman to ...
0 votes
2 answers
167 views

Which intrinsically explainable model has the highest performance?

Explainable AI can be achieved through intrinsically explainable models, like logistic and linear regression, or post-hoc explanations, like SHAP. I want to use an intrinsically explainable model on ...
0 votes
1 answer
42 views

Efficient ways of clustering for big data

I have a task which is customer segmentation with 120k users and a record of their purchases which is +3 million records of data, the approach I want to use is to use clustering algorithms like kmeans ...
2 votes
0 answers
253 views

Shapley values for channel attribution equal to linear attribution

I am looking into Shapley values for online marketing attribution. In recent time many articles seem to have been made on this particular approach to attribution (there are more): https://medium.com/...
2 votes
2 answers
236 views

What are available Python libraries for Interpretable ML?

I recently become familiar with Interpretable ML and I found some libraries like LIME. I would be thankful if you can suggest to me some libraries and what are the advantages of each library.
1 vote
1 answer
39 views

Interpreting model

If I trained a model (say logistic regression) on train, test and validation. During interpretation which dataset (test or validation) should I base on for interpretation? If test and validation shows ...
0 votes
0 answers
55 views

What are some "best practices" for discovering true patterns in data without relying on "scores" as measures of accuracy?

What are some "best practices" for discovering true patterns in data without knowing about them and without relying on "scores" as measures of accuracy? In university I was always ...
0 votes
0 answers
17 views

How "much" should belief be weighted against numerical measures of accuracy/correctness?

How "much" should belief be weighted against numerical measures of accuracy/correctness? It's possible to devise numerically low-quality models, but that have very good empirical validity, ...
1 vote
1 answer
39 views

Interpreting visualisations for write ups - clustermaps

I produced a clustermap as part of an attempt to visualise any multicollinearity in a dataset and it's occurred to me that I actually don't really know how to interpret it. There is plenty of ...
2 votes
0 answers
48 views

When is scaling and centering important?

There are some models such as PCA or SVM where scaling and centering of training data is essential. There are some models, mostly tree-based where scaling and centering is not required at all. I don't ...
1 vote
1 answer
143 views

How to interpret a linear regression effects graph?

could someone tell me how to interpret the following graph? It corresponds to a graph in which the effects of the variables in a linear regression are observed, but its interpretation is not clear to ...
3 votes
1 answer
357 views

Interpreting ROC curves across k-fold cross-validation

I have used a MARS model (multivariate adaptive regression splines) and I have used k fold cross validation for the evaluation of the model, obtaining the following graph: How would be the ...
1 vote
1 answer
106 views

Why do I get this result with a chi- square test?

I have a question about the chi squared independence test, I'm working on dataset and I'm interested in finding the link between the categories of product and the gender, I plot my contingency table. ...
1 vote
1 answer
33 views

Practical Interpretation of PCAs for a supplier analysis

I am using PCA to validate and research a set of 13 suppliers of products against a set of about 50 variables and performance indicators against an ideal "wish"-Supplier, mostly based on G. ...
0 votes
1 answer
29 views

Answering the question of "WHY" using AI?

We have seen lots of natural occurrences that are happening in the whole world. Since we have great progress in technology and in particular AI, How can I employ <...
2 votes
3 answers
445 views

How do I interpret the output of linear regression model in R?

I have the following linear regression model and its analysis. There are a few errors, but I am not very sure about the errors. I have not succeeded in finding them so far. First, the 95% confidence ...
1 vote
0 answers
68 views

Understanding, visualizing and interpreting CNN activations

I am working with the first layer of a CNN and trying to understand how to interpret the activation output. My CNN takes input from 3 channels (RBG picture) and the first layer is ...
20 votes
5 answers
6k views

What is the difference between explainable and interpretable machine learning?

O’Rourke says that explainable ML uses a black box model and explains it afterwards, whereas interpretable ML uses models that are no black boxes. Christoph Molnar says interpretable ML refers to the ...
1 vote
0 answers
38 views

paired t-test shows no difference between median and Wilcoxon test p value shows that there is a difference between median values ? How to interpret?

I have a dataset. I wanted to do paired t test on it. So I carried out normality test and it showed that it does not follow normal distribution. So I used Wilcoxon test in place of paired t test. The ...
2 votes
1 answer
31 views

Suggestions for improvement? Time series of variation in relative frequency of emotion-related words in academic psychology over time

First time plotting and interpreting time series data and I have used a line plot for ease of use. I am aware this is incredibly basic, but any input/ recommendations would be much appreciated (e.g., ...
0 votes
1 answer
30 views

How to increase sales and revenue of a Client?

I was asked this in an interview for a Data Scientist position: Lets say Holland and Barret came to you and said they'd like to increase their sales and revenue. How will you go about it? My answer ...
6 votes
1 answer
436 views

Shapley values without intercept (or without `expected_value`)

I have a model and I want to derive its interpretability by using feature contributions. In the end, I want to have some contribution per feature such that the sum of contributions equals the ...
1 vote
0 answers
62 views

Can we use Shap to interpret output changes?

Can we calculate the difference between Shapley values to interpret changes in the output? More precisely, if we get Shapley values for two different inputs, can we compare them to understand how much ...