A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

Questions tagged [explainable-ai]

Use for questions about explainable artificial intelligence (AI), which aims at understanding, interpreting, and explaining the decisions that have been made by complex AI systems

Filter by
Sorted by
Tagged with
1
vote
0answers
24 views

Reasons that LIME and SHAP might not agree with intuition

I'm leveraging the Python packages lime and shap to explain single (test-set) predictions that a basic, trained model is making ...
2
votes
2answers
75 views

How to plot number of Trees and OOBs score with Grid Search

I searched to find the answer but I don´t find something with Grid Search. I create a random forest and gradient boosting regressor with grid search. Now I want to make a visualization to see if the ...
1
vote
0answers
20 views

SHAP Explanations in case of repeated train/test split

I am building a XGBoost model with Python and trying to explain it using the beautiful shap package. Apart from calculating SHAP values of each feature, I'd like to show graphs such as the two that ...
0
votes
1answer
93 views

Explainable anomaly detection

There are plenty of working for explaining prediction in supervised learning (e.g. SHAP values, LIME). What about for anomaly detection in unsupervised learning? Is there any model for which there ...
1
vote
0answers
17 views

What is the meaning of an empty SHAP graph in Explainable AI?

Using Python, I created a neural network to perform predictions on a binary class dataset (e.g. will a passenger survive the Titanic?). I am using the SHAP package to explain individual predictions. ...
0
votes
1answer
48 views

How to restructure my dataset for interpretability without losing performance?

What I am doing: I am predicting product ratings using boosted trees (XGBoost) with a dataset in this format: What I want to do: I want to use SHAP TreeExplainer to interpret each prediction my ...
3
votes
0answers
247 views

Explanation of how DeepExplainer works to obtain SHAP values in simple terms

I have been using DeepExplainer (DE) to obtain the approximate SHAP values for my MLP model. I am following https://github.com/slundberg/shap and DE's performance is very high in terms of computation ...
0
votes
0answers
26 views

Local Interpretable Model-Agnostic Explanations (LIME) implementation on MATLAB

Do you know if there's a MATLAB implementation of the LIME framework, by Marco Ribeiro et al.? Specifically, i'm referring to this work LIME by Marco Ribeiro et al. I have seen the author have a ...
0
votes
0answers
18 views

Is it valid to compare SHAP values across models?

Let's say I have three models- a random forest with 100 trees, a random forest with 1000 trees, and an xgboost model. I can rank the importance of my features on my dataset for each model using SHAP, ...
1
vote
1answer
61 views

Explainability ML Methods

I am currently working on a Machine-Learning Model. In order to explain how it works, I have looked at Partial Dependence Plots, Feature Importance and all kinds of methods, but one thing still ...
3
votes
1answer
69 views

Evaluating machine learning explainers?

I'm working on a project where multiple machine learning explainers (LIME and SHAP, potentially more coming) are applied to pre-trained models (neural networks) to help explain the predictions of ...
2
votes
0answers
123 views

How to handle the parameter space of neural networks?

This question is very broad (and might even be closed as "too broad"). It can be considered as a beginners question, because it is largely about getting started in terms of heading into a direction ...