0
$\begingroup$

What is the difference between interpretable algorithm and transparent algorithm? In particular, is there an algorithm that is interpretable but not transparent?

Update: In this post we defined explainability and interpretability and showed how these two concepts are different. The question is whether transparency is something different from either (or both) explainability or interpretability.

$\endgroup$
2
  • $\begingroup$ You might find the paper On Transparency of Machine Learning Models: A Position Paper interesting $\endgroup$
    – Sammy
    Aug 7 '21 at 19:57
  • $\begingroup$ Thank you Sammy! But is it consistent with what we discussed about Interpretablity and Explainability? I mean can Interpretablity, Explainability, and Transparency be all discussed within the same context? I also updated the post. $\endgroup$
    – Qwerty
    Aug 8 '21 at 0:42
1
$\begingroup$

In the this link, the author describes that the difference between model transparency and explainability (ie interpretability) lie in their approaches to solving the black box problem in AI.

Transparency solves this by the use of simple models, such as linear regression, that are well-known and use easy to follow steps. Whereas interpretability solves this problem by trying to gain insights into the black box using statistical methods.

The most popular statistical method is the Local Interpretable Model-Agnostic Explanations framework (LIME). This is where, quote,

"LIME essentially runs the model in a parameter space close to the prediction to understand how each feature impacted the results of the model."

This framework was suggested and further explained in this paper that also came with a python package called LIME.

Using the above framework to answer your second question, Deep Neural Networks can be made explainable (ie interpretable ) without necessarily being transparent.

$\endgroup$
1
  • 2
    $\begingroup$ Thank you for your answer! It was discussed here (datascience.stackexchange.com/questions/99808/…) that explainability and interpretability are different concepts. Your definition of transparency is actually explainability. $\endgroup$
    – Qwerty
    Aug 8 '21 at 0:36

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.