A message from our CEO about the future of Stack Overflow and Stack Exchange. Read now.

Questions tagged [confusion-matrix]

A confusion matrix is a special contingency table used to evaluate the predictive accuracy of a classifier. Predicted classes are listed in rows and actual classes in columns, with counts of respective cases in each cell.

Filter by
Sorted by
Tagged with
5
votes
3answers
2k views

Precision and Recall if not binary

I have to calculate precision and recall for a university project to measure the quality of the classification output (with sklearn). Say this would be my results: y_true = [0, 1, 2, 1, 1] y_pred = [...
2
votes
1answer
615 views
1
vote
0answers
13 views

Compute an ROC for a hybrid model where only one of the model components computes class probabilities

I've created a hybrid model by taking an existing decision engine (TRUE/FALSE output) and supplementing it with a random forest ...
2
votes
1answer
979 views

Interpreting confusion matrix and validation results in convolutional networks

I need some help in the assessment of the training results of a convolutional neural network. Here is my setup: Architecture: InceptionV3 Pre-trained InceptionV3 with weights from image net ...
0
votes
2answers
375 views

Matrix Confusion - Get Model Precision

I've this matrix confusion: [9779 107] [2227 148] What is the accuracy of my model? My doubt is because the confusion matrix is calculated based on Test ...
1
vote
1answer
245 views

Export dataset with predicted target - Python

I've this code (part of predictive model): ...
0
votes
1answer
654 views

Python - Get FP/TP from Confusion Matrix using a List

I using two different classifiers to predict a binary target (Random Forests and Decision Trees). Now I want to evaluate my model creating a confusion matrix. For example, for predicting the binary ...
2
votes
0answers
462 views

what's the best way to plot a confusion matrix in a multilabel setting?

In a multilabel setting a training example could be a, b, (a, b), d, c, (d, c), etc. This makes it a bit hard to come up with a helpful confusion matrix because the ...
1
vote
0answers
2k views

Can tuning individual precision and recall classification thresholds improve deep learning models?

I learned that Keras doesn't have a built-in way to set a threshold for precision and accuracy when building a classifier. Courtesy of a solution here, I wanted to see what would happen when I fit a ...
0
votes
1answer
571 views

Is this a good classified model based confusion matrix and classification report?

I build a classification model. The results below when implemented Decision Tree Classifier. Prediction accuracy 0.785813630042 confusion matrix [[ 1302 1581] [ 2577 13953]] ...
-1
votes
1answer
276 views

Term for relative recall

For in calculating success in information retrieval, precision and recall are fairly standard measurements, relating to accuracy of the results, and to what extent the results are comprehensive, ...
0
votes
2answers
1k views

Confusion matrix - classes get confused with each other

I got an example from this book on page 318: Chemometrics for Pattern Recognition By Richard G. Brereton. The example explained that; ...
1
vote
2answers
278 views

How to interpret the AUC score in this case?

I just run a random forest model on a imbalance dataset. I got the set of AUC and the confusion matrix. The AUC seemed not bad but actually the model predict every instance as positive. So how it ...
0
votes
2answers
66 views

What do this Classification evaluation results mean to you? Do they are suspicious or not?

I have collected dataset with two class labels and used the SVM Method to classify the dataset, and this is the results. Does this appear suspicious or not? scikit-learn classifiers with SVM SVC ...
-2
votes
1answer
73 views

Performance Measures [closed]

I run the following models..Decision tree, Logistic Regression,Naive Bayes, SVM and Random Forest ..I am given certain input features and Respnse feature as whether a customer will buy the product or ...
0
votes
1answer
285 views

Understanding ConfusionMatrix for Google Prediction API

I'm trying to analyze my training model, Google Prediction API provides analyze method to get insights for the model. Currently I want to improve confidence levels, for my predictions, I haven't found ...
3
votes
1answer
2k views

Python plot for confusion matrix similar to confusion wheel?

I have a confusion matrix with 7 classes and would like to represent the matrix in a graph. Something similar like a confusion wheel. Mainly I need to show, the correct observations in each class and ...
6
votes
1answer
176 views

Kappa From Combined Confusion Matrices

I am trying to evaluate and compare several different machine learning models built with different parameters (i.e. downsampling, outlier removal) and different classifiers (i.e. Bayes Net, SVM, ...
1
vote
1answer
34 views

result of correlation function in r

I would like to ask if the matrix that is returned from the R cor() function applied on a dataset, is considered a confusion matrix. Thank you
0
votes
1answer
160 views

Multiple confusion matrix for multiple training instances. Which one to take?

I am using Matlab Neural Network toolbox for a classification problem. Now considering a single set of data, if the inbuilt neural network is trained and classified with same data multiple number of ...
1
vote
0answers
46 views

Trying to come up with a feature to improve emotion classifier based on facial movement using facial landmarks

I managed to create an emotion recognition system that uses dense optical flow on each entire frame. While the accuracy range is within 80-90% with cross-validation, I am aiming to improve the ...
8
votes
2answers
3k views

How to get an aggregate confusion matrix from n different classifications

I want to test the accuracy of a methodology. I ran it ~400 times, and I got a different classification for each run. I also have the ground truth, i.e., the real classification to test against. For ...