Questions tagged [roc]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3
votes
1answer
36 views

At what stage are ROC curves used when building machine learning model?

When developing a machine learning model, at what stage are ROC curve with AUC used? Typically I have three data sets train - ...
1
vote
0answers
26 views

Best practice to select precision vs. recall threshold for a binary classifier

I have a logistic regression model in Scikit-Learn doing a binary classification. Looking at the Roc curve for the classifier I can see that it performs really well: The AUC score is 0.99 which is ...
0
votes
0answers
16 views

When to use AUROC OvR vs. AUROC OvO?

For multiclass problems, there are 2 versions of the AUROC metric: the AUROC OvR and AUROC OvO. Does anyone know in what particular cases we would use AUROC OvR vs. AUROC OvO? In the general academic ...
1
vote
1answer
31 views

Interpreting vertical and horizontal parts of ROC curve

It's not clear to me how I can interpret vertical and horizontal parts of the ROC curve. What important information can I gain from this? This is a text from the book "Human-in-the-Loop Machine ...
1
vote
1answer
45 views

Micro Average vs Macro Average for Class Imbalance

I have a dataset consisting of around 30'000 data points and 3 classes. The classes are imbalanced (around 5'000 in class 1, 10'000 in class 2 and 15'000 in class 3). I'm building a convolutional ...
1
vote
1answer
31 views

How would you interpret the following ROC and PRC curves?

How would you interpret the following ROC and PRC curves? For example, I find it weird to understand that the precision actually increases at some point when recall increases as well. Is that even ...
2
votes
0answers
21 views

Fast PR / ROC curves and corespondings AUPR / AUROC

I find myself in a position of calculating numerous PR / ROC curves and their associated area under the PR curves (AUPR) / area under the ROC curve (AUROC). Its is quite easy to perform those ...
0
votes
1answer
35 views

Correctness of a ROC Curve

I've built a Decision Tree Classifier to practice with the sklearn library. My first task was to shuffle the iris dataset and split it keeping only the last 10 elements for the test. Then, after the ...
2
votes
0answers
70 views

AUC on ROC Curve near 1.0 for Multi-Class CNN but Precision/Recall are not perfect?

I am building a ROC Curve and calculating AUC for multi-class classification on the CIFAR-10 dataset using a CNN. My overall Accuracy is ~ 90% and my precision and recall are as follows: ...
0
votes
1answer
46 views

AUC ROC Curve multi class Classification

Here is the part of the code for ROC AUC Curve calculation for multiple classes. ...
2
votes
1answer
46 views

What is the difference in plotting ROC curve with probability scores vs binary decisions

As the title reads what is the difference? Plotting the ROC w.r.t probability scores gives the stair cased version. But in my opinion I find that using binary decision is better because the ROC curve ...
1
vote
1answer
43 views

Algorithm for Binary classification

I have a data set with huge number of features ( Approximately 3000) and a binary target variable . The reason I have too many features is because of one hot encoding many categorical variables in ...
0
votes
2answers
153 views

Don't understand why I get an inverse ROC curve for SVM (Python)

I build an SVM classifier but get an inverse ROC curve. The AUC is only 0.08. I've used the same datasets to build a Logistic Regression classifier and a Decision Tree classifier, and the ROC curves ...
1
vote
2answers
35 views

Graphs for representing performance of machine learning classifiers [closed]

Can any please guide about how many types of the graph other than ROC can be plotted to represent the performance of the machine learning classifier?
3
votes
2answers
39 views

Lower-than-random ROC

If I have an ROC for a single classifier [y(x) in the range 0...1] that is 'worse than random', namely the AUC of the ROC is less than 0.5, would a classifier that reversed the class predictions [y'(...