Questions tagged [roc]
The roc tag has no usage guidance.
17
questions with no upvoted or accepted answers
4
votes
0
answers
195
views
Fast PR / ROC curves and corespondings AUPR / AUROC
I find myself in a position of calculating numerous PR / ROC curves and their associated area under the PR curves (AUPR) / area under the ROC curve (AUROC).
Its is quite easy to perform those ...
- 2,196
2
votes
0
answers
2k
views
AUC on ROC Curve near 1.0 for Multi-Class CNN but Precision/Recall are not perfect?
I am building a ROC Curve and calculating AUC for multi-class classification on the CIFAR-10 dataset using a CNN. My overall Accuracy is ~ 90% and my precision and recall are as follows:
...
- 159
1
vote
0
answers
26
views
How does ROC work with SVM?
Could someone please explain how ROC works with SVM?
Specifically i'm using RocCurveDisplay.from_predictions(y_test, y_pred, ax=ax[1]) which works fine.
Since the ...
- 11
1
vote
0
answers
74
views
Macro-average ROC curve not looking right
I am performing a 10-fold Cross-validation on imbalance datasets with small n examples and large p attributes. I am plotting ROC curves by merging predicted probabilities obtained by testing on each k ...
1
vote
0
answers
118
views
What is ROC curve based on for SVM?
I was studying about the ROC curves for Logistic regression. There is a threshold in this method that determines the classification. By changing this threshold we get different confusion matrices and ...
- 111
1
vote
0
answers
359
views
How to draw each ROC curve of an SVM model with cross validation
I would like to make a graph like the following in python:
That is, one curve for each fold.
I have the following code where I use an SVM model to classify some data
...
- 314
1
vote
0
answers
16
views
My data can be approximated with Normal mixture. How can I find the reasons and explain this behaviour?
I use DeLonge method to compare two ROC AUCS. The result of it is Z-score.
Both ROC AUCs obtained from LDA (linear discriminant analysis) from sklearn package. The ...
- 11
1
vote
0
answers
17
views
How to ensamble different ranking models?
I have trained two different models, which give a score to each data point. The score of the models it is not necessarily comparable.
The score is used to give a ranking, and the performance is ...
- 111
1
vote
0
answers
377
views
ROC and AUC curve for CNN multi-class classification problem
I have produced a convolutional neural network to classify images (malware images) into different classes/families. I have managed to produce a confusion matrix and classification report. My ...
- 155
1
vote
0
answers
389
views
Best practice to select precision vs. recall threshold for a binary classifier
I have a logistic regression model in Scikit-Learn doing a binary classification.
Looking at the Roc curve for the classifier I can see that it performs really well:
The AUC score is 0.99 which is ...
- 247
0
votes
0
answers
25
views
ROC Curve - How to deal with overflow?
I'm trying to calculate the ROC curve and the AUC of a binary logistic regression from scratch, without using third party methods like sklearn.metrics.roc_curve, to ...
0
votes
0
answers
43
views
ROC curve for multiclassification - results sound not correct
I'm working on a multiclassification task using LSTM algorithm, i generated my roc curve plots but they give scores like 1 , 0.99, 0.97 however i have an accuracy of 0.97, Precision 0.65, Sensitivity/...
- 11
0
votes
0
answers
325
views
How do I compute the Weighted average ROC Curve?
So i have a multiclass problem and successfully computed the micro and macro average curves, how do I calculate the weighted value for each TPR and FPR?
- 11
0
votes
0
answers
38
views
Can you get a very good AUC-ROC score despite predicting all rows to have the same probability?
On the test set of a binary classification problem, the p25, p50 and p75 of the predictions are very close to each other (e.g. 0.123).
Is it possible that my model can achieve a high AUC-ROC (e.g. 0....
- 1
0
votes
0
answers
383
views
Use one-vs-rest ROC AUC to get threshold for each class
I have a Neural Network with 4 classes (completely balanced) where the recall is the following for each class (the class with the highest score from the network is chosen)
$RE(C1) = 0.611650 $
$RE(C2) ...
- 500
0
votes
0
answers
17
views
How can I Determine a Treshold According to the Precision and Recall?
I am gettin these precision and recall values from my classifier and I want to determine a treshold for the test data. How can I determine that treshold? Is these values enough or something else is ...
-1
votes
2
answers
1k
views
Why I am having trouble plotting the AUC?
I am trying to plot the roc_auc curve however I am not getting any results. Any explanation here? Are there any problems with the number of data?
Here is my example :
...
- 214