All Questions
Tagged with performance accuracy
11 questions
1
vote
1
answer
77
views
Overall acurracy +/- E (with 90% C.I.)
I am assessing the accuracy of my classification model. I performed a 4-folds cross-validation and I obtained the following Overall Accuracy: OA = (0.910, 0.920, 0.880, 0.910). So, the average OA is 0....
- 63
1
vote
1
answer
20
views
How to compute performance of a detection-classification system?
I use a yolo (y) to detect only one object and a multiclassifier (mc) that classifies that object.
Now, the problem is: what I have to do with yolo's false positive and false negative, if I want to ...
- 13
0
votes
0
answers
74
views
How to increase accuracy and decrease loss of my model
https://jovian.ai/casella0798/badmodel
I created the model above to predict red wine quality. I have 6 classes, from 3 to 8. Dataset is unbalanced, with a lot of classes 5 and 6.
My model performs ...
- 229
0
votes
1
answer
65
views
How to derive false positive and false negative from top-k accuracy?
I am working on the following "equality identification" problem and become quite confused on how to reasonably define false positive and false negative in my case.
Problem:
Suppose I have a ...
1
vote
2
answers
300
views
AUC ROC Threshold Setting in heavy imbalance
I am doing binary logistic regression on a dataset with very heavy class imbalance. Class 1 is only 1% of data. When I train logistic regressor without class weights I get ROC AUC Score of 0.6269. ...
- 141
3
votes
4
answers
1k
views
Metrics to determine K in K-cross fold validation
Consider a scenario where the dataset in hand is quite large, let's assume 50000 samples (quite well balanced between two classes). What metrics can be used to decide the K value in a K-fold cross-...
- 211
10
votes
4
answers
9k
views
Log loss vs accuracy for deciding between different learning rates?
While model tuning using cross validation and grid search I was plotting the graph of different learning rate against log loss and accuracy separately.
Log loss
When I used log loss as score in ...
- 788
7
votes
2
answers
211
views
What makes you confident in your results? At what point do you think you can present your work to tech illiterate superiors?
I understand that the models are only as good as the data you get, and bad design can generate really bad data. Nonrandom sampling, unbalanced/incomplete designs, confounding, can make data analysis ...
- 73
1
vote
1
answer
813
views
Accuracy value constant even after different runs
I am using the neural network toolbox of Matlab to train a network. Now my code is as follows:
...
- 1,161
3
votes
1
answer
193
views
Understanding ROCs in imbalanced data-sets
A response variable (label) $B$ can either be $0$ or $1$.
In the training set, $B_i = 1$ is an extremely rare event at only $0.26\%$ occurrences. Which makes the prediction of this label on a test ...
- 1,783
25
votes
3
answers
533
views
How do you manage expectations at work?
With all the hoopla around Data Science, Machine Learning, and all the success stories around, there are a lot of both justified, as well as overinflated, expectations from Data Scientists and their ...