All Questions
4 questions
0
votes
1
answer
123
views
How to effectively evaluate a model with highly imbalanced and limited dataset
Most data imbalance questions on this stack have been asking How to learn a better model, but I tend to think one other problem is How do we define "better" (i.e. fairly evaluate the learned ...
- 23
1
vote
2
answers
910
views
A robust metric in the presence of class imbalance
When evaluating the performance of a multiclass classification problem, on a highly imbalanced dataset, what is the most robust metric for this purpose?
I read a paper that states:
"Average ...
- 611
1
vote
2
answers
328
views
Doubt to use accuracy or macro f1 measure in an unbalanced classification task
I have a multi-class classification task where the organizers said that the final results will be using the Accuracy measure.
The provided data is unbalanced, and I don't have an idea about the test ...
- 262
1
vote
2
answers
157
views
How to interpret PR and ROC Curve for an unbalanced test set
I have trained a neural network on a dataset, the test set is very unbalanced, ratio between positive examples and negatives is 1:25000.
All positive examples are correctly predicted, instead ...
- 11