All Questions
Tagged with confidence classification
2 questions
0
votes
0
answers
14
views
How to adjust classification totals based on known bias of estimator
Let's say I have a dataset, $D$, with known ground truth labels. I nonetheless use a few-shot LLM classifier on this dataset to predict $k$ classes for each label.
From the LLM results, I get ...
1
vote
1
answer
777
views
Confidence intervals for evaluation on test set
I'm wondering what the "best practise" approach is for finding confidence intervals when evaluation the performance of a classifier on the test set.
As far as I can see, there are two ...