Questions tagged [confidence]
The confidence tag has no usage guidance.
12
questions
1
vote
1answer
22 views
Confidence score for all observations is between 0.50 - 0.55
Hello Data Science Stack Exchange Community,
This question will appear to be open-ended, however any answers or thought will be much appreciated. I am trying to go-through a pre-trained Random Model ...
0
votes
0answers
18 views
How to get confidence score from a PyTorch based BiLSTM-CRF model
I have created a BiLSTM-CRF based NER model referring the following link: https://pytorch.org/tutorials/beginner/nlp/advanced_tutorial.html
Now, the ask is to get the confidence score for each ...
0
votes
0answers
15 views
Classifier Performance - Binomial proportion confidence interval
I am solving a binary classification task.
As an output of Random Forest classifier, I get a probability of how sure RF is that class is 0 or a 1.
How can I calculate the needed threshold, to be 95% ...
0
votes
0answers
52 views
Narrow confidence Interval of forecast
I am new to data science so please accept my apology in advance. I am trying to predict the value using ARIMA. I have got weekly value for the current year. Based on the available weekly values, I ...
1
vote
0answers
32 views
Confidence in the rewards for a RL task
For a RL task that I am trying to solve, for which I train once per day, I have the rewards stored for each of those days, so that I can see the progress on daily basis.
In the beginning of the ...
0
votes
0answers
26 views
Difference between test statistic and sample statistic?
Test statistic and sample statistic are used to check statistical significance. How do I understand the procedure in background of reaching a conclusion about an effect-size estimate.
2
votes
1answer
26 views
Interpreting confidence interval results for datasets
I have created a dataset automatically and wanted to clarify my interpretation of the amount of noise using the confidence interval.
I selected a random sample and manually annotated the sample and ...
2
votes
2answers
23 views
Confidence rating for regression tasks
In classification tasks, we can interpret the output vector as how "confident" the model is that the input has a certain label. For example,
...
2
votes
1answer
33 views
Relation between Cross Validation and Confidence Intervals
I've read from a source which I forgot where that 'In cross validation, the model with best scores at 95% confidence interval is picked'.
But according to my stat knowledge, in order for CI (...
0
votes
0answers
125 views
Confidence score over xgboost logistic regression
The probabilities of logistic regression indicate how the certain the model is over predictions. if its 0.93 it means the model is 93% confident the label is 1 and 7% to be 0. or if the probability is ...
1
vote
1answer
27 views
Understand how to simulate a statistics [closed]
This solution describes how to simulate statistics to find a confidence interval.
A journalist called 1000 people in town to ask who will they be voting for out of candidates A and B.
The observed ...
1
vote
2answers
437 views
Predict_proba for Binary classifier in Tensorflow
I'm working in binary classifier problem, where I have used Tensorflow low level API's.
Last layer wrapped with Sigmoidal Function and just returning a single value.
For my prediction I just set a ...
