Questions tagged [confidence]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
22 views

Confidence score for all observations is between 0.50 - 0.55

Hello Data Science Stack Exchange Community, This question will appear to be open-ended, however any answers or thought will be much appreciated. I am trying to go-through a pre-trained Random Model ...
0
votes
0answers
18 views

How to get confidence score from a PyTorch based BiLSTM-CRF model

I have created a BiLSTM-CRF based NER model referring the following link: https://pytorch.org/tutorials/beginner/nlp/advanced_tutorial.html Now, the ask is to get the confidence score for each ...
0
votes
0answers
15 views

Classifier Performance - Binomial proportion confidence interval

I am solving a binary classification task. As an output of Random Forest classifier, I get a probability of how sure RF is that class is 0 or a 1. How can I calculate the needed threshold, to be 95% ...
0
votes
0answers
52 views

Narrow confidence Interval of forecast

I am new to data science so please accept my apology in advance. I am trying to predict the value using ARIMA. I have got weekly value for the current year. Based on the available weekly values, I ...
1
vote
0answers
32 views

Confidence in the rewards for a RL task

For a RL task that I am trying to solve, for which I train once per day, I have the rewards stored for each of those days, so that I can see the progress on daily basis. In the beginning of the ...
0
votes
0answers
26 views

Difference between test statistic and sample statistic?

Test statistic and sample statistic are used to check statistical significance. How do I understand the procedure in background of reaching a conclusion about an effect-size estimate.
2
votes
1answer
26 views

Interpreting confidence interval results for datasets

I have created a dataset automatically and wanted to clarify my interpretation of the amount of noise using the confidence interval. I selected a random sample and manually annotated the sample and ...
2
votes
2answers
23 views

Confidence rating for regression tasks

In classification tasks, we can interpret the output vector as how "confident" the model is that the input has a certain label. For example, ...
2
votes
1answer
33 views

Relation between Cross Validation and Confidence Intervals

I've read from a source which I forgot where that 'In cross validation, the model with best scores at 95% confidence interval is picked'. But according to my stat knowledge, in order for CI (...
0
votes
0answers
125 views

Confidence score over xgboost logistic regression

The probabilities of logistic regression indicate how the certain the model is over predictions. if its 0.93 it means the model is 93% confident the label is 1 and 7% to be 0. or if the probability is ...
1
vote
1answer
27 views

Understand how to simulate a statistics [closed]

This solution describes how to simulate statistics to find a confidence interval. A journalist called 1000 people in town to ask who will they be voting for out of candidates A and B. The observed ...
1
vote
2answers
437 views

Predict_proba for Binary classifier in Tensorflow

I'm working in binary classifier problem, where I have used Tensorflow low level API's. Last layer wrapped with Sigmoidal Function and just returning a single value. For my prediction I just set a ...