Questions tagged [confidence]
The confidence tag has no usage guidance.
19
questions
1
vote
0answers
25 views
Association rules - Find 100% confidence rules [closed]
Suppose there are 100 items, numbered 1 to 100, and also 100 baskets, also numbered 1 to 100. Item i is in basket b if and only ...
0
votes
0answers
9 views
Approximation of a confidence scores from a neural network with a final softmax layer: Softmax vs other normalization methods
Say that there is a neural network for classification and the 2nd to last layer are 3 nodes, and the final layer is a softmax layer.
During training the softmax layer is needed, but for inference it ...
1
vote
1answer
38 views
Confidence intervals for evaluation on test set
I'm wondering what the "best practise" approach is for finding confidence intervals when evaluation the performance of a classifier on the test set.
As far as I can see, there are two ...
0
votes
0answers
13 views
data analysis leads to linear regression model: how to proceed with prognosis?
Data analysis of a large dataset of project management data together with working hours led me to a surprisingly simple linear model over the key milestones of all projects. Now I am a bit at loss on ...
0
votes
1answer
27 views
Excluding data via confidence score: Is it a good idea?
Let's say I have a model which has a binary classification task (Two classes of 0 and 1) and therefore, it outputs a number between 0 and 1, if it is greater than 0.5 we consider it to be class 1 and ...
1
vote
1answer
19 views
How to State The Confidence of Accuracy/Inaccuracy?
Consider that I have a dataset automatically acquired by a machine that returns the following measurements:
[111, 121, 114, 154, 149, 150]
I then go and manually ...
0
votes
1answer
28 views
How to predict only those values that our model is 95% sure of?
I have 5 classes. I made a XGBoost Classification model and used model.predict(test) to predict the classes of test dataset. Out of all those values predicted by my ...
1
vote
1answer
53 views
Plotting confidence intervals
For the following dataframe, I am trying to plot the means of a sample of 5 random rows . And also plot their respective confidence intervals using errorbars. I am unable to figure how to plot the ...
0
votes
1answer
31 views
Producing a confidence output to use in a weighted average layer
I am trying to solve a problem where the input consists of an unordered set of observations (variable size), and the desired output is a single value describing some property of the observations as a ...
1
vote
1answer
38 views
Confidence score for all observations is between 0.50 - 0.55
Hello Data Science Stack Exchange Community,
This question will appear to be open-ended, however any answers or thought will be much appreciated. I am trying to go-through a pre-trained Random Model ...
0
votes
0answers
129 views
How to get confidence score from a PyTorch based BiLSTM-CRF model
I have created a BiLSTM-CRF based NER model referring the following link: https://pytorch.org/tutorials/beginner/nlp/advanced_tutorial.html
Now, the ask is to get the confidence score for each ...
0
votes
0answers
242 views
Narrow confidence Interval of forecast
I am new to data science so please accept my apology in advance. I am trying to predict the value using ARIMA. I have got weekly value for the current year. Based on the available weekly values, I ...
1
vote
0answers
35 views
Confidence in the rewards for a RL task
For a RL task that I am trying to solve, for which I train once per day, I have the rewards stored for each of those days, so that I can see the progress on daily basis.
In the beginning of the ...
0
votes
0answers
32 views
Difference between test statistic and sample statistic?
Test statistic and sample statistic are used to check statistical significance. How do I understand the procedure in background of reaching a conclusion about an effect-size estimate.
2
votes
1answer
37 views
Interpreting confidence interval results for datasets
I have created a dataset automatically and wanted to clarify my interpretation of the amount of noise using the confidence interval.
I selected a random sample and manually annotated the sample and ...
2
votes
2answers
50 views
Confidence rating for regression tasks
In classification tasks, we can interpret the output vector as how "confident" the model is that the input has a certain label. For example,
...
2
votes
1answer
62 views
Relation between Cross Validation and Confidence Intervals
I've read from a source which I forgot where that 'In cross validation, the model with best scores at 95% confidence interval is picked'.
But according to my stat knowledge, in order for CI (...
1
vote
1answer
28 views
Understand how to simulate a statistics [closed]
This solution describes how to simulate statistics to find a confidence interval.
A journalist called 1000 people in town to ask who will they be voting for out of candidates A and B.
The observed ...
1
vote
2answers
2k views
Predict_proba for Binary classifier in Tensorflow
I'm working in binary classifier problem, where I have used Tensorflow low level API's.
Last layer wrapped with Sigmoidal Function and just returning a single value.
For my prediction I just set a ...
