Questions tagged [bayes-error]

Bayes error is the lowest possible error that can be achieved; it is also known as irreducible error.

Filter by
Sorted by
Tagged with
0
votes
0answers
16 views

Bayes Classifier and Unavoidable Error

Consider the following two-class classi cation problem, where $Y = 0 \text{ or } 1$. Suppose $Y$ is a random variable satisfying$ P(Y = 0) = \frac{1}{3}$ and $P(Y = 1) = \frac{2}{3}$: Moreover, we ...
0
votes
1answer
20 views

kNN vs Logistic Regression

Good day, I had this question set as optional homework and wanted to ask for some input. Suppose an individual was to take a data set, divide it in half into training and test data sets and then ...
2
votes
0answers
420 views

Estimation of Bayes Error / Human-level error

In one of course Andrew Ng mentioned that model (Machine learning) error can't outperform Bayes / human level performance and hence the bias can't avoided.. (Unavoidable bias) How do we determine / ...
3
votes
1answer
117 views

Neural Networks - Strategies for problems with high Bayes error rate

I am building a Neural Network for a binary classification problem where the Bayes error (lowest possible error rate) is probably close to 50%. What makes the task easier is that I don't need to make ...
0
votes
1answer
41 views

image based example for Bayes error/irreducible error

I have a hard time intuitively understand the Bayer error in the context of supervised learning. We have an input X and an output Y. We want to find the function f(X) = Y. I feel like I don't ...
1
vote
1answer
146 views

Does classification of a balanced data-set lead to any problem?

So I came across a bioinformatics paper, where I found a line which says: One potential problem with using a training set with equal numbers of positive and negative examples in cross-validation ...
11
votes
2answers
550 views

When do we say that the dataset is not classifiable?

I have many times analysed a dataset on which I could not really do any sort of classification. To see whether I can get a classifier I have usually used the following steps: Generate box plots of ...