Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [bias]

The tag has no usage guidance.

1
vote
0answers
22 views

Simulate Biased dataset Python [on hold]

I am trying to show that bias does not go away with larger sample sizes and show plots using python in samples of 100 1000 100000. I'm not sure how to approach. It's for a school example
0
votes
1answer
23 views

Why underfitting is called high bias and overfitting is called high variance?

I have been using terms like underfitting/overfitting and bias-variance tradeoff for quite some while in data science discussions and I understand that underfitting is associated with high bias and ...
2
votes
1answer
34 views

Bias-variance tradeoff in practice (CNN)

I first trained a CNN on my dataset and got a loss plot that looks somewhat like this: Orange is training loss, blue is dev loss. As you can see, the training loss is lower than the dev loss, so I ...
0
votes
1answer
38 views

Linear machine learning algorithms “often” have high bias/low variance?

In this blog, which explains the meaning of bias and variance in machine learning, there's a line under the heading "Bias-Variance Trade-Off" which says: Parametric or linear machine learning ...
0
votes
0answers
14 views

How to calculate Bias and Standard deviation given the true versus predicted values of ML model?

I am looking to calculate Bias and Standard deviation given the true versus predicted values of ML model. Am I correct in saying: Bias = (average difference between true values and predicted values)/...
2
votes
1answer
33 views

svm optimization problem

Suppose we have the dataset: {(3,1),(3-1),(6,1),(6,-1)} {(1,0),(0,1),(0,-1),(-1,0)} the first set represent the positive label, and de second the negative. I want manually find the support vectors, ...
1
vote
1answer
50 views

LSTM regression bias increases when targets go close to 0

I've build a LSTM model for time series forecasting. Results are not bad, with a mean normalized error of 7%. However, this normalized bias shows a clear pattern: The closer to 0 the value to predict, ...
1
vote
1answer
98 views

Free parameters in logistic regression

When applying logistic regression, one is essentially applying the following function $1/(1 + e^{\beta x})$ to provide a decision boundary, where $\beta$ are a set of parameters that are learned by ...
1
vote
1answer
29 views

Training dataset decreasing in quality (Google data science blog)

I have a complex algorithm that decides when it should show customers of an only shop an ad on our website, after they log in, in hope that they will buy what is in the ad. We have no control what is ...
0
votes
2answers
96 views

Relationship between train and test error

I have some specific questions for which I could not extract answers from books. Therefore, I ask for help here and shall be extremely grateful for an intuitive explanation if possible. In general, ...
1
vote
0answers
22 views

Bias of 1 in fully connected layers introduced dying relu problem

While implementing AlexNet (model-code), one of the thing I need to do was to initialize the biases of the convolutional layers and fully connected layers. Normally we initialize biases with 0s, but ...
0
votes
1answer
61 views

Maths question on mean squared error being dervied to bias and variance

I am reading a book and have difficulty in understanding the math on bias- variance tradeoff. Below is the section that I am having trouble with: Given a set of training samples $x_1, x_2, ..., x_n$...
1
vote
0answers
18 views

When should the bias b be updated with weights w and when should it be updated seperately?

It seems in some Machine Learning models, the bias term $b$ is updated just like other weights $w_i, i=1...n$. For example, in Logistic Regression, using SGD, $b \ \text{or} \ w_0$ is updated with: $$...
0
votes
0answers
242 views

How to understand the bias term b and how it is updated in ADALINE algorithm?

With $y=x*w+b$, where $x$ is the feature vector of a sample and $w$ is the weight vector, the update rule (SGD) for the bias $b$ is: $b \leftarrow b + \eta(o - y)$. With Gradient Descent, the final $...
1
vote
2answers
180 views

How is the equation for the relation between prediction error, bias, and variance defined?

I'm reading this article Understanding the BiasVariance Tradeoff. It mentioned: If we denote the variable we are trying to predict as $Y$ and our covariates as $X$, we may assume that there is a ...
4
votes
2answers
66 views

Trade off between Bias and Variance [closed]

What are the best ideas or approaches to trade off between bias and variance in Machine Learning models.
8
votes
1answer
221 views

Question on bias-variance tradeoff and means of optimization

So I was wondering how does one, for example, can best optimize the model they are trying to build when confronted with issues presented by high bias or high variance. Now, of course, you can play ...
0
votes
1answer
29 views

Can You Purposely Bias A Clustering Model?

We have a large amount (Billions) of high cardinality, mixed nominal & numerical data, and are performing some clustering on it as an experiment. There is a small subset of these data, however, ...
1
vote
1answer
15 views

Weights and bias' relative to preprocessed X

I am currently using sklearn scale to preprocess my X data before being put into a perceptron - mean/stddev so as to prevent the ...
3
votes
1answer
217 views

Correcting log-bias in the output of an XGB

I have previously worked with GAMs, where I was trying to do regression on a log-transformed variable. The log-transformation introduced a negative bias in the average of the predicted variable, and I ...