# Questions tagged [bias]

The tag has no usage guidance.

37 questions
Filter by
Sorted by
Tagged with
39 views

### Should bias updates be porportional to overfitting?

According to questions on the internet, the bias is a learnable parameter, and there are different solutions to updating it, but I failed to find a concise methodology of correctly updating biases ...
35 views

### How much can bias decrease performance of the network at the beginnng of the training?

I am writing a custom framework and in it I'm trying to train a simple network to predict the addition function. The network: 1 hidden layer of 3 Neurons 1 output layer cost function used is ...
21 views

### Bias of an estimator?

What is p(X;0)actually modelling? What's the difference between the two types of theta? What's happening in this equation and did expectation convert into summation ? Source:https://subscription....
39 views

### Bias Formula in Machine Learning expanded using ground truth

Why is Bias calculated for $f(x)$? Shouldn't it be calculated for $Y$ (which is $f(x)$ + Noise $\epsilon$)? We are fitting our model to $Y$, So shouldn't we be calculating bias wrt to $Y$? Also, I ...
27 views

### Calculation of Neural network biases in backpropagation

While learning neural networks I've found a basic Python working example to play with. It has 3 input nodes, 4 nodes in a hidden layer, 1 output node. 5 data sets for training. The initial code is ...
152 views

### Bagging vs Boosting, Bias vs Variance, Depth of trees

I understand the main principle of bagging and boosting for classification and regression trees. My doubts are about the optimization of the hyperparameters, especially the depth of the trees First ...
10 views

### Reflections about types of bias in comparative analysis

I am working on an analysis on proposal rejections across two different periods in time and I was wondering what reflections I would have to make about the risk of bias. The reason for this is ...
14 views

### What is the defining Set in NLP

I am reading the paper Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings here is the pdf. On page 6, we read: ...
11 views

119 views

### Trade off between Bias and Variance [closed]

What are the best ideas or approaches to trade off between bias and variance in Machine Learning models.
634 views

### Question on bias-variance tradeoff and means of optimization

So I was wondering how does one, for example, can best optimize the model they are trying to build when confronted with issues presented by high bias or high variance. Now, of course, you can play ...
65 views

### Can You Purposely Bias A Clustering Model?

We have a large amount (Billions) of high cardinality, mixed nominal & numerical data, and are performing some clustering on it as an experiment. There is a small subset of these data, however, ...