Questions tagged [variance]
The variance tag has no usage guidance.
60
questions
0
votes
1answer
27 views
Does variance and standard deviation both measure how spread out the numbers are?
I've heard from different sources that, standard deviation measures how spread out the numbers are. But I've also heard the same for variance.
Is it technically correct to say this statement for both ...
2
votes
1answer
19 views
When unsupervised learning is more beneficial in comparison with supervised learning even the labelings are existed?
When unsupervised learning is more beneficial in comparison with supervised learning even the labeling are existed?
If there is no labeling the unsupervised learning is better than supervised learning ...
2
votes
1answer
12 views
Technique to determine variation in metric due to varying parameters
So basically I have a large set of features corresponding to a metric - like many ML problems.
What I want to know is: can we correlate the variance of metric with the variation in each feature.
ex:
...
1
vote
0answers
8 views
Comparison of dispersion measures of different samples with different subsamples
Context: I have data on movie ratings and I want to find what factors affect the rating the most. I have $k$ features $F_1, F_2,\ldots,F_k$ characterizing a movie - for example, director, lead actor, ...
1
vote
0answers
10 views
allan deviation for nonuniform samples?
I am monitoring the stability of a data stream of phase measurements. However, sometimes, the stream is corrupted and I must discard some samples. This forces the sampling period to be nonuniform.
...
0
votes
0answers
7 views
Finding variation in mean of some parameter for different groups
Let's say I have some data on students' test scores that consists of id, category1, category2...
0
votes
1answer
13 views
Why is the variance going down so much in this weight initialization problem(using pytorch)?
first look at this example
>>> x = t.randn(512)
>>> w = t.randn(512, 500000)
>>> (x @ w).var()
tensor(513.9548)
it makes sense that ...
0
votes
0answers
33 views
Is it correct to say that a high variance feature will be important to my model?
Analysing 3 features I was faced with the following situation:
Two of them have almost no variance and the last one have a greater variance than the other (almost two times). Is it correct to assume ...
4
votes
2answers
115 views
Bagging vs Boosting, Bias vs Variance, Depth of trees
I understand the main principle of bagging and boosting for classification and regression trees. My doubts are about the optimization of the hyperparameters, especially the depth of the trees
First ...
1
vote
0answers
15 views
Co-joining multi-peak histograms
I am analysing a bunch of data files which represent responsiveness of cells to addition of a drug. If a drug is not added, cell responds normally, if it is added, it shows abnormal patterns:
, .
We ...
2
votes
2answers
94 views
Determining if a time series is random
An example time series would be the stock market, which is sometimes described as a random walk. Over time, this is clearly not the case as it has essentially gone in one direction (up) with only ...
0
votes
0answers
8 views
Derive main prediction for zero-one loss function
Intuitively I can see why mode of predictions is the main prediction of a zero-one loss function, but mathematically I am not sure how it is derived?
Main prediction $= argmin_{y'}E_D[L(\widehat y, y'...
3
votes
0answers
159 views
Learning curve using micro F-score and macro F-score
I plotted the learning curves using micro and macro F-scores for a Multinomial Naive Bayes classifier.
The first plot is made using micro F-score, and the second using macro F-score. I find it quite ...
1
vote
0answers
14 views
Sampling trying to keep as much multivariate variance as possible
We can use PCA for dimensionality reduction, but at the cost of getting "uninterpretable" variables.
I was thinking if anyone considered a sampling technique that would try to aim keeping as much of ...
0
votes
1answer
46 views
What variance threshold to consider in feature selection?
Consider a numerical dataset with continuous variables, that has been scaled to end up with values in the [0,1] range. How can I compute a reasonable variance threshold for all the variables?
0
votes
0answers
12 views
Evaluating randomness in a model performance
I'm evaluating the variability in performance (AUC) in the test set of a machine learning model with an intrinsic random component (xgboost). How many sources of variation should I use?
Just ...
3
votes
1answer
95 views
What does high variance mean in a binary classification machine learning model?
My understanding of high variance is that the targets are spread widely around. The output values are "all over the place".
In a binary classification model, there can only be 2 outcomes. I am at a ...
1
vote
2answers
105 views
Why is there a trade-off between bias and variance in supervised learning? Why can't we have best of both worlds?
The bias-variance trade-off is like a law in machine learning. You cannot have the best of both worlds. What is it about supervised learning in machine learning that makes it impossible to satisfy the ...
1
vote
1answer
60 views
Measure degree of heteroscedasticity [closed]
I analyzed my time series using Breusch Pagan test and observed the presence of heteroscedasticity in it. After box-cox transformation, I again tested the time series using Breusch Pagan test. The ...
1
vote
0answers
15 views
Identify appropriate variance stabilization transform
I have a heavy tailed data which is heteroscedastic in nature. I need to apply some ML algorithms on this data that are good for normal distribution. So I want to transform the data. I tried Box cox ...
2
votes
1answer
98 views
Variance in statistics vs machine learning
In basic statistics, variance is a measure the variability of the data about its mean. In machine learning, variance is a measure of learning the training data too well/capturing the noise in the data/...
0
votes
1answer
119 views
Implication of a dominant Principal Component in PCA analysis
I need help, are there any practical implications of a dominant principal component. For example, if of three PCs, PC1 explains almost 100% of the variance in this dataset, What does this mean in ...
0
votes
1answer
33 views
Bias and variance in the model o in the predictions?
This topic confuses me. In the literature or articles, when talking about bias and variance in automatic learning, specifically in cross-validation, do they refer to the high bias (underfitting) and ...
1
vote
1answer
72 views
bias variance decomposition for classification problem
It is given that:
MSE = bias$^2$ + variance
I can see the mathematical relationship between MSE, bias, and variance. However, how do we understand the mathematical intuition of bias and variance for ...
1
vote
0answers
56 views
Math behind, MSE = bias^2 + variance
Based on the deeplearningbook:
$$MSE = E[(\theta_m^{-} - \theta)^2]$$
$$equals$$
$$Bias(\theta_m^{-})^2 + Var(\theta_m^{-})$$
where m is the number of samples ...
0
votes
0answers
24 views
ZCA: Covariance of Large Image Database
I have an overall question if my method is sound, so please bear with me in this description :).
I have a large image database and I wanted to create a preprocessing step using ZCA. The issue is that ...
1
vote
0answers
19 views
F-test for comparing the mean of two groups
What would be the procedure, in terms of F-test, if I would like to check if the mean of one group is greater than the other group (alternative hypothesis: $\mu_1 > \mu_2$)?
And also what would ...
0
votes
1answer
111 views
Massive variation in results with tensorflow and keras
I'm new to Tensorflow and Keras and I some background knowledge of how CNN's work.
I'm using a basic sequential model based on the code by https://pythonprogramming.net/convolutional-neural-network-...
2
votes
1answer
105 views
Bias-variance tradeoff and the uncertainty principle
Bias variance tradeoff seems to behave like the uncertainty principle, is it just another name for the same principle?
0
votes
0answers
7 views
Two tailed F test, correct rejection of the null hypothesis
I am performing an F test for equality of two variances by following this website formula https://itl.nist.gov/div898/handbook/eda/section3/eda359.htm, however it states that
In the above formulas ...
0
votes
0answers
4 views
What are some common sources of variance in a convolutional neural network DICE scores?
I know it's basically impossible to pinpoint the exact answer to this question without data, code, architecture, etc, but I'm curious as to if anyone has any general ideas on why this might be ...
1
vote
2answers
401 views
Why can decision trees have a high amount of variance
I've heard that decision trees can have a high amount of variance, and that for a data set $D$ split into test/train the decision tree could be quite different depending on how the data was split. ...
5
votes
3answers
2k views
Why underfitting is called high bias and overfitting is called high variance?
I have been using terms like underfitting/overfitting and bias-variance tradeoff for quite some while in data science discussions and I understand that underfitting is associated with high bias and ...
2
votes
0answers
26 views
Measure of variety within list/cluster
I have a dataset of about 53000 points. It has been clustered twice, based on two sets of unrelated attributes. For the first clustering (clustering 1) I used DBScan, and it ended up with about 700 ...
0
votes
0answers
65 views
Finding unaffected data in a dataset
The data set has missing values. Further examination tells that they are spread along 1.5 standard deviation from the median with distribution mean = 0 & variance = 5. How much data (in percentage)...
1
vote
0answers
12 views
Would it make technical sense to model its two known subelements separately (CLV example)?
Let's assume Customer Lifetime Value (CLV) is defined as average basket x frequency.
Option A is to build model predicting CLV ...
3
votes
1answer
211 views
Bias-variance tradeoff in practice (CNN)
I first trained a CNN on my dataset and got a loss plot that looks somewhat like this:
Orange is training loss, blue is dev loss. As you can see, the training loss is lower than the dev loss, so I ...
2
votes
3answers
339 views
Linear machine learning algorithms “often” have high bias/low variance?
In this blog, which explains the meaning of bias and variance in machine learning, there's a line under the heading "Bias-Variance Trade-Off"
which says:
Parametric or linear machine learning ...
0
votes
4answers
251 views
Meaning of variance in machine learning models
I know that high variance cause overfitting, and high variance is that the model is sensitive to outliers.
But can I say Variance is that when the predicted points are too prolonged lead to high ...
0
votes
1answer
47 views
Initialisation methods and variance
I'm trying to understand some weights initialisation methods by reading the article http://proceedings.mlr.press/v9/glorot10a/glorot10a.pdf .
But I don't understand their notation on variance. Right ...
0
votes
2answers
2k views
Relationship between train and test error
I have some specific questions for which I could not extract answers from books. Therefore, I ask for help here and shall be extremely grateful for an intuitive explanation if possible.
In general, ...
3
votes
1answer
3k views
RL Advantage function why A = Q-V instead of A=V-Q?
In RL Course by David Silver - Lecture 7: Policy Gradient Methods, David explains what an Advantage function is, and how it's the difference between Q(s,a) and the V(s)
Preliminary, from this post:
...
8
votes
3answers
5k views
What is the meaning of term Variance in Machine Learning Model?
I am familiar with terms high bias and high variance and their effect on the model.
Basically your model has high variance when it is too complex and sensitive too even outliers.
But recently I was ...
3
votes
0answers
108 views
Evaluation of regression models with different evaluations (MSE, variance, VAF etc.)
When comparing several regression models in terms of quality, it seems like most have agreed on the MSE.
There are also papers comparing "variance" and "variance accounted for (VAF)".
However, there ...
0
votes
1answer
83 views
Maths question on mean squared error being dervied to bias and variance
I am reading a book and have difficulty in understanding the math on bias-
variance tradeoff. Below is the section that I am having trouble with:
Given a set of training samples $x_1, x_2, ..., x_n$...
1
vote
1answer
27 views
sort occurrence matrix to minimize its spatial variance
Is there any algorithm or an approach that sort occurrence matrix to reduce its spatial variance. I mean by spatial variance moving window variance (n*n moving box).
1
vote
2answers
214 views
How is the equation for the relation between prediction error, bias, and variance defined?
I'm reading this article Understanding the BiasVariance Tradeoff. It mentioned:
If we denote the variable we are trying to predict as $Y$ and our
covariates as $X$, we may assume that there is a ...
0
votes
1answer
21 views
How is the property in eq 15 obtained for Xavier initialization
I am new in this field so please be gentle with terminology.
In the original paper; "Understanding the difficulty of training deep feedforward neural networks", I dont understand how equation 15 is ...
4
votes
3answers
1k views
How to estimate the variance of regressors in scikit-learn?
Every classifier in scikit-learn has a method predict_proba(x) that predicts class probabilities for x. How to do the same thing ...
1
vote
0answers
451 views
How to sort tensor along two axis by variance in TensorFlow?
I have a function that visualizes 2D convolutional kernels. The weights come as 4D-tensors [filter_height, filter_width, in_channels, out_channels], as specified for conv2d. Now I try to sort the ...
