The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [variance]

The tag has no usage guidance.

22 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
36 views

Learning curve using micro F-score and macro F-score

I plotted the learning curves using micro and macro F-scores for a Multinomial Naive Bayes classifier. The first plot is made using micro F-score, and the second using macro F-score. I find it quite ...
24 views

Measure of variety within list/cluster

I have a dataset of about 53000 points. It has been clustered twice, based on two sets of unrelated attributes. For the first clustering (clustering 1) I used DBScan, and it ended up with about 700 ...
97 views

Evaluation of regression models with different evaluations (MSE, variance, VAF etc.)

When comparing several regression models in terms of quality, it seems like most have agreed on the MSE. There are also papers comparing "variance" and "variance accounted for (VAF)". However, there ...
10 views

Co-joining multi-peak histograms

I am analysing a bunch of data files which represent responsiveness of cells to addition of a drug. If a drug is not added, cell responds normally, if it is added, it shows abnormal patterns: , . We ...
14 views

Sampling trying to keep as much multivariate variance as possible

We can use PCA for dimensionality reduction, but at the cost of getting "uninterpretable" variables. I was thinking if anyone considered a sampling technique that would try to aim keeping as much of ...
15 views

Identify appropriate variance stabilization transform

I have a heavy tailed data which is heteroscedastic in nature. I need to apply some ML algorithms on this data that are good for normal distribution. So I want to transform the data. I tried Box cox ...
68 views

bias variance decomposition for classification problem

It is given that: MSE = bias$^2$ + variance I can see the mathematical relationship between MSE, bias, and variance. However, how do we understand the mathematical intuition of bias and variance for ...
52 views

Math behind, MSE = bias^2 + variance

Based on the deeplearningbook: $$MSE = E[(\theta_m^{-} - \theta)^2]$$ $$equals$$ $$Bias(\theta_m^{-})^2 + Var(\theta_m^{-})$$ where m is the number of samples ...
18 views

F-test for comparing the mean of two groups

What would be the procedure, in terms of F-test, if I would like to check if the mean of one group is greater than the other group (alternative hypothesis: $\mu_1 > \mu_2$)? And also what would ...
11 views

Would it make technical sense to model its two known subelements separately (CLV example)?

Let's assume Customer Lifetime Value (CLV) is defined as average basket x frequency. Option A is to build model predicting CLV ...
414 views

How to sort tensor along two axis by variance in TensorFlow?

I have a function that visualizes 2D convolutional kernels. The weights come as 4D-tensors [filter_height, filter_width, in_channels, out_channels], as specified for conv2d. Now I try to sort the ...
74 views

Convert a pdf into a conditional pdf such that mean increases and std dev falls

Let success metric(for some business use case I am working on) be a continuous random variable S. The mean of pdf defined on S indicates the chance of success. Higher the mean more is the chance of ...
5 views

Derive main prediction for zero-one loss function

Intuitively I can see why mode of predictions is the main prediction of a zero-one loss function, but mathematically I am not sure how it is derived? Main prediction \$= argmin_{y'}E_D[L(\widehat y, y'...
40 views

What variance threshold to consider in feature selection?

Consider a numerical dataset with continuous variables, that has been scaled to end up with values in the [0,1] range. How can I compute a reasonable variance threshold for all the variables?
12 views

Evaluating randomness in a model performance

I'm evaluating the variability in performance (AUC) in the test set of a machine learning model with an intrinsic random component (xgboost). How many sources of variation should I use? Just ...
62 views

Implication of a dominant Principal Component in PCA analysis

I need help, are there any practical implications of a dominant principal component. For example, if of three PCs, PC1 explains almost 100% of the variance in this dataset, What does this mean in ...
28 views

Bias and variance in the model o in the predictions?

This topic confuses me. In the literature or articles, when talking about bias and variance in automatic learning, specifically in cross-validation, do they refer to the high bias (underfitting) and ...
19 views

ZCA: Covariance of Large Image Database

I have an overall question if my method is sound, so please bear with me in this description :). I have a large image database and I wanted to create a preprocessing step using ZCA. The issue is that ...
7 views

Two tailed F test, correct rejection of the null hypothesis

I am performing an F test for equality of two variances by following this website formula https://itl.nist.gov/div898/handbook/eda/section3/eda359.htm, however it states that In the above formulas ...
4 views

What are some common sources of variance in a convolutional neural network DICE scores?

I know it's basically impossible to pinpoint the exact answer to this question without data, code, architecture, etc, but I'm curious as to if anyone has any general ideas on why this might be ...