Questions tagged [mse]
MSE stands for mean-squared error. It's a measurement of an empirical loss in certain mathematical models, especially regression models.
44
questions
1
vote
0
answers
60
views
ValueError: Found input variables with inconsistent numbers of samples: [120, 30]
I practice XGBClassifier() to predict the target in iris dataset.
here is the code:
...
0
votes
0
answers
19
views
Plateaus training loss but validation loss decreases
I am training a fully convolutional regressor, with mobilenet as its backbone. I have already overcome a massive overfitting problem by augmenting the data. However, the training loss seems to be ...
0
votes
0
answers
41
views
Hello! I am create linear model in python, and have question. It's bad score or good score?
please, take me info, this bad or good?
I am real don't understand....
i'm know, also when
Mean Absolute Deviation (MAD): In [0,∞), the smaller the better
Root Mean Squared Error (RMSE): In [0,∞), the ...
0
votes
1
answer
26
views
Relation between MSE and variance of data
I am having a hard time understanding how to compare results of MSE and variance of data to eachother. I understand that MSE is used to calculate how far off data points are from a prediction, say you ...
- 1
2
votes
1
answer
423
views
Predict actual result after model trained with MinMaxScaler LinearRegression
I was doing the modeling on the House Pricing dataset. My target is to get the mse result and predict with the input variable
I have done the modeling, I'm doing the modeling with scaling the data ...
- 123
0
votes
1
answer
48
views
Proof for MSE = Var + Bias2
I am trying to prove the equality of $$\rm MSE=Var+Bias^2$$ but obviously I got something wrong as they don't equal in my calculation:
So here is the example. I use monte carlo to estimate this ...
- 133
0
votes
1
answer
122
views
MAE vs MSE for linear regression
Several articles says that MAE is robust to outliers but MSE is not and MSE can hamper the model if errors are too huge.
My question is that MSE and MAE both are error matrices,our priority is to just ...
- 43
0
votes
1
answer
11
views
Do I need to rescale input labels before training (label values between 20..51)?
I'm trying to build model for this datatset (Age prediction):
The input image has the shape: 3, 128, 128 and the predicted labels (ages) range between 20 to 51.
I ...
- 363
0
votes
0
answers
10
views
Trying to implement a loss function read from a journal-article in python
Computer science undergrad here. I am trying to understand Eqn 12 from this paper so that I can implement it in python code. In this paper, the NN model takes a blurred image as input and outputs a ...
1
vote
1
answer
478
views
how to calculate loss function?
i hope you are doing well ,
i want to ask a question regarding loss function in a neural network
i know that the loss function is calculated for each data point in the training set , and then the ...
- 23
0
votes
1
answer
44
views
Why does log-transforming the target have a huge impact on MSE value?
I am doing linear regression using the Boston Housing data set, and the effect of applying $\log(y)$ has a huge impact on the MSE. Failing to do it gives MSE=34.94 ...
- 109
0
votes
0
answers
68
views
Batch Size influences R2 score a lot, but not MSE (much)
If I train a model following a random search, (and in general for this problem I am working on), a big batch size seems to control R2 score where bs=200 or more, say, roughly, gives R2 scores of 0.95 ...
- 91
0
votes
1
answer
119
views
What causes explosion in MSE when training?
I (probably) well overfitted/overtrained a model. But I was just curious as to what might cause this type of behaviour. I carried on training (Epoch 1/50 is not the first epoch of training this model)....
- 91
0
votes
0
answers
67
views
weighted mse - weights as function of time
I am predicting timeseries data using LSTM (in tensorflow).
Currently I am using MSE as my metric of choice.
I would like to create my own custom Weighted MSE metric, such that the weights are a ...
- 1
0
votes
0
answers
13
views
Increasing (negative) R2 coincident with decreasing (positive) MSE during hyper parameter optimisation
I have a densely connected NN and I'm running a hyper parameter optimisation for multi-target output. During hyper parameter optimisation training, each epoch KerasTuner focuses on val_loss.
During ...
- 91
0
votes
1
answer
16
views
How to extract MSEP or RMSEP from lassoCV?
I'm doing lasso and ridge regression in R with the package chemometrics. With ridgeCV it is easy to extract the SEP and MSEP values by ...
- 5
1
vote
1
answer
70
views
Can't understand an MSE loss function in a paper
I'm reading a paper published in nips 2021.
There's a part in it that is confusing:
This loss term is the mean squared error of the normalized feature
vectors and can be written as what follows:
...
- 249
0
votes
0
answers
45
views
Find $a, b, c$ minimizing MSE
Suppose you are given a "dummy" classifier. It looks like this:
$$
y(x) = \begin{cases} a \text{ if } x >= c \\ b \text{ else } \end{cases}
$$
Given some data set $\{(y_1, x_1), \dots (...
0
votes
0
answers
79
views
Why the error between the measured data and model data is not minimizing in Python?
I want to fit the non-linear experimental data with the model function by estimating some parameters in the function. The model function I have is: ...
- 1
6
votes
1
answer
513
views
Why autoencoders use binary_crossentropy loss and not mean squared error?
Keras autoencoders examples:
(https://blog.keras.io/building-autoencoders-in-keras.html) use binary_crossentropy (BCE) as loss function.
Why they use ...
- 363
0
votes
0
answers
1k
views
Why training loss is decreasing down too fast?
I have a dataset of video sequences, I have trained them, and calculated the training loss using mean square error, but my training loss is decreasing down very fast. Like 0.06-0.02. Is it just fine ...
- 21
1
vote
3
answers
118
views
what n represents in the MSE loss function?
Neural Network Loss Function - Mean Square Error: questions about what 'n' signifies
I can't understand how the answers in this question answered the question. please help me to understand the ...
- 11
2
votes
1
answer
56
views
What is bad, good and excellent metric score for time series model?
I have created a couple of models for my master project and I used several metrics for evaluation. I used MSE, MAE, MAPE, RMSE not because I really learned about them a lot, because I saw in many ...
0
votes
1
answer
4k
views
neg_mean_squared_error in cross_val_score [closed]
The string "mean_squared_error" appears to be deprecated in cross_val_score now, and it's saying to use ...
- 101
1
vote
1
answer
2k
views
input shape of keras Sequential model
i am new to neural networks using keras,
i have the following train samples input shape (150528, 1235) and output shape is (154457, 1235) where 1235 is the training examples,
how to put the input ...
- 23
0
votes
3
answers
59
views
MSE relevance as a metric when errors < 1
I'm trying to build my first models for regression after taking MOOCs on deep learning. I'm currently working on a dataset whose labels are between 0 and 2. Again, this is a regression task, not ...
- 11
3
votes
1
answer
2k
views
Match between objective function and evaluation metric
Does the objective function for model fitting and the evaluation metric for model validation need to be identical throughout the hyperparameter search process?
For example, can a XGBoost model be ...
- 683
0
votes
2
answers
535
views
Regression performance with Feature Selection
I would like to ask you a theoretical question. In my project I am trying to get a better performance from my regression model by feature selection methods, especially with CatBoost feature ...
- 29
1
vote
1
answer
1k
views
What would be the mse (mean squared error) of my scaled dataset on the original scale?
I build an LSTM model on a standardized dataset using sklearn's MinMaxScaler. All values of the dataset are between 0 and 1. Features and target variables were standardized between 0 and 1.
I achieve ...
- 113
0
votes
1
answer
86
views
When optimizing the MSE, the correlation between prediction and target increases?
After optimizing the MSE (mean squared error) in a regression task, how is the change in Pearson correlation coeficient between target vector and the prediction?
Is any behaviour possible?
Or is sure ...
- 2,222
0
votes
1
answer
82
views
I am getting very minimal mse values and not sure if it is correct?
Below is the linear regression model I fitted and not sure if I am doing the right way as I am getting neat to 99% accuracy
Fitting Simple Linear Regression to the Training set
...
- 69
1
vote
2
answers
110
views
Finding a vector that minimize the MSE of its linear combination
I have been doing a COVID-19 related project. Here is the question:
N = vector of daily new infected cases
D = vector of daily deaths
E[D] = estimation of daily deaths
N is a n-dimensional vector, n ...
- 11
0
votes
1
answer
166
views
PyTorch MultiLayer Perceptron Classification Size of Features vs Labels Wrong
I am getting the following error:
...
4
votes
2
answers
2k
views
Extremely high MSE/MAE for Ridge Regression(sklearn) when the label is directly calculated from the features
Edit: Removing TransformedTargetRegressor and adding more info as requested.
Edit2: There were 18K rows where the relation did not hold. I'm sorry :(. After ...
- 175
-1
votes
1
answer
64
views
Understanding MSE,R2 scores wrt different scaling methods and non intutive results
EDIT: Added Code and updated the metric values as my code changed
If I have the Income Statements of all the companies currently trading in the US, I would like to predict the gross profit.
I was ...
- 175
1
vote
0
answers
18
views
Which MSE (total or individual) back-propagate for multi out regression neural network
When we have multi output regression neural network, we can calculate total MSE and individual MSE per output. How this MSE should back-propagate ? Shouldn't we back-propagate individual MSE through ...
- 11
0
votes
1
answer
8k
views
How to Minimize mean square error using Python
I want to minimise mean square error function to find best alpha value (decay rate) for my model.
Here is the description of my model:
...
- 277
3
votes
1
answer
465
views
Confusion about the MSE ERROR
I created a Random Forest regressor model and calculated my own error. I also want to calculate MAE, MSE and RMSE to compare my results to similar use cases. I am confused by the results as the values ...
- 337
3
votes
2
answers
3k
views
Reason for generally using RMSE instead of MSE in Linear Regression
In linear regression, why we generally use RMSE instead of MSE? The rationale I know is that it's easy to minimize the error in RMSE instead of MSE by Gradient Descent, but I need to know the exact ...
- 534
1
vote
1
answer
53
views
Carlification of the MSE loss sum symbol
So I have a question regarding the MSE loss on the application of a Neural Network.
Loss function: $\text{MSE} = \frac{1}{2} \sum_{i=1}^{n} (Y_i - \hat{Y_i}) ^ 2$
I ...
- 133
1
vote
1
answer
28
views
why is MSE of prediction way different from loss over batches
I am new to machine learning so forgive me if i ask stupid question. I have a time series data and i split it into training and test set.
This is my code:
...
- 23
0
votes
1
answer
511
views
Coefficients of Linear regression for minimizing MSE
(I asked this in mathematics site, but nobody responded, it seems the whole problem is more related to data science than math.)
In a regression problem, loss function is:
$$L(a,b) = {\sum_{i=1}^n (y^...
- 1,154
1
vote
1
answer
312
views
Math behind, $MSE = bias^2 + variance$
Based on the deeplearningbook:
$$MSE = E[(\theta_m^{-} - \theta)^2]$$
$$equals$$
$$Bias(\theta_m^{-})^2 + Var(\theta_m^{-})$$
where m is the number of samples ...
- 1,154
0
votes
2
answers
69
views
A substitute formula for MSE
I don't understand where this formula for Mean Squared Error is coming from.
How do we arrive at:
$$MSE = \frac{1}{m}||y' - y||_2^2$$
from:
$$MSE = \frac{1}{m}\cdot\sum_i(y'_{i} - y_{i})^2$$
(The ...
- 1,154