Questions tagged [ridge-regression]

A regularization method for regression models that shrinks coefficients towards zero.

Filter by
Sorted by
Tagged with
0
votes
0answers
15 views

Error in predictions using glmnet() function in R

I've got a problem with my code, whilst making predictions using glmnet() Here is my code plus an error which occurs: ...
0
votes
0answers
9 views

what other metrics can i use to estimate quality of the model predicting income range - interval estimation task?

I trained a model that predicts customer's income given the features: age, declared income number of oustanding instalment, overdue total amount active credit limit, total credit limit total amount ...
2
votes
2answers
77 views

How do standardization and normalization impact the coefficients of linear models?

One benefit of creating a linear model is that you can look at the coefficients the model learns and interpret them. For example, you can see which features have the most predictive power and which do ...
1
vote
1answer
31 views

Why is Regularization after PCA or Factor Analysis a bad idea?

I have done Factor Analysis on my data and applied various machine learning models on it. I particularly find it giving high MSE value for Ridge and Lasso Regression compared to other models. I want ...
1
vote
1answer
67 views

How is learning rate calculated in sklearn Lasso regression?

I was applying different regression models to Kaggle Housing dataset for advanced regression. I am planning to test out lasso, ridge and elastic net. However, none of these models have learning rate ...
0
votes
0answers
11 views

Determining the degree of freedom in ridge regression | Interpretation of the head matrix

right now, I am diving into statistical learning and stumbled over the so-called "head-matrix" and the determination of the degree of freedom. I am referring to ridge regression: So the ...
0
votes
0answers
11 views

Can we use both ridge-lasso and PCA in the same model for better results?

My question here is if we are using the PCA, the dimensionality is reduced and no question of feature selection is required using ridge & lasso. So should I use ride-lasso followed by PCA or I ...
-1
votes
1answer
21 views

Is there a reference data set for ridge regression?

In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
4
votes
2answers
183 views

Extremely high MSE/MAE for Ridge Regression(sklearn) when the label is directly calculated from the features

Edit: Removing TransformedTargetRegressor and adding more info as requested. Edit2: There were 18K rows where the relation did not hold. I'm sorry :(. After ...
3
votes
1answer
143 views

Does ridge regression always reduce coefficients by equal proportions?

Below is an excerpt from the book Introduction to statistical learning in R, (chapter-linear model selection and regularization) "In ridge regression, each least squares coefficient estimate is ...
0
votes
0answers
19 views

Matlab - Financial Modeling, Linear Regression with Prior

Am trying to implement this equation from the book Doing Data Science Straight Talk from the frontline, In chapter 6, page 161, equation below: From what i can tell it is pretty much an enchanced ...
1
vote
1answer
58 views

Dividing the weights obtained on an already standardized data set by the standard deviation of the features? (Ridge regression)

I'm trying to understand a code snippet from my lecture on Machine Learning (see the code below). It extracts the mean and standard deviation of the features and uses them to 'normalize' (...
2
votes
3answers
1k views

Can ridge regression be used for feature selection?

I'm trying to figure out whether using Ridge Regression for regularization can be used to cause a more sparse hypothesis however to me it seems like ridge will never actually bring any coefficients to ...
3
votes
1answer
86 views

Does it matter whether we put regularization parameter ($C$) with error or weight term in Kernel ridge regression?

Kernel ridge regression associate a regularization parameter $C$ with weight term ($\beta$): $\text{Minimize}: {KRR}=C\frac{1}{2} \left \|\beta\right\|^{2} + \frac{1}{2}\sum_{i=1}^{\mathcal{N}}\left\|...
0
votes
0answers
68 views

Running into strange errors when using glmnet and generating graphs

I developed a very simple Ridge Regression with glmnet, the R package. When I use the plot.glmnet() function I encounter strange errors: ...
1
vote
1answer
137 views

How to improve Regression Model with High Training Performance and Low Test Performance

I am performing regression analysis on some data. I keep getting very high training score and low test score. My code is below, what can i do to enhance it? Thank you in advance. ...
3
votes
2answers
708 views

What does a negative coefficient of determination mean for evaluating ridge regression?

Judging by the negative result being displayed from my ridge.score() I am guessing that I am doing something wrong. Maybe someone could point me in the right ...