Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 97267

Least Absolute Shrinkage and Selection Operator (LASSO) regression, is a regularization technique used in regression cases where the model overfits or there is high multi-collinearity.

1 vote
1 answer
83 views

Why is the L2 penalty squared but the L1 penalty isn't in elastic-net regression?

That worked good for my purposes, but I know that usually in sparse regression models (for example elastic net or lasso regression) the L1 penalty is not squared, so it made me wonder if there could be …
Tomer Wolberg's user avatar
0 votes
Accepted

Why is the L2 penalty squared but the L1 penalty isn't in elastic-net regression?

If we solved lasso/ridge on each of them separately we'll get the same answer as if we solved the problem on the matrix: $$A_1 \ \ 0\\ 0 \ \ A_2$$ And the desired vector $$b_1\\ b_2 $$ But in the case …
Tomer Wolberg's user avatar