# Questions tagged [linear-models]

The tag has no usage guidance.

31 questions
Filter by
Sorted by
Tagged with
1 vote
1 answer
51 views

### Minimize $\sum_i||Y_i-AX_i||^2$

I have N data vectors $X_i$ and N target vectors $Y_i$ where $i$ indexes the sample. I would like to learn a linear map $A$ between the data and the target i.e find the matrix $A$ that minimize \...
• 113
0 votes
1 answer
36 views

### Can Linear Models infer Product Sum operation of Features to predict Target?

In a dataset of 9 columns: $X_1-X_8, y$. $y = X_1 * X_5 + X_2 * X_6 + X_3 * X_7 + X_4 * X_8$ Can any form of linear model (anything but SVM, NN, Random Forest, XGBoost, etc.) predict $y$?
0 votes
1 answer
59 views

### Effect on regression coefficients by multiplying a constant to a feature

I was solving one quiz question on Coursera and I found an interesting question. If you double the value of a given feature (i.e. a specific column of the feature matrix), what happens to the least-...
• 165
0 votes
0 answers
19 views

• 121
1 vote
1 answer
654 views

### The effect of the λ in the Ridge regression

Why by increasing value of λ in Ridge estimator the slope of the line is decreasing? How exactly λ affects to the y = kx + b?
• 11
3 votes
2 answers
4k views

### How to visualize optimization problems' feasible region?

Is there any tool to visualize the feasible region when given a set of Linear equations (equalities and inequalities). If not, can anyone suggest a way to visualize it? If I am going to do it myself ...
• 131
2 votes
0 answers
457 views

### Does linear kernel make SVM a linear model?

I have deleloped several SVR models for my case study using the linear kernel, and those models were optimized using the RMSE as criterion. Now Im searching for additional evaluation metrics and it ...
• 43
0 votes
1 answer
2k views

### How to make a linear model with a constant value in R?

I'm working on an unassessed homework problem from unpublished course notes of a statistics module from a second year university mathematics course. I'm trying to plot a 2-parameter full linear model ...
• 103
0 votes
0 answers
88 views

### What is the Intuition behind weight vector W which is normal to the plane? Is the weight vector W same as the W which is normal to the plane π?

In an interview, I was asked the intuition behind the weight vector. I told the weight vector is a vector which we try to minimize to a local minima with the help of regulariser so we don't overfit. ...
0 votes
1 answer
622 views

### Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$

(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model? Relative contributions from a linear (additive) model E.g., there are 3 contributors to $y$ (given by ...
• 141
1 vote
0 answers
110 views

### How can I compare a NN model and a linear regression?

I have a small dataset (1500 rows) and to predict the imbalanced target, I am running two linear models (linear regression and lasso) and one nonlinear model (Neural Network) on it. I am using Area ...
3 votes
1 answer
821 views

### what is difference between Logistic regression and SGDClassifier with log loss OR SVM and SGDClassifer with hinge loss?

Can we just use SGDClassifier with log loss instead of Logistic regression, would they have similar results ?