Questions tagged [linear-models]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
0answers
39 views

Understanding the math behind linear classification [closed]

For example we have $X$ train data, $y$ and $w$ Our margin is $M = y_i \langle w, x_i \rangle$ If $M_i > 0$ classifier return True predict and otherwise, if $M_i < 0$ we get False predict. How ...
1
vote
0answers
27 views

Does linear kernel make SVM a linear model?

I have deleloped several SVR models for my case study using the linear kernel, and those models were optimized using the RMSE as criterion. Now Im searching for additional evaluation metrics and it ...
0
votes
0answers
11 views

Linear models: Imputing missing not at random

This question is a continuation of a similar question for linear models instead of Tree-based model. Given that linear models (e.g. lasso, ridge, Linear regression, elastic net, etc.) can't handle ...
0
votes
0answers
11 views

linear mixed modelling- Zi in model matrix

Hi I am trying to learn linear mixed modelling. In the matrix form of the model $Y_i = X_i \beta + Z_i \mu_i + \epsilon_i$, how do we calculate is $Z_i$? The model is defined in the picture attached. ...
0
votes
1answer
14 views

How to make a linear model with a constant value in R?

I'm working on an unassessed homework problem from unpublished course notes of a statistics module from a second year university mathematics course. I'm trying to plot a 2-parameter full linear model ...
0
votes
0answers
21 views

What is the Intuition behind weight vector W which is normal to the plane? Is the weight vector W same as the W which is normal to the plane π?

In an interview, I was asked the intuition behind the weight vector. I told the weight vector is a vector which we try to minimize to a local minima with the help of regulariser so we don't overfit. ...
0
votes
1answer
85 views

Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$

(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model? Relative contributions from a linear (additive) model E.g., there are 3 contributors to $y$ (given by ...
1
vote
0answers
37 views

How can I compare a NN model and a linear regression?

I have a small dataset (1500 rows) and to predict the imbalanced target, I am running two linear models (linear regression and lasso) and one nonlinear model (Neural Network) on it. I am using Area ...
3
votes
1answer
86 views

what is difference between Logistic regression and SGDClassifier with log loss OR SVM and SGDClassifer with hinge loss?

Can we just use SGDClassifier with log loss instead of Logistic regression, would they have similar results ?