Questions tagged [linear-models]
The linear-models tag has no usage guidance.
9
questions
2
votes
0answers
39 views
Understanding the math behind linear classification [closed]
For example we have $X$ train data, $y$ and $w$
Our margin is $M = y_i \langle w, x_i \rangle$
If $M_i > 0$ classifier return True predict and otherwise, if $M_i < 0$ we get False predict.
How ...
1
vote
0answers
27 views
Does linear kernel make SVM a linear model?
I have deleloped several SVR models for my case study using the linear kernel, and those models were optimized using the RMSE as criterion. Now Im searching for additional evaluation metrics and it ...
0
votes
0answers
11 views
Linear models: Imputing missing not at random
This question is a continuation of a similar question for linear models instead of Tree-based model.
Given that linear models (e.g. lasso, ridge, Linear regression, elastic net, etc.) can't handle ...
0
votes
0answers
11 views
linear mixed modelling- Zi in model matrix
Hi I am trying to learn linear mixed modelling. In the matrix form of the model $Y_i = X_i \beta + Z_i \mu_i + \epsilon_i$, how do we calculate is $Z_i$? The model is defined in the picture attached.
...
0
votes
1answer
14 views
How to make a linear model with a constant value in R?
I'm working on an unassessed homework problem from unpublished course notes of a statistics module from a second year university mathematics course.
I'm trying to plot a 2-parameter full linear model ...
0
votes
0answers
21 views
What is the Intuition behind weight vector W which is normal to the plane? Is the weight vector W same as the W which is normal to the plane π?
In an interview, I was asked the intuition behind the weight vector. I told the weight vector is a vector which we try to minimize to a local minima with the help of regulariser so we don't overfit. ...
0
votes
1answer
85 views
Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$
(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model?
Relative contributions from a linear (additive) model
E.g., there are 3 contributors to $y$ (given by ...
1
vote
0answers
37 views
How can I compare a NN model and a linear regression?
I have a small dataset (1500 rows) and to predict the imbalanced target, I am running two linear models (linear regression and lasso) and one nonlinear model (Neural Network) on it. I am using Area ...
3
votes
1answer
86 views
what is difference between Logistic regression and SGDClassifier with log loss OR SVM and SGDClassifer with hinge loss?
Can we just use SGDClassifier with log loss instead of Logistic regression, would they have similar results ?
