Questions tagged [linear-models]
The linear-models tag has no usage guidance.
22
questions
1
vote
1
answer
34
views
What are the advantages of model drift vs concept drift in online learning?
I have asked this question here but I'm also posting it here to get a better insight:
https://stats.stackexchange.com/questions/602282/what-are-the-advantages-of-model-drift-vs-concept-drift-in-online-...
- 131
0
votes
1
answer
28
views
Is Linear kernel SVM always better than Logistic regression?
We know that linear kernel SVM may give better results than logistic regression since maximizing the margin usually leads to more stable results/better displacement of the decision boundary. But is ...
- 246
-1
votes
1
answer
19
views
How do the intercept and slope calculated in linear regression relate to the output of lm?
I have been looking at how to calculate coefficients by hand
and the example produces
$Y = 1,383.471380 + 10.62219546 * X$
However the output shown of lm does not show these values anywhere.
How do I ...
- 105
0
votes
0
answers
39
views
Linear Regression: Won't adding irrelevant features still improve the prediction
Assume we are predicting weight based on height: this is simple linear regression. If we now add gender, this creates multiple linear regression and improves our model, and makes it more capable of ...
- 195
0
votes
0
answers
27
views
Plot overfit of multi variable input model
In my machine learning project, I have created a linear regression model that has an input of 4 variables and returns output variable. Before adapting and processing the data, my model was overfitting,...
0
votes
0
answers
28
views
Is it a good idea to test the robustness of a Neural Network on a linear relation?
Just to give you more context, I'm currently working on a finance project relying on neural network. I'm principally using Neural Network to achieve regression task. So my neural network aims to ...
1
vote
1
answer
36
views
Temperature lag forecasting
I am working on a data science project on an industrial machine. This machine has two heating infrastructures. (fuel and electricity). It uses these two heatings at the same time, and I am trying to ...
- 23
0
votes
0
answers
60
views
Feature importance of a linear regression
What is the easiest and easy to explain feature importance calculation for linear regression?
I know I can use Shap to compute feature importance, but I find it difficult to explain it to stakeholders,...
- 233
0
votes
0
answers
19
views
How to write this TeX equation appropriately for publication?
I have a 2 variables that resemble 2 different tests. I would like to multiple it by 0.2 with conditions. If test1 is available and ...
- 101
0
votes
1
answer
130
views
What is the SHAP values for a liner model? How do we derive that?
What is the SHAP values for a linear model?
it is given as below in the documentation
Assuming features are independent leads to interventional SHAP values which for a linear model are coef[i] * (x[i]...
- 233
1
vote
1
answer
72
views
Is it possible to explain why Lasso models eliminated certain coefficient?
Is it possible to understand why Lasso models eliminated specific coefficients?. During the modelling, many of the highly correlated features in data is being eliminated by Lasso regression. Is it ...
- 233
0
votes
1
answer
49
views
Can I include a quotient as dependent variable and independent variables with same denominator in a linear model? How do we interpret such models?
I want to create a model in a food processing plant where my dependent variable is Electricity (KWhr) consumption per kg. Plant produce different food items with varying electricity consumption. I'm ...
- 233
0
votes
0
answers
36
views
Approaches for multiclass classification with a reference level to extract variables of importance?
I have a dataset with with multiple classes (< 20) which I want to classify in reference to one of the classes.The final goal is to extract the variables of importance which are useful to ...
1
vote
0
answers
33
views
Does the appliance of R-squared to non-linear models depends on how we calculate it?
Does the appliance of R-squared to non-linear models depends on how we calculate it? $R^2 = \frac{SS_{exp}}{SS_{tot}}$ is going to be an inadequate measure for non-linear models since an increase of $...
- 121
1
vote
1
answer
72
views
The effect of the λ in the Ridge regression
Why by increasing value of λ in Ridge estimator the slope of the line is decreasing? How exactly λ affects to the y = kx + b?
- 11
1
vote
2
answers
2k
views
How to visualize optimization problems' feasible region?
Is there any tool to visualize the feasible region when given a set of Linear equations (equalities and inequalities). If not, can anyone suggest a way to visualize it?
If I am going to do it myself ...
- 111
1
vote
0
answers
207
views
Does linear kernel make SVM a linear model?
I have deleloped several SVR models for my case study using the linear kernel, and those models were optimized using the RMSE as criterion. Now Im searching for additional evaluation metrics and it ...
- 33
0
votes
1
answer
977
views
How to make a linear model with a constant value in R?
I'm working on an unassessed homework problem from unpublished course notes of a statistics module from a second year university mathematics course.
I'm trying to plot a 2-parameter full linear model ...
- 103
0
votes
0
answers
60
views
What is the Intuition behind weight vector W which is normal to the plane? Is the weight vector W same as the W which is normal to the plane π?
In an interview, I was asked the intuition behind the weight vector. I told the weight vector is a vector which we try to minimize to a local minima with the help of regulariser so we don't overfit. ...
- 35
0
votes
1
answer
370
views
Can absolute or relative contributions from X be calculated for a multiplicative model? $\log{ y}$ ~ $\log {x_1} + \log{x_2}$
(How) can absolute or relative contributions be calculated for a multiplicative (log-log) model?
Relative contributions from a linear (additive) model
E.g., there are 3 contributors to $y$ (given by ...
- 131
1
vote
0
answers
93
views
How can I compare a NN model and a linear regression?
I have a small dataset (1500 rows) and to predict the imbalanced target, I am running two linear models (linear regression and lasso) and one nonlinear model (Neural Network) on it. I am using Area ...
- 103
3
votes
1
answer
652
views
what is difference between Logistic regression and SGDClassifier with log loss OR SVM and SGDClassifer with hinge loss?
Can we just use SGDClassifier with log loss instead of Logistic regression, would they have similar results ?
- 39