# Questions tagged [linear-regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

533 questions
Filter by
Sorted by
Tagged with
25 views

### Why is $Y=\beta_0 x^{\beta_1} e$ a linear model?

Why is $Y=\beta_0 x^{\beta_1} e$ a linear model? When we apply the transform, it becomes $lnY = ln\beta_0+\beta_1 lnx +lne$, and why is it still linear when the $\beta_0$ part is under ln?
14 views

### Building Model directly on data [closed]

I am building a model and my data is mostly skewed how far I can trust my model. My Training and Testing errors are almost equal and I am getting good results on my testing data. Can I belive that ...
14 views

### Why I got a wrong loss? [closed]

I am using Pytorch to do a linear regression but I got some problems with my code : I started to import the packages : ...
16 views

### Deriving vectorized form of linear regression

We first have the weights of a D dimensional vector $w$ and a D dimensional predictor vector $x$, which are all indexed by $j$. There are $N$ observations, all D dimensional. $t$ is our targets, i.e, ...
60 views

### Which machine learning model to choose? [closed]

I am a beginner in data science. I am facing the problem of choosing the most appropriate algorithm for my specific problem. I am building a recommendation system that gives students insight into ...
7 views

### Value error while using Linear Regression (new) [closed]

I am new to Python. I was trying to practice Linear Reg Modeling. Below error in picture shows up every time. Code in this link worked. Data set i used Ad.csv
27 views

### Interpretation of the data through scatter plot [closed]

I was exploring the data and had observed the data points are forming a triangle on the lower side. x-axis: Total items y-axis: Cancelled items Can someone help me ...
25 views

### How to use a multiple linear regression model built from normalized data

I built a linear multivariable regression model from normalized data (for the interval [0; 1]). Initially, the data was not normalized, I normalized the data by myself (independent and dependent ...
24 views

### Preprocessing dataset to predict salary

I'm currently a student in a machine learning course studying for an upcoming exam. Here's a question I've been given for practice: You have a very large dataset of employees and you'd like to ...
46 views

### Scikit learn linear regression - learning rate and epoch adjustment

I am trying to learn linear regression using ordinary least squares and gradient descent from scratch. I read the documentation for the Scikit learn function and I do not see a means to adjust the ...
73 views

### Predictive power of a dataset

I am reading a book on machine learning for undergraduate. I am actually confused on linear regression flexibility as the say: Occasionally, linear regression will fail to recover a good solution for ...
28 views

### Choosing the correct loss function

I am training multiple linear Ridge regression using Python (sklearn). I want to train regression using my loss function. I found that my loss function in sklearn I can define using ...
16 views

### How to calculate cov(e|X) in Generalised linear regression?

This image taken from wiki https://en.wikipedia.org/wiki/Generalized_least_squares. I am not able to calculate Cov(e|X)? Can someone tell me that.And also give me dimesion of cov(E|X)= sigma^2 * rho
1k views

### Overfitting in Linear Regression

I'm just getting started with machine learning and I have trouble understanding how overfitting can happen in a linear regression model. Considering we use only 2 feature variables to train a model, ...
39 views

### Imagining a Linear Regression model with more than 3 dimensions [closed]

I'm just getting started with Machine Learning and this is really bugging me now. Assuming we could use more than 2 feature variables to train a Multiple Linear Regression model, how can we imagine ...
15 views

### Implementation of RMS prop for linear regression

I'm trying to implement linear regression using Rms Prop optimizer from scratch. Code: ...
73 views

### How do standardization and normalization impact the coefficients of linear models?

One benefit of creating a linear model is that you can look at the coefficients the model learns and interpret them. For example, you can see which features have the most predictive power and which do ...
77 views

### Dose finding slope/intercept using the formula of m,b gives best fit line always In linear regression?

In liner regression We have to fit different lines and chose one with minimum error so What is the motive of having a formula for m,b that can give slope and intercept value in the regression line ,...
69 views

### Dropping one category for regularized linear models

While reviewing the sklearn's OneHotEncoder documentation (attached below) I noticed that when applying regularization (e.g., lasso, ridge, etc.) it is not recommended to drop the first category. ...
33 views

### Understanding one of the assumptions of linear regression: Multicollinearity

I've read that multicollinearity is one of the main assumptions of multivariate linear regression - Multicollinearity occurs when the independent variables are too highly correlated with each other. ...
60 views

### Possible harm in standardizing one-hot encoded features

While there may not be any added value in standardizing one-hot encoded features prior to applying linear models, is there is any harm in doing so (i.e., affecting model performance)? Standardizing ...
36 views

28 views

### Linear Regression with vs without polynomial features

I have a conceptual question about why (processing power/storage aside) would you ever just use a regular linear regression without adding polynomial features? It seems like adding polynomial features ...
147 views

### Can GLM( generalized linear method) handle the collinearity between the predictor variables in a regression-analysis?

I'm a beginner in Machine learning and I've studied that collinearity among the predictor variables of a model is a huge problem since it can lead to unpredictable model behaviour and a large error. ...
41 views

### Multivariate Linear Regression with exponential trend-line

The dataset that I'm working with has 2 independent variables (qty, volume) and 1 dependent variable (cost). When I plot individual X with Y, it turns out qty vs cost gives an exponential decay trend ...
12 views

### No data point at some combination of categorical independent variables when doing linear regression

I am running a linear regression model which contains a few categorical independent variables. During the EDA, I found that some combination of these categorical variables doesn't really have data ...
39 views

### Linear Regression Model

I'm taking a course on Supervised Learning in R: Regression. There is a section where I'm supposed to predict blood pressure given age and weight. This is was MY approach ...
36 views

### Trusting p-values when errors are not normally distributed [duplicate]

Suppose I have a multiple linear regression model and the errors are not distributed normally.Does the central limit theorem hold true in this case? should i trust the p values of the coefficients of ...
35 views

### Does it violate the assumptions of linear regression to perform it on time series data?

One of the assumptions of linear regression says that the errors must be independent i.e., the residuals must not depend on each other. Let's say we are using linear regression to model the ...
26 views

### Which supervised machine learning algorithms assume normally distributed feature variables?

I want to understand the assumptions made by supervised machine learning models. I've heard it said many times that 'you need to make sure your feature variables are normally distributed for your ML ...
36 views

### How to solve (or even effectively think about) a complex real-life multivariate problem

In my work, we get estimates. An estimate may include up to 12 different categories of costs (Development, Legal Travel, etc.) to produce any number of assets/deliverables from dozens of different ...
56 views

### Is it ok to trust regression predictions when none of the coefficients are statistically significant?

Background to the problem: I am estimating individual treatment effects using double machine learning model. I do not know true treatment effects for my problem. Double ML: Given Y (outcome), T (...