# Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

1,590 questions
Filter by
Sorted by
Tagged with
40 views

### What to do when test values are not correlated with predictions?

I have a regression problem where I obtained a mean absolute error close to the desired value but the predictions do not correlate well with the expected values. I have tried several algorithms, ...
10 views

### Convert Regression output to classification based on prospective performance of model

Let’s say I have a regression model that predicts experimental value in the range of 4 to 8 of an object based on a set of features. I am aiming to design an oBject with an experimental value of great ...
28 views

### Feature selection: ANOVA between features vs within a feature

I am currently performing feature selection on a dataset containing continuous and categorical features. The target is a continuous variable. If I understand properly, ANOVA can be used between ...
1 vote
45 views

### How do I use ML models to estimate current stress level based on past data?

I am new to machine learning and I cannot understand the difference between estimating current stress level and predicting future stress levels based on historical data. I have been told these are two ...
113 views

### Understand and compute confidence interval and coefficient of variation for regression model

I would like to better understand the concepts of: coefficient of variation and confidence interval. Trivially taking the definitions from wikipedia: confidence interval (CI) In frequentist ...
1 vote
13 views

### Can the k-index in either of the two individual locations be used to predict the estimated kp-index?

The k-index measures the condition of the magnetosphere. It is usually averaged over three hour, so each day has 8 measurements. The planetary k-index (kp-index) is an average of the measures taken ...
19 views

15 views

### Can a multivariate MIMO LSTM forecaster learn the relationships between the multiple feature outputs?

Question: Can a multivariate MIMO LSTM learn the relationships between the multiple feature outputs? This question arose when I decided to modify a multivariate (Multiple Input - Single Output, MISO) ...
2 views

### With infinite observations, would the weights resulting from ridge regression be the same as simple linear regression?

As the number of observations approaches infinity, do the weights of a linear regression approach the weights of a linear regression with L2 penalty?
8 views

### Align Vectors are Easy to Learn?

I have three vectors $x,y_1,y_2\in\mathbb{R}^{n\times 1}$, where $x=y_1$, $x\perp y_2$. If I use $x$ as input of a 2-layer perceptron, will regressing $y_1$ be easier than $y_2$ (i.e., when fully ...
18 views

### What is the right type of equation to fit the following data

I want to estimate the amount of unique social media users $N$, in a list of the $K$ most recent social media posts (i.e. I extract the user that posted each post). I've made a few graphs based on the ...
29 views

### Does MAPE really penalizes overpredictions?

I read it on many sites, that one of the main "disadvantage" of MAPE is that it penalizes overpredictions, hence it prefers models that are under-predicting. The main argument is that if we ...
1 vote
64 views

### Linear Regression and Logistic Regression

I'm a beginner, and I'm wondering whether a logistic regression in a nut-shell is just normalizing a linear regression? Correct me if I'm wrong, but I came to this conclusion because the predicted ...
1 vote
40 views

### How to build a categorization system without a target variable?

The data I have a large dataset containing execution logs from various tests conducted over several years. The logs can be noisy and often contain a plethora of messages detailing the ongoing ...
15 views

### Minimize MAE loss for a target that is sum of two other targets

Working on a regression modelling task where my dataset have some feature columns, two more columns A, B and a target column T. The goal is to predict T, and minimize MAE, that is ...
30 views

### How to assign sample weight for regression problem

I'm trying to model a forecasting problem where I'm trying to forecast for the following month. I am using LightGBM Regressor class for it and it giving me a decent ...
27 views

### GridSearchCV with TimeSeriesSplit

I am tuning the HPs for a time dependant neural network model (heating energy consumption prediction) in a bachelor thesis. Total amount of samples is 145.860, with minutely granularity from January ...
14 views

### Metrics for difference between two "vectors" of independents values

New here! I'm working in some crypto for a Ph.D. and I'm trying to figure out the best metrics to measure the different/error between a input vector of integers with the output that ideally is the ...
31 views

### The optimal way to stratify a numerical target variable into a categorical one for a machine learning algorithm

I have tabular data, the predictive variables are numerical and categorical and the target variable is a numerical one. Using the proper techniques I can make predictive models with R^2=0.95. Now let'...
12 views

### How is it called when instead of creating predective models finding patterns in observed data (ML) you tried to guess the model theorically...?

I'm a college student appasionated of machine learning and I've decided to my bachelor thesis about it. I thought that as an interesting introduction to machine learning, I could introduce it by ...
13 views

### RMSE of whole and part of test dataset

Can anybody help me to understand the behavior of metrics (RMSE namely) when testing model? I have NN with 1 hidden layer for regression task. RMSE equal 0.07 for external test dataset. But if I break ...
9 views

### warning 'newdata' had X row but variables found have Y rows

Linear Discriminant Analysis (LDA)+logistic regression model lda_model <- lda(train_labels ~ Sepal.Length + Sepal.Width + Petal.Length + Petal.Width, data = train_data) LDA scores for the training ...
8 views

### Automating the task of figuring out if a task is classification or regression

When manually identifying if a given dataset and dependent variable are suitable for classification or regression I look at the type of variable (continuous or discrete) in which the name and values ...
35 views

### Neural regression predictions all around the mean of target

I have a transformer regression model and some data about last users transactions (categorical and numerical). My target has exponential distribution with mean aroud 10e4 and also zero-inflated, so I ...
32 views

### Regresson on 3d tabular data

There is a dataset, where each Y depends on separate table : Each table consists of the same set of columns, but the number of rows may vary. Features in tables are both numerical and categorical (...
16 views

### 2 regression models giving same performance

I have 2 regression models (1 is deeplearning based) and another is SVR both trained on the embeddings obtained from the last FC layer of ResNet50. Output variables are min-max normalized to get in ...
48 views

### XGBoost tweedie regression objetive from scratch

I'm trying to gain a deeper understanding of the tweedie loss function and how it is used in XGBoost. So, I tried to implement it from scratch. I started by examining the original implementation. I ...
27 views

### calculate the predicted value based on coefficient and constant in python

i have the coefficients and the constant (alpha). i want to multiply and add the values together like this example. (it has to be done for 300000 rows) Prediction = constant + (valOfRow1 * col1) + (-...
20 views

### Can you please provide one fully solved gradient boosting regression numerical example (not python code) [duplicate]

Can you please provide one fully solved gradient boost regression numerical example (not Python code).
42 views

### One-Hot encoded variables dominates importance among other variables

I am currently training some machine learning models to predict the 28-day compressive strength of cement, a continuous real-valued variable. The available dataset comprises samples from three ...
78 views

### Best metrics to evaluate the performance of a regression model?

I've just started with machine learning and I have a lot to learn but one of the recent problems I'm facing is evaluating the performance of a regression model. I know about MSE, RMSE, MAE ...
8 views

### Grouped Time Restricted Demand Regression with value cap

so I am working on quite an interesting regression task that I haven't encountered before. Our company sells products (steel) in tons. We offer contracts where the customer orders a certain amount of ...
40 views

### XGBRegressor underestimates sum of regression target (insurance application)

I'm trying to learn how to apply Boostig Algorithms (e.g. XGBoost) to insurance applications (premium calculation). As a starting point I used this tutorial from the scikit-learn website. tldr: The ...
376 views

### Parameter estimation in linear regression

Another test Q I couldn't answer - We have marks of students belonging to 3 sections - A,B,C and two genders - M & F. Which regression model will not be able to estimate all the parameters? 1 ) ...
13 views

### Is it possible okay to use regression MLP for ordinal classification problem when target variable is numerical?

I have a target variable of 1-10 that represent difficulty level. These are individual classes represented by integers with 1 being the easiest and 10 most difficult. I have decided to use regression ...
17 views

### Is this problem a time series regression or seq2seq regression or some other type of problem?

I measure sequences of 3 parameters in my system. 2 are independent and the 3rd dependent. Let's call the independent ones $x$ and $y$, and the dependent one $z$. They are each measured once per hour ...