Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

Filter by
Sorted by
Tagged with
1
vote
1answer
39 views

Deriving Prediction Intervals for Orthogonal Distance Regression using `scipy.odr`

Questions How can I derive prediction intervals for predictions based on new observations from the output of scipy.odr? Is it also possible (or necessary) to take ...
0
votes
1answer
32 views

How to reduce RMS error value in regression analysis & predictions - feature engineering, model selection

There's this dataset containing the metadata of Twitch's top 1,000 streamers of 2020. You can have the details here. I am currently participating in a challenge to predict the values for Followers ...
3
votes
3answers
91 views

Find recurrent dates in a small set (and get rid of non recurrent ones)

I need help in the analyse of a categorization problem. Given a set of dates (small set: 20 elements maximum), I would like to group dates which are equally distributed (with a tolerance). It can be,...
1
vote
1answer
13 views

Over-sampling when predicting a contionuous variable

Lets say i am predicting house selling prices (continuous) and therefore have multiple independent variables (numerical and categorical). Is it common practice to balance the dataset when the ...
0
votes
1answer
21 views

Approaches for matching leads to salesmen

I'm starting to tackle a new problem where we are trying to optimally match new leads (perspective customers) for our product to our sales representatives in the hopes of improving bottom-line metrics ...
0
votes
0answers
60 views

Having trouble reducing MSE error for SVR model sklearn (EDIT : now a Random Forest Regression Model)

I'm trying to create an SVR model to predict the number of comments a headline will receive for the following dataset : https://www.kaggle.com/benjaminawd/new-york-times-articles-comments-2020?select=...
0
votes
0answers
13 views

LSTM for non consecutive lags

Let's suppose I have a time series with hourly data. Firstly, I was using the previous 168 values aka lags/timesteps to forecast current value, i.e, I was trying to learn the following F function $X_t=...
0
votes
1answer
45 views

When R2 score and MSE are not correlated

I'm training some forecasting models and then, to check performance I see several metrics. It's surprising for me when they are no related, for example: Let's suppose I'd have two models, A and B. --&...
3
votes
1answer
440 views

Discriminator of a Conditional GAN with continuous labels

OK, let's say we have well-labeled images with non-discrete labels such as brightness or size or something and we want to generate images based on it. If it were done with a discrete label it could ...
0
votes
1answer
23 views

New client's future profits prediction

Problem: I want to evaluate the efficiency of new clients' acquisition. For that reason I want to be able to forecast the profit generated by client (in let's say 12 months from acquisition month) and ...
1
vote
2answers
58 views

How do I correctly build model on given data to predict target parameter?

I have some dataset which contains different paramteres and data.head() looks like this Applied some preprocessing and performed Feature ranking - ...
0
votes
2answers
81 views

Validation loss and validation accuracy stay the same in NN model

I am trying to train a keras NN regression model for music emotion prediction from audio features. (I am a beginner in NN and I am doing this as study project.) I have 193 features for training/...
0
votes
1answer
115 views

Decomposing R squared or VIF

In the context of multi-regression, I am wondering if there is a way to decompose $$VIF_i = 1/(1-R_i^2)$$ where $R_i^2$ is the r squared obtained from the regression of dependent variable = i and ...
2
votes
2answers
120 views

Regularization for intercept parameter

Why is the regularization parameter not applied to the intercept parameter? From what I have read about the cost functions for Linear and Logistic regression, the regularization parameter (λ) is ...
1
vote
1answer
570 views

Accuracy and Loss in MLP

I am trying to explore models for predicting whether a team will win or lose based on features about the team and their opponent. My training data is 15k samples with 760 numerical features. Each ...
0
votes
0answers
10 views

3D mesh input to regression

Is it possible to use 3D mesh data as the input for trained regression network? It's a common technique to animate a 3D character's face by combining weighted blendshapes such as smile, eyebrows ...
0
votes
1answer
8 views

Accessing regression coefficients when using MultiOutputRegressor

I am working on a multioutput (nr. targets: 2) regression task. The original data has a huge dimensionality (p>>n, i.e. there are far more predictors than ...
0
votes
1answer
21 views

How to use rule-based labelling intelligently?

I have a dataset like below The outcome column is labelled as positive if the % difference between target final Qty and ...
0
votes
4answers
113 views

How to resample

I have to deal with a small dataset. I thought that I maght take advantage of resamplin methods to enlarge the population and improve the performance of my regression algorithm. I heard about SMOTE, ...
1
vote
1answer
58 views

Time Series Continuous Classification

Intro I'm quite new to all the subjects in this question. This is my very first shot at Keras, Tensorflow, NNs or Time Series. If you're not a newbie, you'll notice that immediately. Problem I have ...
1
vote
1answer
244 views

Differentiable loss function for ranking problem in regression model

In regression problem, we may need a loss function to measure the relative ranking accuracy between targets $y$ and predicted values $y_{pred}$. Abviously, the simple MSE does not consider such ...
2
votes
1answer
79 views

How to get intuitive understanding which deep learning architecture suits for my problem

I'm working on a research problem where I need to perform classification for coarse prediction in a feature space and then fine grained regression for getting more precise values. I know that this way ...
0
votes
2answers
24 views

How to show prototype of output before building model

Currently in my work, we are working on a POC for a AI project. We intend to do a binary classification using traditional classification algorithms. However, my boss wants me to show a feel of the ...
0
votes
1answer
449 views

how to find holiday effect on revenue?

I have 2 datasets from 2013-2017 for each day. a) Revenue generated by Locations and date. b) Holiday name and date I would like to know how each holiday is impacting the revenue by location. I am ...
0
votes
1answer
18 views

How does Scikit learn KNN handle categorical input variables?

In some articles, it's said knn uses hamming distance for one-hot encoded categorical variables. Does the scikit learn implementation of knn follow the same way. Also are there any other ways to ...
0
votes
1answer
69 views

Trying to compress text with NLP

For a university project, I need to send text in Spanish via SMS. As these have a cost, I am trying to compress this text in an inefficient way. This consists of first generating a permutation of ...
1
vote
1answer
45 views

Meaningful predictive analytics for small (n=114) dataset with just 1 explanatory variable and 1 response variable?

I am given an Excel pivot table that aggregates data from a somewhat sizable data source (a database table with 1.9m records and another of about 490k). The data within the Excel file consists of 3 ...
4
votes
1answer
74 views

What ML architecture fits fixed length signal regression?

My problem is of regression type - How to estimate a fish weight using a fixed-length signal (80 data points) of the change in resistance when the fish swim through a gate with electrodes (basically 4 ...
0
votes
1answer
17 views

Estimate timeline for a ML Project

I am a novice data scientist and have been asked to provide an estimate for a data science project in our organization. From the problem stmt description, i am able to understand that it is a ...
0
votes
3answers
66 views

Feature selection for regression

Suppose I have a response variable y and and a set of feature variables (x1, x2 ... xn). I wish to find which of x1...xn are the ...
0
votes
2answers
30 views

Is there any point in having layers in a neural network for regression problems?

In my textbook I read that an MLP and linear activation functions for the hidden layers can be reduced to a simple input-output system, i.e. no hidden layers. This makes sense to me. Later on I read ...
2
votes
2answers
97 views

Confidence intervals in multivariate linear regression

I am fitting my data to a multivariate linear regression $Y = BX + \Xi$, where the response is bivariate $Y\in R^{n\times 2}$, and the predictor is uni-variate but elevated to the projective plane to ...
0
votes
1answer
19 views

How to Optimised my Regression model if my Target Variable is Right Skewed?

Recently i was working on a problem where my target variable is a continuous variable, with highly right skewed data. Please refer to image below If i want to create regression this please suggest ...
0
votes
1answer
65 views

Predicting products to be sold in a store - problem formulation

I have a data from a store for the products that sold since more than 5 years. Each sell process has a customer id, date, and the quantity of the product. I want to build a machine learning model to ...
3
votes
1answer
177 views

Is decision tree regression comparable to locally weighted regression

I am new to decision tree method. For decision tree regression model, does it just fit a piece wise step function over data? When and why would people prefer it over some traditional regression like ...
3
votes
1answer
884 views

Linear Regression on data with bimodal outcome

I have a data set with 3,000 features and continuous dependent variables of time with 18,000 instances. The histogram of the dependent variables show that the they have a bimodal distribution. I am ...
0
votes
2answers
18 views

How to convert String data to something more meaningful for regression model training

I have a bunch of data of employees and their salaries. I would like to build a regression model that predicts The columns in question are countries, employment_status, job_title, education All of ...
0
votes
1answer
43 views

How to improve regression neural network?

I am new to deep learning and data science and trying to increase my knowledge by working on some hackathons. Currently, the hackathon project I am working on has the task to predict the closing price ...
6
votes
1answer
275 views

When is the sum of models the model of the sum?

The response variable in a regression problem, $Y$, is modeled using a data matrix $X$. In notation, this means: $Y$ ~ $X$ However, $Y$ can be separated out into different components that can be ...
0
votes
0answers
11 views

How to estimate time interval with external time-dependent regressors?

I'm on a team that is tackling a project similar to the following. Suppose you want to estimate the age of a plant using a small set of tabular data features. In addition to the plant data, you have ...
5
votes
1answer
124 views

Predicting change of shapes/coordinates

I'm trying to find a way to predict/calculate how a shape (e.g. outline of a glacier) will change in the future—based on its history (previous shape) and additional factors (e.g. Δtemperature). In my ...
0
votes
1answer
236 views

Data Augmentation for Regression ANN with low Sample Size

There is a Dataset of 65 tuples. I want to Augment new Data from this set and validate my ANN on the original Data. Is there a possibility, that my ANN already overfits on the augmentet Data. For ...
0
votes
2answers
77 views

Sourcing (discounted) products customers want

Goal: Generate a list of 100 products per vertical (e.g. fashion, electronics) that the teams should source, discount, and list on the website over a specific period. You may assume all customers are ...
0
votes
1answer
31 views

Assign a risk score in records in a dataset

I was wondering, if I have a dataset with categorical and numerical data and labels such as 1 or 0 that shows if a row is anomalous or normal respectively. Is it possible to create somehow a model ...
0
votes
1answer
24 views

Recommended number of features for regression problem

In the following link the answer recommends a feauture amount of N/3 for regression (or it is quoted). Where N corresponds to the sample size: How many features to sample using Random Forests Is there ...
0
votes
1answer
28 views

Building a relevant predictive model [closed]

I have a dataset on Covid and diet: https://www.kaggle.com/mariaren/covid19-healthy-diet-dataset This dataset includes percentage of fat, food quantity, energy, protein intake from different types of ...
5
votes
1answer
70 views

Multi-target regression tree with additional constraint

I have a regression problem where I need to predict three dependent variables ($y$) based on a set of independent variables ($x$): $$ (y_1,y_2,y_3) = \beta_0 + \beta_1 x_1 + \beta_2 x_2 + \dots + \...
1
vote
1answer
76 views

Distribution of Regression Residuals: Is this a normal distribution?

I've created a histogram as well as a QQPlot from the residuals of my Regression Model: Mean: 0.35 Standard Deviation: 18.14 Judging from these plots, is it okay to say that my residuals are normally ...
0
votes
1answer
38 views

How to perform regression on image data using Tensorflow?

Overview I understand the surface of the mathematics* of simple neural networks. I went through single label image clasification problems (ie using MNIST & fashion-MNIST datasets) using native ...
1
vote
2answers
453 views

Loss function when the output is a single probability

I have a regression problem where the output y is a single probability, i.e. real number that varies in the interval [0, 1] ...

1
2 3 4 5
27