Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

1
vote
1answer
22 views

Multiclass Regression for density prediction

This is my first question in the DS-community, so I'm happily willing to accept any kind of (meta-) advice :). I have time-series data for a set of users (~100), ...
2
votes
1answer
61 views

Training with a subset of data: relationship between subset size and training metric?

I have a not-quite linear regression problem which I am investigating. The data set is fairly large, with ~6000 samples and ~2100 features. By performing 5-fold cross-validation on different sized ...
0
votes
0answers
25 views

Inferring latent variable distribution from binary data

I want to create a model to infer the behavior of a latent variable. As an example, let's assume the latent variable represents the level of extro/introversion of a person. The level of extro/...
0
votes
1answer
22 views

How to interpretate multiple histograms corresponding to each feature in multiple linear regression for relationship?

Used matplotlib to plot the histograms for each feature in Boston dataset available in scikitlearn library. How to interpretate the histograms to determine the correlation or significance of that ...
0
votes
0answers
17 views

Question on X_train data formatting

I want to train a model to approximate the probability of an event between two objects based on previous occurrences. My input training data are the parameters (six in total) of the pairs that have ...
2
votes
2answers
52 views

Similarity score: Can Sklearn SVR predict values greater than 1 and less than 0?

I am using svm.SVR() from scikit-learn to apply Logistic Regression on my training data to solve a similarity problem. Using GridSearchCV, I am finding the best ...
1
vote
0answers
13 views

Slowly decreasing validation / training cost and their abnormal values

I have a dataset of size ~100,000 of images, I'm training a CNN model on them for regression. optimizer: Adam batch_size: 64 Number of epochs: 50 When I set the ...
0
votes
0answers
33 views

Beginner's question

I am a beginner in ML, and I have data that look like a "cross" shape as follow: It seems 2 regression lines are overlapped Would you have any ideas for how to fit or predict y axis with x axis ?
-2
votes
1answer
18 views

Which function should I use for a nonlinear regression in panel data in R?

I have a data set with different years, so it is panel data. I know what features I should use in my model for a nonlinear regression. I already used the nls()...
0
votes
1answer
27 views

What Regresson Algorithm Would Fit This Data?

I am using regression on lottery numbers, below is the head of my database. I was wondering if anyone had a suggestions on what the best algorithm would be to use for the regression model. ...
0
votes
0answers
19 views

Help with Tensorflow 2.0 beta not learning

Have a tabular data set and have done some graphical exploration with Orange 3. Attempted NN regression with Keras/TensorFlow 2.0 beta on Python 3.6.7. The problem is that TF 2.0 is not "learning" (...
2
votes
2answers
48 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
0
votes
2answers
39 views

Correlation feature selection followed by regression

I have quarterly results data for a company with around 100 variables. Total 60 quarters results are available (total records 60). sample data: (only few columns & 10 rows) I would like know ...
1
vote
2answers
50 views

How to find the right regression model for my project

I tried several things to find the best regression model with the best parameters but i can't go higher than 40% right predictions. So i have 67741 rows in an excel file. the data looks like this ...
0
votes
2answers
25 views

Is there any time series model which handles data at variable frequencies.?

Goal: Predict the yellow points.(yellow events appear at varying frequencies) But I'm struggling to find a good model to fit this use case. Most of the time series algorithms are handling data which ...
0
votes
1answer
30 views

What are good practices in reporting RMSE or MAPE estimates for a machine learning model?

I have built a regression model to estimate prices given some attributes. Prices are expressed in million USD, with average of 4.4 million USD. I need to provide an estimate of the RMSE and MAPE of ...
0
votes
0answers
17 views

Build model to get daily probability of meeting a certain end of period goal

I was hoping for some consultation and direction with how to go about the following: To give context, I work for an agency that manages advertisements on social media for general motors - ...
0
votes
1answer
28 views

What does it mean when an Actual vs Predicted plot is like this assuming you are using the best model?

I'm trying to predict the monetary value in a fixed time-frame for a project. I wanted to start with a baseline model before doing any feature engineering or advanced pre-processing. I'm using a feed-...
3
votes
2answers
21 views

Weighted Sum with restricted weights

Given a value $y$ and some values $x_1, ..., x_n$. How do I find weights $w_1, ... w_n$ so that the $error = y - w_1*x_1 + ... w_n*x_n$ is minimal, where the weights have to sum up to 1 or a different ...
1
vote
1answer
15 views

Data Structure For Multilevel Analysis

I am little confused about how to structure my specific data for multilevel analysis. I have 10 categories and each category has some items in them. The dataset is available for 117 weeks. There is ...
2
votes
1answer
27 views

Multiclass classification with high number of classes, high number of features and small sample size

I am working on a biology related dataset with over 300K features, and I only have about 5K samples. I want my model to classify many classes. For this problem in particular the class is age. Each age ...
3
votes
2answers
45 views

Seeking advice on knowledge discovery

Background Information I work for a fire department in Florida and the fire chief posed a question to me; At any given moment in time during the calendar year 2018, how many fire trucks are busy, ...
0
votes
0answers
23 views

Python: OneVsRestClassifier results in incorrect hyperplanes with images (linear classification)

Using the OneVsRestClassifier leads to two hyperplanes which have a huge y-axis distance to the actual min. y-value of the data points (somewhere in the area of -300 while the y-minimum is around -1). ...
0
votes
1answer
43 views

ValueError: Expected 2D array, got scalar array instead using predict method

I am trying to get a predicted value instead of whole features for a particular level using predict method. ...
2
votes
1answer
49 views

Survival regression with major event that won't happen

I would like to do some survival regression about the duration before the "death" of an individual. The final purpose is to know, given an individual, how long it should take before he'll most likely "...
1
vote
0answers
22 views

coefficients from decision regression tree

I have a data on which I apply decision regression tree since it gives better numerical values as predicting house prices. I have almost 45 features in which price is the target value. With linear ...
1
vote
1answer
24 views

Both train and test scores high. Could my model be overfitting?

all. Currently I am working in a regressor to predict the median house value using 1990 census as a dataset (the same on Aurélien Géron used on his book). My best result so far has been a score of ~0....
0
votes
2answers
33 views

Reducing MAE or RMSE of linear regression

I'm trying to guess a home price, at final I intend to figure out a formula by using linear regression. As you can see over the url, I have 1480 data with 45 features in which ...
1
vote
2answers
56 views

How to import statsmodels module to use OLS class?

I am trying multiple Regression ...
2
votes
1answer
33 views

Transfer learning for a regression problem

if my understanding is correct, in case of image classification and NLP, if I have a pre-trained model, to train on new data, I can reshape the data according to the pre-trained model. So there is no ...
1
vote
1answer
42 views

After plotting my predicted values against the true label values, I didnt quite get the answer I was looking for

I downloaded data on wine quality and tried to run a regression model to predict the quality, However I did not receive the plot I was expecting. The mean absolute error for the wine quality was ...
1
vote
1answer
18 views

How to adjust the Regression with ANN for last part of function

The Blue dots represent the required function and the Black ones represent the predicted function I am using keras with the following code:- ...
0
votes
0answers
17 views

Coding type affects the fit of a mixed model in R

I'm running a mixed effects model in R, using the lme4 package. The model I'm running is this: ...
0
votes
0answers
9 views

Logistic Regression Perfect segregation issue

Is it possible that a combination of independent variables are showing a perfect segregation in a binary logistic regression. As I am getting the warning: glm.fit: fitted probabilities numerically 0 ...
0
votes
0answers
15 views

Best technique for testing if an event causes a trend?

Example - A major holiday is coming up and the frequency of a product being purchased starts increasing significantly as it gets closer to the day of the holiday. Then after the holiday, the frequency ...
0
votes
2answers
48 views

Can this problem be solved using deep learning?

I want to predict price of used cars. I have data like this: Is this problem suitable for deeplearning or Should I use XGBOOST, RandomForest etc.? I used one hot approach for nominal features and ...
0
votes
1answer
33 views

Neural network or other algorithms?

I have a regression problem, with a million rows or so, around 10-15 features. What should work better on that particular setting? Neural network or regular regressors?
0
votes
0answers
30 views

How do I avoid time leakage in my KNN model?

I am building a KNN model to predict housing prices. I'll go through my data and my model and then my problem. Data - ...
0
votes
2answers
28 views

What are some good machine learning techniques for developing rules that govern changes in data?

Say I read a set of data in and it looks like so: [ 1, 2, 3, 4, 5 ] Now, there's an unknown rule set by my data's source that says if the 3rd element in my list ...
1
vote
2answers
187 views

Neural network for linear regression?

In this example: https://www.tensorflow.org/tutorials/keras/basic_regression I was surprised to see a neural network's predicted values graph as a straight line. Isn't the purpose of neural networks ...
1
vote
1answer
46 views

Any non Deep Learning python packages for sequence classification.?

Stats model or any other machine learning python packages for doing sequence classification(that can be multi class) and sequence prediction (Both next step and regression). PS : Input data will be ...
0
votes
1answer
25 views

Regression vs Classification to rank by profit

Say that I have a population of 10k customers, for which I expect 100 responders in my next campaign and have budget to send a letter to 5k. I have past data of how much those who respond spent, and ...
0
votes
0answers
6 views

What is the method to track Lift values over time when using logistic regression?

I have a series of monthly surveys asking for services perception and I can use logistic regression to build a model every month to predict the probabilities and the associated lift. My question is: ...
2
votes
0answers
31 views

When is the sum of models the model of the sum?

The response variable in a regression problem, $Y$, is modeled using a data matrix $X$. In notation, this means: $Y$ ~ $X$ However, $Y$ can be separated out into different components that can be ...
0
votes
1answer
20 views

Statistical significance test in deep learning for regression problems

I was reading the tutorial "Statistical Significance Test for comparing ML algorithms", where it suggests to use k-fold and apply the appropriate statistical test. Suppose that I have a train set and ...
3
votes
2answers
57 views

Linear Regression

I'm starting to learn machine learning and one of the first things that is mentioned is the usage of a linear regression method. Basically, we have a bunch of data points and we want to fit a line ...
2
votes
1answer
40 views

Logistic Regression - Coefficients have p-value more than alpha(0.05)

I am very new to the machine learning field and have been practicing logistic regression on few sample data sets. I have built a Model using the logistic regression algorithm. Few of the coefficients ...
3
votes
1answer
53 views

statsmodels ols does not include all categorical values

I am doing an ordinary least squares regression (in python with statsmodels) using a categorical variable as a predictor. There are 5 values that the categorical variable can have. However, after ...
1
vote
1answer
27 views

Impact calculation- Regression

I am dealing with the below data: \begin{array} {|c|c|}\hline \text{user} & \text{A_PDE} & \text{B_PDE} & \text{C_PDE} & \text{D_PDE} & \text{Sales} & y_\text{pred} & \text{...
0
votes
0answers
5 views

Balanced sampling of a dataset on 2 or more regression targets

I'm given a dataset with 2 regression labels, $y_1$ and $y_2$ in the range $[0, 1]$. My goal is to sample from this dataset such that I come as close as possible to a uniform distribution for both $...