Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [predictive-modeling]

Statistical techniques used for predicting outcomes.

1
vote
0answers
10 views

Forecasting/predicting techniques for qualitative data?

I have a food alert dataset composed of nominal qualitative variables, such as type of alert, country of origin, action taken, etc. as well as the date on which the alert was recorded. What ...
1
vote
1answer
9 views

How to predict unknown(hidden) value by incomplete value or partly recorded value

Let me make it clear by make an example: Suppose I knew a person's cost each month for 3 years like: 2016Jan : $2500 2016Feb : $4000 2016Mar : $3500 ... Just according to this, can I ...
0
votes
1answer
20 views

Finding interaction

How do you find the interaction between a continuous and a categorical variable? I have tried using ggPredict but it doesn't seem to work if there are more levels. ...
3
votes
2answers
32 views
0
votes
0answers
4 views

Website Lead prediction with Amazon ML [on hold]

I am experimenting with Amazon ML and would like to predict if some user on my website will execute a lead (form subscription for info material). I am new in the ML world and would like to hear from ...
-1
votes
0answers
18 views

Logistic Regression with Non-Integer feature value

Hi I was following the Machine Learning course by Andrew Ng. I found that in regression problems, specially logistic regression they have used integer values for the features which could be plotted in ...
0
votes
1answer
37 views

What could be a dataset in which the presence of an outlier dramatically affects the performance of Ordinary Least Squares (OLS) regression?

I am tasked with giving an example of a dataset in which the presence of an outlier dramatically affects the performance of Ordinary Least Squares (OLS) regression. I've searched and searched the web ...
0
votes
0answers
10 views

NEURAL NETWORK MODELLING OF WIND ENERGY PROFILE [closed]

I am currently carrying out a research work on the above subject using MLP NN using SPSS. I am not a guru with NN but trying my best to understand and interpret the output of my analysis. My ...
0
votes
0answers
5 views

Which Keras model, if any, is best for this unusual (K,N)-multinomial predictive task?

Say I have a bunch of images that were classified by $N$ people. Each person classified each image into one of $K$ categories. For each image, the votes for each category are then summed up. As a ...
0
votes
0answers
7 views

Why is my regression predictions values variance different from real values variance

I am modeling a physical process using a regression(XGBoost). I'm looking for ways improving my model, have tried different things without success. Decided to get a better intuition on where my model ...
0
votes
1answer
23 views

Prediction: plugin a corelation table (neuron) into a Time-Series Neuron in Keras/ TF

i am adding more details I have a time series of Babies (1,2,3) showing how many problem they have each week (Born week 1 to week 80) and in which organ (14 organ). There is a separate numeric time-...
1
vote
0answers
13 views

Is linear regression on the trees of XGBoost (rather than taking their mean) useful/popular?

Given training data $(\underline{x}_1, y_1),...,(\underline{x_N}, y_N)$, one can choose a variety of ensemble method for trees. These algorithms output a set of trees $T_1, ..., T_n$, and then the ...
1
vote
0answers
30 views

Why does balancing the test dataset improve precision-recall curve?

I have a fairly imbalanced dataset for default-risk credit scoring (2:98). Both costs are fairly important i.e False negative means loss from default and false positive is a lost-revenue opportunity. ...
-1
votes
0answers
10 views

Training a RNN, Sequence to Sequence VS Sequence to One?

I would like my RNN to be able to be able to predict wether the person is likely to make a purchase based on website visits. Let's assume that I have data for a user in the following format: ...
0
votes
1answer
24 views

Can Precision-Recall be improved for imbalanced sample?

I tried out a few models on a highly imbalanced sample (~2:100) where I can get decent AUC from ROC (test sample). But when I plot precision-recall (test sample), it looks horrible. Kind of like the ...
0
votes
0answers
14 views

Good model for rating sets of items in a gift basket?

I'm working on a model to score a set of items that make up a gift basket; typically these are unordered sets of 1-3 items such as {cheese, wine-bottle, crackers}, <...
0
votes
0answers
12 views

using regression model to optimize teams working on work items

I have a few work items with these features: WI1, WI2, WI3 which describe these work items. I also know the number of people and how many minutes they spend each ...
1
vote
0answers
23 views

Test predictive power of classes in multiclass classification

How can we confidently identify if the data has lower predictive power. I saw that the classifiers are giving poor accuracy (< 50%) on test data and approx 97% on train data. Correlation of a class ...
0
votes
0answers
14 views

Distribution of Features

I am using a dataset. The aim is to predict the average monthly loss to the company. With feature enginnering I have introduced a feature loss using workload(given per day) and the absence (given per ...
1
vote
2answers
30 views

When creating a classification model, should predictors with little correlation to the response variable be included in the model?

I am building a predictive model designed to predict attrition within my organization. I am trying to decide whether to add certain predictors to my model. I used a Kruskal-Wallis rank sum test to ...
-1
votes
0answers
13 views

Can common Neural Network be used for timeseries prediction?

i want to make multivariate time series prediction (classification) i want to use sklearn , but there is no RNN in sklearn. Can normal Neural Network used to do multivariate time series prediction ? ...
0
votes
0answers
11 views

How to get count “Number of people” gathered for a public event through social networking sites

I am currently working on a sales forecast prediction modeling. As part of it I need to find out an approximate count of people gathered for a public gathering based on "Date" and "Zipcode" or "Lat,...
1
vote
1answer
23 views

Predict the corresponding value in one column using a list of values found in another column

Please have a look at this link. This was a question I asked few months back and after some suggestions and exploring I was able to successfully use TFIDF along with MultinomialNB classifier to pretty ...
0
votes
0answers
9 views

Interface with wireless WIFI monitoring device

Will Orange collect and store data received from a remote WIFI connected monitoring device permitting subsequent analysis? The monitor will be gathering performance data on electric equipment.
0
votes
0answers
17 views

Feature selection, hyperparameters tuning and model test with Cross Validation

I don't know if this is a valid question, but I am not finding any documentation or explanation anywhere and I have a doubt. I have a dataset - 100 samples, 50 variables, 3 response variables (1 ...
1
vote
2answers
34 views

How to visualize Ensemble Models ( Random Forest) with 1000 estimators

I am working on classification problem where I need to categorize the user in buy/ non-buy category. I have around 100 + features or predictors to predict the behavior of user. I tried to implement ...
0
votes
1answer
47 views

how to build a predictive model without training data neither historical data

I m trying to score "how much a product is expected in the market". I created some features: How much this product is used each year. Where was it used . how many product for each country. the main ...
0
votes
1answer
55 views

Exploratory Data Analysis

I am working on this dataset. Dataset has missing values. What would be the best method to impute the missing values. Also values are missing from target feature as well. So far I have dropped those ...
1
vote
0answers
32 views

Improving population weighting

Bit of a noob in this stats world, so apologies in advance for any naiveté. I did a fair bit of stats long ago in college but it's a distant memory, so please assume little knowledge! The dataset I'...
1
vote
1answer
51 views

Probabilistic Outlier Detection (edited + clarified)

Measured data $D \in \mathbb{R}^3$, every $d^i \in D$ is $d^i_{(x)}$, where the $x=[x_1, x_2]$. Simply said, the measured data are function of $x$. It is known, the dependency is linear, such as: $$...
0
votes
1answer
88 views

Keras Conv1D for simple data target prediction

I am trying to use conv1D layer from Keras for predicting Species in iris dataset (which has 4 numeric features and one categorical target). Following is my code: ...
1
vote
1answer
34 views

What methods can be used to detect duplicacy in image dataset?

I want to remove duplicate images from a dataset of 50Million images. What is the best method to detect all the duplicates? Do you think one shot learning is good for this?
0
votes
0answers
29 views

predict() xgboost model with weights

I am working on a xgboost model with a weight. ...
0
votes
1answer
31 views

Running multiple random forest and combining them

I am trying to build a random forest model in R (RStudio). My training dataset has around 2 million rows and 38 variables. When I tested 5000 rows from this dataset I was able to build the random ...
1
vote
1answer
18 views

Algorithm Suggestions for a Self Project [closed]

So, I am doing a small self project on data analytics. I am collecting the android apps data from the play store sites by web scraping. I am basically trying to collect all possible information ...
1
vote
1answer
14 views

Fully endogenous models for predicting multivariate time series

I have a formal social science background but I am new to data science. My interest is in building predictive models for applications in the social sciences, mostly (but not only) in economics. I am ...
1
vote
0answers
8 views

How can cognitive neuroscience enhance machine learning?

There have been many recent papers on using cognitive neuroscience as inspiration for the improvement of machine learning. For example, Hassabis et al. (2017) have written an article on ...
0
votes
0answers
48 views

Best approach to predict best time to call for call center log data?

Doing all the below things in R, I have a call logs data of a call center. variables are "date_time" , "callerID" , "Phone_number" , "call_duration". date_time is of POSIXct type , i have extracted ...
2
votes
1answer
28 views

How to create user and item profile in an item to item collaborative filtering? (Non-rating case)

I want to build a recommender system for a coupons website which should do the following: Given the past purchase behaviour of a user, recommend coupons which the user is likely to buy. The data does ...
1
vote
0answers
16 views

Decision tree to get difference in rates in two groups?

I have two sample groups of customers, each customer has 100s of features. For a single sample, i would use Decision Trees to find sub-groups that have a high churn rate. Thats easy. However, my ...
0
votes
1answer
18 views

Higher frequency of time series benefits

We are setting up an experiment for a model that is able to predict the evolution of a time series in different horizons. One of the parameters to decide is the granularity of frequency of our samples ...
2
votes
2answers
37 views

Which recommender system: Content based or Collaborative filtering?

I want to build a recommender system for a coupons website which should do the following: Given the past purchase behaviour of a user, recommend coupons which the user is likely to buy. The data does ...
1
vote
0answers
10 views

Classification on time series items - choose not constant threshold

I'm dealing with a classification problem on a time series {time: t, value: y(t)} where, for each time t, my classification algorithm gives as ouput the probability that the y(t) belongs to class 0 or ...
1
vote
0answers
21 views

one predictive methods

Is there any algorithm/method/system/application that combine all predictive methods into one? so for users instead of deciding which method they should use, is there any platform that you just feed ...
1
vote
1answer
21 views

Which model may be best for outcome of a surgery?

New to data science and am trying to be a self-starter and implement advanced data analytics in my subspecialty of surgery. Below is a description of my data set. I know that I will have to explore ...
2
votes
1answer
18 views

Predicting t+1 from a set of sequences

Say I have have an experiment where I release a single rat into a maze and wait for it to reach the end. Say I also track this rat's position in the maze at various times. Let's do this $n$ times. Now,...
1
vote
1answer
48 views

Timestamps in Ridge Regression Scikit Learn

I am trying to transform data for use in regression, most likely the Ridge or Lasso technique implemented in sklearn.linear_model. My training data contains time ...
0
votes
0answers
18 views

Model validation in flexible parametric survival analysis: any special package or code in R or stata?

I am doing medical prediction research. I used to use logistic regression and Cox regression and I found my R or stata package to do model validation e.g. rms in R (validate function with bootstrap ...
1
vote
1answer
24 views

multi-targets predict using python

let's say I have year month data h1 h2 h3 .. h24 2004 1 1 40 42 60 .. : : : 2008 12 31 I am trying to predict h1....h24 for a ...
1
vote
0answers
15 views

Having the target and data row - how to find the correct model

I am coming from a web developer background, and having no data science background. I am looking to skill-up and get some answers for a current task: find a model that returns a predicted value same ...