Questions tagged [predictive-modeling]

Statistical techniques used for predicting outcomes.

Filter by
Sorted by
Tagged with
2
votes
3answers
333 views

How to do Machine Learning the right way?

I have a basic understanding about Machine Learning in general. My question is how it is done in the practical applications of it. If I take the following definition of ML A computer program is ...
3
votes
1answer
147 views

Behaviour of Learning Algorithms on Random Data

Suppose we collect data for 100,000 tosses of a fair coin and record "Heads" or "Tails" as the value for the attribute outcome and also record the time, temprature and other irrelevant attributes. We ...
2
votes
1answer
122 views

Case when Out of Bag Error and Test error differs a lot in Random Forest

I'm using random forest and the out of bag error for the level of one class is very different to its test error. I'm working with a cutt-of equal to c(0.2,0.8). Here's the case: ...
2
votes
2answers
163 views

Dividing data between test, learn and predict

I was posting on stats.stackexchange but perhaps I should be posting here. Context. Subscription business that charges users a monthly fee for access to the service. Management would like to predict "...
4
votes
2answers
2k views

Equipment failure prediction

I have a system that manages equipments. When these equipments are faulty, they will be serviced. Imagine my dataset looks like this: ID Type # of times serviced ...
5
votes
1answer
152 views

Predictive models with class value belonging to a set of observations

I would like to know whether it's possible to build a predictive model where I could define a set of rows with their attributes, and a class belonging to that set of rows, instead of having the ...
3
votes
1answer
3k views

Propensity Modeling for Retail Marketing: Model Adjustments Based on Consumer Life Changes.

I built a predictive model using logistic regression for direct marking creatives. I built a “children’s” model which predicts buying behavior for those that purchase boys, girls and baby apparel. ...
0
votes
1answer
914 views

Machine Learning algorithm to predict an outcome where output is not known

I have a very unique problem that I would like to solve using machine learning. I have a set of 90 or so unique options. Each of these options has a unique set of features (5 to be specific) that vary ...
1
vote
1answer
217 views

How to start analysing and modelling data for an academic project, when not a statistician or data scientist

I have collected data for a PhD thesis, and need help understanding how to build a road map to do analytical and statistical analysis. The PhD is not itself in statistics or machine learning, but I ...
0
votes
2answers
2k views

How to make predictions based on correlations?

I have correlation values for profit based on three different attributes - attribute1,...
7
votes
2answers
7k views

How to use Cohen's Kappa as the evaluation metric in GridSearchCV in Scikit Learn?

I have class imbalance in the ratio 1:15 i.e. very low event rate. So to select tuning parameters of GBM in scikit learn I want to use Kappa instead of F1 score. My understanding is Kappa is a better ...
14
votes
3answers
40k views

How to predict probabilities in xgboost?

The below predict function is giving -ve values as well so it cannot be probabilities. ...
1
vote
0answers
168 views

Quantity Prediction Algorithm

I want to make prediction for quantity of stock that will be sufficient over a period of time i.e from one delivery to another. Assuming, i want a store to have minimum amount of item between ...
4
votes
2answers
109 views

Naive about which Naive Bayes in article

Working with the Naive Bayes spam filtering article on Wikipedia (https://en.wikipedia.org/wiki/Naive_Bayes_spam_filtering) Is it a binary multinomial equation or a Bernoulli form or some other? In ...
1
vote
1answer
498 views

Develop a “Credit Risk Scoring System” with R [closed]

I want to achieve during my internship a credit risk scoring system based on "credit german dataset". I develop a model with R using logistic regression and i validate it. Now i must use this model ...
3
votes
1answer
99 views

Advise on making predictions given collection of dimensions and corresponding probabilities

I am a CS graduate but am very new to data science. I could use some expert advise/insight on a problem I am trying to solve. I've been through the titanic tutorial on gaggle.com which I think was ...
6
votes
3answers
489 views

Data driven approach to define a churn user

I'm trying to define a churn prediction model for an online service (betting/gambling). A lot of papers talk about churn analysis/prediction for telco companies where defining a churn user is ...
3
votes
4answers
1k views

Custom trained model in Azure ML

I have a predictive model which I trained on a training set. I have written it in R. Now I want to deploy it as a web service so anyone can just input the data into it and get the output from the ...
2
votes
0answers
102 views

Techniques for dealing with unevenly spaced time series data that have missing time-stamps?

What are the techniques to infer missing time-stamps in the unevenly spaced time series data that has missing time-stamps? The frequency of data recording is about 1-3 times a day without any fixed ...
1
vote
0answers
373 views

Errror in confusionMatrix in R

While i am using the confusionMatrix in R, I am getting the following error: Error in binom.test(sum(diag(x)), sum(x)) : 'n' ...
2
votes
1answer
510 views

Modules on Python which are useful for missing Word/Letter prediction in text paragraphs from a coprpus

Can someone please recommend me some Python packages which I can use for missing word prediction in a paragraph of text. The missing words are a part of existing semantic list of words.( List of ...
8
votes
1answer
5k views

R - Interpreting neural networks plot

I know there are similar question on stats.SE, but I didn't find one that fulfills my request; please, before mark the question as a duplicate, ping me in the comment. I run a neural network based on ...
11
votes
4answers
16k views

How to avoid overfitting in random forest?

I want to avoid overfitting in random forest. In this regard, I intend to use mtry, nodesize, and maxnodes etc. Could you please help me choose values for these parameters? I am using R. Also, if ...
0
votes
1answer
3k views

What are the performance measures in the neural networks field?

I constructed a neural networks in R using neuralnet package. I want to test that using cross-validation, that is a technique based on using 4/5 of the dataset to ...
3
votes
2answers
305 views

Denormalise data in Neural Networks

I wrote a Neural Networks prediction model in Python. My data has a few inputs and two outputs. In order to make it work, I have to normalise every column on data for good prediction results. ...
3
votes
1answer
42 views

How to fit an odd relationship with a function?

Let's say there is a function $f$ such that $y = f(x)$. However, if $f$ is a piecewise function such that: $$y = \begin{cases} 0 \quad x \leq 0 \\ 1 \quad x >0\end{cases} $$ How do I fit $f$ in ...
1
vote
1answer
1k views

Create a prediction formula from data input

I have an algorithm which have as an input about 20-25 numbers. Then in every step it uses some of these numbers with a random function to calculate the local result which will lead to the final ...
1
vote
0answers
65 views

Do I need to apply a Ranking Algorithm for this?

I have data of the form : ...
1
vote
1answer
57 views

What techniques are used to understand call patterns?

I have customer data since 2013 and there is a file which has the customer unique id, a timestamp, and the reason for the call (a drop down from the person who handled the call). I did some ...
2
votes
1answer
933 views

Analyzing survey data for predictions

I've got survey data that resembles: ...
3
votes
1answer
68 views

Predicting earthquakes using disturbances in DTH TV transmission

It is said that before an earthquake happens, a viewer experiences disturbances in DTH TV transmission in the form of distorted images on the screen which automatically correct after a few seconds. ...
3
votes
2answers
469 views

Using clustering and Lasso with cv

I used clustering on my dataset. Now when I'm trying to use a LASSO with cv to predict a response, one of the variables it takes into consideration is which cluster a new point is classified into.(I ...
1
vote
1answer
42 views

What algorithmic approach for selecting similar, relevancy based documents

I have an application that tracks people making mentions of various topics. We've used a Bayes algorithm to do some simple classification (users give a thumbs up/thumbs down) to pick the people that ...
1
vote
1answer
828 views

Predictive Model for Customer Payment Pattern

I am working for a logistics firm and there are approx. 750+ customers who avail our services. I am in the process of building and generating some insight for the business based on the payments made ...
0
votes
1answer
502 views

Best way to format data for supervised machine learning ranking predictions

I'm fairly new to machine learning, but I'm doing my best to learn as much as possible. I am curious about how predicting athlete performance (runners in particular) in a race of a specific starting ...
0
votes
1answer
3k views

Forecasting sales and creating model [closed]

In a assignment we are given macro economic indicators like GDP, Consumer price index, Producer Price index and Industrial production index. Also we are given Crude oil, Sugar prices and FM-CG Sales. ...
4
votes
3answers
1k views

Predicting Soccer: guessing which matches a model will predict correctly

I took on a project to predict the outcome of soccer matches but it turned out to be a very challenging task. I tried out different models but I only got 50-54% accuracy on my test dataset. Some of ...
1
vote
1answer
509 views

Combining data sets without using row.name

I start with a data.frame (or a data_frame) containing my dependent Y variable for analysis, my independent X variables, and some "Z" variables -- extra columns that I don't need for my modeling ...
3
votes
2answers
1k views

R in production

Many of us are very familiar with using R in reproducible, but very much targeted, ad-hoc analysis. Given that R is currently the best collection of cutting-edge scientific methods from world-class ...
0
votes
1answer
259 views

Interested in Mathematical Statistics… where to start from?

I have been working in the last years with statistics and have gone pretty deep in programming with R. I have however always felt that I wasn't completely grasping what I was doing, still ...
1
vote
1answer
120 views

problem of choosing right statistical method for scheduler prediction

I am struggling to choose a right data prediction method for the following problem. Essentially I am trying to model a scheduler operation, trying to predict its scheduling without knowing the ...
1
vote
2answers
537 views

How to start the process of coming up with the predicted math score?

I am working on a problem(non competition) from hacker rank https://www.hackerrank.com/challenges/predict-missing-grade Basically you're given test data of a bunch of students of their scores in ...
4
votes
3answers
635 views

machine learning on athlete performances to predict the time in a future race

Example Data I have a dataset (in R as a data frame) of race results for athletes. ...
-1
votes
4answers
196 views

Format of CSV file

I'am trying to create a regression based prediction (like booking website): predict the number of clicks for each hotel. I have to generate a .csv file containing two columns: ...
4
votes
1answer
510 views

Rank players of any given sport

I've recently become interested in possibly of developing some sort of method for ranking athletes of sports such as American football and determining which players are better than others in terms of ...
2
votes
2answers
150 views

Could someone please offer me some guidance on some kind of particular, SPECIFIC project that I could attemp, to “get my feet wet, so to speak” [closed]

I am COMPLETELY new to the field of Data Science, mainly because every employer I have worked for, simply COULDN'T sell any customers anything that would use techniques learned in this field. Of ...
2
votes
1answer
211 views

Which Graph Properties are Useful for Predictive Analytics?

Let's assume I'm building a content recommendation engine for online content. I have web log data which I can import into a graph, containing a user ID, the page they viewed, and a timestamp for when ...
1
vote
2answers
164 views

Time series: variations as a feature

I am trying to predict clients comportement from market rates. The value of the products depends on the actual rate but this is not enough. The comportement of the client also depends on their ...
2
votes
1answer
1k views

predict with Multinomial Logistic Regression

If I execute the following code I have no problem: ...
1
vote
1answer
128 views

Web Framework Built for Recommendations

I'm wondering if there is a web framework well suited for placing recommendations on content. In most cases, a data scientist goes through after the fact and builds (or uses) a completely different ...