Questions tagged [prediction]

The tag has no usage guidance.

57
votes
5answers
33k views

Time series prediction using ARIMA vs LSTM

The problem that I am dealing with is predicting time series values. I am looking at one time series at a time and based on for example 15% of the input data, I would like to predict its future values....
11
votes
2answers
3k views

Is a 100% model accuracy on out-of-sample data overfitting?

I have just completed the machine learning for R course on cognitiveclass.ai and have begun experimenting with randomforests. I have made a model by using the "randomForest" library in R. The model ...
11
votes
1answer
7k views

How to Predict the future values of time horizon with Keras?

I just built this LSTM neural network with Keras ...
10
votes
4answers
6k views

Prediction interval around LSTM time series forecast

Is there a method to calculate the prediction interval (probability distribution) around a time series forecast from an LSTM (or other recurrent) neural network? Say, for example, I am predicting 10 ...
5
votes
3answers
386 views

Why can't my neural network learn how to predict the squares of natural numbers?

I want my neural network to learn to predict the square $n+1$ number having $n$ number. I am considering a regression problem. That's what I'm doing: ...
5
votes
1answer
1k views

how to interpret predictions from model?

I'm working on a multi-classification problem - Recognizing flowers. I trained the mode and I achieved accuracy of 0.99. To predict, I did: ...
5
votes
1answer
69 views

Make classification and prediction at the same time

I am working on the detection and prediction of epileptic seizures and I was thinking about something : would it be possible to apply classification and prediction at the same time. I mean, having ...
5
votes
2answers
5k views

Using RNN (LSTM) for predicting one future value of a time series

I have been reading several papers, articles and blog posts about RNNs (LSTM specifically) and how we can use them to do time series prediction. In almost all examples and codes I have found, the ...
5
votes
1answer
1k views

Batching in Recurrent Neural Networks (RNNs) when there is only a single instance per time step?

I have scoured the internet and books, but everything seems to use num_steps and batch_size or similar terms interchangeably and ...
5
votes
2answers
4k views

Why is input preprocessing in VGG16 in Keras not 1/255.0

I am just trying to use pre-trained vgg16 to make prediction in Keras like this. ...
5
votes
3answers
58 views

Which algorithm to use for efficient resource assignment?

I am a starter in ML. So pardon me if the question is naive. We have a Project Management tool where users can create a ticket and assign it to others. This is just one part of the tool but we are ...
5
votes
1answer
64 views

Theoretical background for model arhitecture choosing

Suppose I have a dataset $X$ and two different binary labels $y_{1}$ and $y_{2}$. The classes are very imbalanced - 3% of true in $y_{1}$ and 2% in $y_{2}$. Moreover, there are no pairs of (0,1), so, ...
4
votes
1answer
507 views

What do “compile” , “fit” and “predict” do in Keras sequential models?

I am a little confused between these two parts of Keras sequential models functions. May someone explains what is exactly the job of each one? I mean ...
4
votes
2answers
3k views

Prediction Intervals Using XGBoost

I want to obtain the prediction intervals of my xgboost model which I am using to solve a regression problem. I am using the python code shared on this blog, and not really understanding how the ...
3
votes
2answers
8k views

Sales prediction of an Item

So, I've been trying to implement my first algorithm to predict the (sales/month) of a single product, I've been using linear regression since that was what were recommended to me. I'm using data ...
3
votes
3answers
45 views
3
votes
2answers
160 views

Sports prediction using machine learning [closed]

I am trying to predict soccer scores using past results. The dataset I have only consists of the home team, the away team, goals scored by the home team and goals scored by the away team in each match....
3
votes
1answer
315 views

How to properly predict date using Orange 3

First of all - I'm new to all of this. I'm trying to create a model to predict the release of ios 12 based on previous years. I've got an excel that has a format like this: ...
3
votes
1answer
3k views

Simple prediction with Keras

I want to make simple predictions with Keras and I'm not really sure if I am doing it right. My data looks like this: ...
3
votes
1answer
59 views

Use Machine Learning/Artificial Intelligence to predict next number (n+1) in a given sequence of random increasing integers

The AI must predict the next number in a given sequence of incremental integers (with no obvious pattern) using Python but so far I don't get the intended result! I tried changing the learning rate ...
3
votes
1answer
102 views

How can i find trend time for my articles?

our article is time-based, that means is my article search more in a specific time. as you can see in under chart this article search more in specific period time. if my dataset looks like this(it ...
3
votes
1answer
848 views

Time series prediction of discontinuous data

In the context of time series prediction, I have read that time series is a series of data that taken at successive equally spaced points in time (which means its in order). What if I have a ...
3
votes
3answers
2k views

tsne for prediction

I have a traditional prediction setting, with a training data set train and a test data set test. I do not know the outcome <...
3
votes
1answer
57 views

How to prevent a neural network from outputing too clustered probabilities?

I have a CNN outputting probabilities using a logistic output. The performances are good on the test set. Yet the probabilities it outputs are very clustered, they are either 0 or 1! I would like ...
3
votes
0answers
37 views

Timeseries prediction error measurement. How to deal with diffrent time scales?

I have some time series and a prediction model. Now I would like to measure how good/bad the prediction is for different products. The problem is that for each product the time points (frequency of ...
3
votes
0answers
104 views

Why does CV yield lower score?

My training accuracy was better than my test accuracy, hence I thought my model was over-fitted and tried Cross-validation. The model further degraded. Is that my input data need to be sanitised ...
2
votes
2answers
674 views

Very low probability in naive Bayes classifier

I have designed NB classifier from scratch in python for binary classification problem. There are total 220 records out of which 85 records belongs to 'Yes' class and 135 to 'No' class. My classifier ...
2
votes
2answers
242 views

Recognize and predict a periodic pattern

I need to design a controller that tries to collect as much falling objects (raindrops) from an unknown source. Beneficial to solving the problem could be the recognition of the seemingly random ...
2
votes
2answers
101 views

What are possible approaches to deal with unseparable data even after PCA?

Greetings data scientists, I am dealing with a complex classification/prediction problem and I am finding very difficult to separate the classes at all. Even after PCA, my data (over the two PCs), ...
2
votes
1answer
105 views

How to predict next year's gross revenue given this year's data?

I have the following dataset (.csv format) which contains: 100 columns: $\textbf{Period}$ (in years, e.g. 2017, 2018, ..., 2028), $\textbf{Gross Revenue}$, $\textbf{Region}$ (e.g. APAC, NEMEA, etc), ...
2
votes
2answers
306 views

LSTM predicting expected value and standard deviation with one-hot encoding

I am implementing LSTM to a time series prediction which requires predicting both the expected value (i.e. the mean of the prediction), and the standard deviation (i.e. the interval that the future ...
2
votes
1answer
1k views

Splitting hold-out sample and training sample only once?

I have a question related to evaluating out-of-sample predictions. For my research I want to tune two parameters related to Support Vector Machines, and use these optimized parameters to predict the ...
2
votes
1answer
61 views

Incorporate luck in statistical modelling

I was wondering if it is possible (and if yes, how is it done) to incorporate a luck component in statistical models. So let’s assume I’d perform a regression on the goal difference between two ...
2
votes
1answer
195 views

Your Prediction Model works. What to do after?

One of the most crucial skills of a data scientist is not only to be able to build an accurate predictive algorithm but to suggest a set of actions based on that to enhance the goal ratios. I have ...
2
votes
1answer
4k views

Date prediction - periodic recurrence

If I have some data regarding the occurence of an event on a certain date and some other variables regarding it (think fe.: I have data on which dates it rained, and some addtitional data like ...
2
votes
2answers
45 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
2
votes
1answer
20 views

Find threshold in rate to determine reason for lost customer

I'm not sure if anybody will be able to help with this, or even if I'll be able to explain it well but I am stuck so here goes.... I have a set of customers, some are lost, some are still active. We ...
2
votes
1answer
1k views

Tensorflow predicting same value for every row

I have a trained model. For single prediction I restore the last checkpoint and pass a single image for prediction but the result is the same for every row. Does anyone have a clue of what might be ...
2
votes
1answer
555 views

Is there a way to calculate value from a radar (spider) chart?

So I am currently working on a project for "sales people". Essentially, the user is giving us a plethora of information related to deals they are trying to win. We have data related to the price of ...
2
votes
1answer
218 views

Confusing Offset in my Support Vector Regression and other Models

I am experiencing a weird offset in my Support Vector Regression prediction (code below). A brief overview: I have a set of 10 .xls sheets as input data (each with 30 rows and 27 columns), and a ...
2
votes
1answer
146 views

ANN and prediction

I have a list of objects. Each objects contains longitude, latitude and a list of words. What I want to do is to predict the location based on the text contained in the object (similar texts should ...
2
votes
2answers
108 views

Prediction approach on unique data or progressive data

In a employee attrition analysis with a table having rowwise data for a (employee like Id, name, Date_Join Date_Relieving Dept Role etc) ...
2
votes
2answers
43 views

Is ARIMA appropriate for time series prediction involving a mix of explanatory and independent variables?

I have a table with the following columns: Date(Month,Year), Sold_Past_Month, Quantity_Available, Quantity_Shipping_In, Missed_Sales, Quantity_Needed Quantity_Needed is the dependent variable that ...
2
votes
1answer
197 views

How to extract the sample split (values) of decision tree leaves ( terminal nodes) applying h2o library

Sorry for a long story, but it is a long story. :) I am using h2o library for python to build a decision tree and to extract a decision rules out of it. I use some data for training where labels get ...
2
votes
1answer
19 views

what is the interest of TimeDistributed after an LSTM layer?

I've already seen several similair questions but I did not understand anything, what is the interest of TimeDistributed? why we need to insert a TimeDistributed layer after LSTM to establish the time ...
2
votes
0answers
51 views

Time-series prediction/forecast coupled with classification [closed]

I am trying to predict a danger zone. I have a multidimensional time-series data and I want to forecast two timeseries for a defined number of time points. Then, I want to classify my predictions and ...
2
votes
0answers
51 views

Predict time series using NN trained with multiple TS [closed]

I'm trying to predict time series using RNN from keras and I have several time series to work with (these are sales from some stores, just usual 1D TS). Right now I can train one simple model using ...
2
votes
1answer
75 views

How do I use rnn to forecast to n periods with limited data?

So this is my 1st time trying to run a small time-series dataset through an RNN, but after a lot of searching, I haven't been able to find, 1. How I can use this to forecast to n periods ? (like in ...
2
votes
0answers
44 views

Prediction questions related to the dataset

I have been self-learning data science from different sources. I have a dataset which was sent to me by my friend from one of her college courses. The work is to be done in R preferably. Description: ...
2
votes
0answers
100 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...