Questions tagged [prediction]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
3answers
28 views

Predict the salaries of customers in 2019 from 2016 data

I have a spreadsheet of data with ages and salaries for 2016. For example, in 2016 there were 12988 customers who were 18 years old and earned 20k. I need to predict the salaries of customers for 2019....
1
vote
2answers
247 views

Train an LSTM neural network with time series containing seasonal and trend

I am working on a project for predicting the number of DNS queries from the site: DNS queries statistics. The data I use is minutely data, which means the number of DNS queries of every minute. If ...
0
votes
1answer
19 views

Machine Learning based Multivariate Time Series Prediction - How to create supervised data format

Q1: I have a multivariate time series dataset. For each timestep, there are 11 features and 1 output. I am going to use supervised ML to predect the output. I understand that in univariate cases, if ...
1
vote
1answer
99 views

Predicting Customer Activity Absence

Could you please assist me with to following question? I have a customer activity dataframe that looks like this: It contains at least 500.000 customers and a "timeseries" of 42 months. The ones and ...
1
vote
1answer
38 views

predicition for a specific month

I am attempting to build a predictive model based on the past historical data. I have details of specific machine failure based on the past year data. I have data from some months of 2016 and from ...
0
votes
1answer
603 views

Predictions with arbitrairy sequence length for stateful RNN (LSTM/GRU) in Keras

I have time series data of the following properties: input shape: (num_timesteps, num_features) output shape: (num_timesteps, num_outputs) I reshape it to batch ...
0
votes
1answer
16 views

Finding the usage percent to perform predictive analysis for new users

Problem Statement- I have to find the average feature usage all the users and the usage of user X to suggest if he should use the feature. Example - On google home page out of all the user's avg 85% ...
2
votes
1answer
20 views

Predicting probability for each tag given already chosen tags

I have a set of tags (~10'000, will be extended over time) presented to a user. After he has selected 3 or more tags, I want to predict for each remaining tag what the chances are that the user will ...
0
votes
1answer
37 views

Decision tree classifier prediction changes from one run of the model to the next

I'm running a very basic gender ['male', 'female'] classifier using the sklearn DecisionTreeClassifier based on ...
0
votes
0answers
7 views

what are possible error analysis approach in tabular data?

I am working on binary classification on tabular data. The dataset is mostly made of categorical data and after fitting the data to a model I found test accuracy to be low. I want to do error analysis ...
2
votes
1answer
81 views

How do I use rnn to forecast to n periods with limited data?

So this is my 1st time trying to run a small time-series dataset through an RNN, but after a lot of searching, I haven't been able to find, 1. How I can use this to forecast to n periods ? (like in ...
1
vote
1answer
20 views

Service Request classification, questionnaire filling and call logging

I am very new to machine learning. I just went through some of the tutorials in Azure and completed one practice workflow(car price prediction). I hope I can ask basic questions here. Scenario : We ...
0
votes
2answers
34 views

How to measure accuracy of a route prediction

I developed a new route prediction algorithm and I am trying to find a metric that informs on how well a prediction was. This metric is meant to be used offline, meaning that the goal is not to ...
0
votes
1answer
32 views

Find suitable locations using Machine Learning

Just for fun, I am currently trying to find suitable locations to deploy new stores. So what I did so far is to take the actual sites of current stores and to assign surrounding variables to it. These ...
1
vote
2answers
35 views

Splitting training and test set with financial data

I am using trees algorithms (decision tree, random forest and XGBoost) to forecast the sign of the returns in the stock market (classification). I am using this article as a reference: http://...
-1
votes
0answers
24 views

Classification and prediction on binary data

I am trying to cluster a binary data that consists of 294 inputs and 120 possible outputs. I have tried to train a neural network using tensorflow/keras with the sigmoid function as the activation one....
0
votes
2answers
41 views

How can i test the performance of a model when the test data contains seen and unseen data

To test the performance of my model based on some selected features, i try to use unseen and seen data. However, when choosing the accuracy based on all data, the model is almost overfitting since ...
0
votes
1answer
62 views

How to predict whether the client will renew the subscription or not based on given data structure

I have a requirement where I want to predict whether the client will renew the subscription or not. And the data is something like below. Basically client's subscription end date can be anything. ...
1
vote
1answer
22 views

Multivariate time series prediction with binary target

I have an electronic component whose sensors record temperature, current and voltage values of various sub-elements. These readings are taken at regular intervals of time and I organized them as ...
2
votes
2answers
150 views

How to create an ensemble that gives precedence to a specific classifier

Suppose that in a binary classification task, I have separate classifiers A, B, and C. If I ...
0
votes
1answer
43 views

Include time as a variable in regression model

I am currently working on a regression problem which requires me to predict the costs of a fixed asset. I have used several variables to do so and derived a predicted cost. However, my superior has ...
2
votes
1answer
22 views

How can I get an algorithm to have an evalutation metric based on aggregate predictions?

Let's say I have a model that makes a prediction per individual. An example data set is below. Normally, evaluation metrics (for example within the XGBoost algorthim), are used at the individual ...
1
vote
4answers
101 views

Which type of model to use and what's my target variable

I am a beginner in Data Science field, so sorry if my question is too basic. The task is to build an ad bidding model for online marketing which allows you to deliver targeted ads to the right ...
0
votes
0answers
8 views

prediction with un-obligatory features

I am pre-processing a real-world dataset with some features with missing values. these features are not mandatory - the user doesn't have to provide them. This means the values are not missing at ...
0
votes
0answers
18 views

Predicting house pricing given a dataset consisting of [ location: date of transaction: price ]

What would be the right way to tackle the problem of predicting median house pricing, given that the data I have for training consists in a big list of entries that have the following values: ...
0
votes
1answer
40 views

Is “adding the predictions to the real data for new training and prediction” a good idea for LSTM?

Considering we have trained our model with a lot of data for "many-to-one" prediction. Then we like to forecast the future data of next 10 days. So we use last 60 of existent data and predict the ...
1
vote
1answer
60 views

XGBOOST : model.predict_proba() and model.predict() conflicting behaviour

I have two classes : 1 and 2 The output of model.predict_proba() -> [0.333,0.6667] The output of model.predict() -> 1 This is happening for around 200 test values out of the test data of 10 lac. ...
0
votes
0answers
11 views

Modify image with machine learning

Here's my problem: I already have a little neural network that generate images using DCGAN, that was very entertaining to do but now I'd like to modify images using ML methods. Let me explain myself: ...
2
votes
1answer
39 views

How to deploy ML models in production?

Have been learning Machine Learning concepts and doing hands-on past few months. Now got a bit different doubt than implementation of code. This is regarding measures to be considered while ...
0
votes
2answers
51 views

Prediction after one hot encoding

I have a regression model that I want to make prediction based on values that I will get from an end user. In my dataset, I have one categorical variable region ...
0
votes
1answer
31 views

Predicting when component will fail having its parameters data

I have a component and I need to predict when it will wear out and will need replacement. I monitor, let's say 5 parameters of this component, each one is monitored for every run cycle. So, the ...
0
votes
1answer
17 views

Identifying importance of each feature in deep model

I have a deep model and I want to figure out which feature has the maximum influence on predicted result. For this I train the model with all the features I think are important, during prediction I ...
2
votes
1answer
39 views

Xgboost multiple class predictive performance beats one versus rest

I have an NLP task I'm tackling with xgboost (R implementation). Before describing my doubt I'll give you some background: I have a corpus of documents for which I did topic discovery, using a term ...
2
votes
1answer
31 views

what is the interest of TimeDistributed after an LSTM layer?

I've already seen several similair questions but I did not understand anything, what is the interest of TimeDistributed? why we need to insert a TimeDistributed layer after LSTM to establish the time ...
2
votes
1answer
277 views

How to extract the sample split (values) of decision tree leaves ( terminal nodes) applying h2o library

Sorry for a long story, but it is a long story. :) I am using h2o library for python to build a decision tree and to extract a decision rules out of it. I use some data for training where labels get ...
0
votes
1answer
31 views

Why am a getting wrong prediction when combining two list of samples, which individually gives correct prediction?

So I am coding in Python. I have to set of samples. Set1 contains samples of class A and the other set, Set2 contains samples of class B. These samples taken are a part of the training dataset. When I ...
0
votes
0answers
9 views

What's the meaning of Err in Online Time Series Predicion with Missing Values

I'm reading THIS paper about online predictions on time series with missing values. And trying to code the third algorithm in C++. The thing is that I don’t understand what they mean by $Err_{\tau}...
1
vote
1answer
71 views

How to add previous predictions for new predictions in LSTM?

I am trying to train a model on a big data sequence like this [0.2 0.1 0.1 ..... 0.4 0.8] . I create X vectors with length 60 for inputs and Y scaler numbers as ...
0
votes
1answer
35 views

What could make a set of the train data more predictive than the whole train data

I took a sample of my training data and balanced it and then trained my model. The results obtained are more accurate than using the whole set of train data (balanced or imbalanced). My question is: ...
0
votes
0answers
33 views

Given $x_1,…,x_n$, predict $y$ without being able to train on $y$

Say we have some large training data (a time series) of a few thousand rows, i.e. $$X_1=\{x_{1,1},\ldots,x_{1,n}\} \in\mathbb{R}^n, \quad y_1\in\mathbb{R}$$ $$\quad\quad \vdots$$ $$X_m=\{x_{m,1},\...
0
votes
0answers
14 views

Find possible fearure values to predict a certain outcome

I have a dataset about patients waiting times in a health district. The data is aggregated by health provider, type of medical procedure, urgency of the procedure (3 classes) and reports the n. of ...
0
votes
1answer
23 views

LSTM get next output with Keras

So I'm learning RNN, and tried to do a prediction LSTM, but I do not understand how the output works. I have this LSTM RNN: ...
0
votes
0answers
106 views

How to fix “'The `start` argument could not be matched to a location related to the index of the data.” Error?

When I try to predict the results using ARIMA for a specific train/test split, its throwing an error like this: "'The start argument could not be matched to a ...
0
votes
0answers
4 views

Get sequential model to output probabilities with pystruct

I have implemented a sequential model using Pystruct. The model I use is BinaryCLF and as a learner the StructuredPerceptron. So far, when I test the prediction of my model, I give as an input the ...
1
vote
1answer
33 views

How to construct confidence bound for Time Series Prediction?

I have some time series data and am using some Deep Learning techniques to get its prediction. Now, I would like to construct confidence bounds for it. I calculated the residuals, their mean and ...
0
votes
1answer
31 views

Searching prediction from 4 datasets

The fourth dataset contains (train_data, test_data, previous_data, and information_history_data). The goal is to search for a user's rating on the loan to the bank. ...
3
votes
1answer
1k views

Time series prediction of discontinuous data

In the context of time series prediction, I have read that time series is a series of data that taken at successive equally spaced points in time (which means its in order). What if I have a ...
0
votes
0answers
10 views

Compare large prediction with observed values

I have test scores for a lot of schools and I created a performance index calculated using the last score of a state test. This index is supossed to predict the performance of the school in the next ...
1
vote
2answers
251 views

Event prediction sequence

I need to create an app to predict events. I'll explain my requirements: I've a set of intermediate events (eg.: 1, 2, 3...9) and a set of final event (eg.: A for OK and B for KO). This events bring ...
0
votes
1answer
47 views

Best metric in imbalanced classification for multi-label classification

My test data are imbalanced, i tried to use the precision or the gmean as metrics for a multi-label learning model, but both metrics are not very informative. Is there any way to use for example the ...