Questions tagged [prediction]

The tag has no usage guidance.

142 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5
votes
0answers
133 views

Deep advantage learning: how to predict the value

I'm currently working on a collection of reinforcement algorithms: https://github.com/lhk/rl_gym For deep q-learning, you need to calculate the q-values that should be predicted by your network. There ...
4
votes
1answer
74 views

How to incorporate the uncertainty of the model coefficients in the prediction interval of a multiple linear regression

I'm dealing with modeling small experimental data sets. As most experimental work does not generate thousands of samples, but rather a handful, I need to be inventive about how to deal with this small ...
4
votes
1answer
218 views

Why does CV yield lower score?

My training accuracy was better than my test accuracy, hence I thought my model was over-fitted and tried Cross-validation. The model further degraded. Is that my input data need to be sanitised ...
4
votes
0answers
3k views

Kalman filter for time series prediction

I have the information about the behaviour of 400 users across period of 1 months (30 days). Across those 30 days I measure 4 different information (let's call it A,B,C and D), hence I have a total of ...
3
votes
1answer
3k views

Making predictions / Loading model in TensorFlow 2.0

I use TensorFlow/Keras on a daily basis to make predictions for a project. Everything works fine but I was getting regular warnings about the transition to TensorFlow 2.0 and I thought this week I ...
3
votes
0answers
47 views

Timeseries prediction error measurement. How to deal with diffrent time scales?

I have some time series and a prediction model. Now I would like to measure how good/bad the prediction is for different products. The problem is that for each product the time points (frequency of ...
3
votes
1answer
1k views

How to extract the sample split (values) of decision tree leaves ( terminal nodes) applying h2o library

Sorry for a long story, but it is a long story. :) I am using the h2o library for Python to build a decision tree and to extract the decision rules out of it. I am using some data for training where ...
3
votes
0answers
163 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...
2
votes
0answers
30 views

Time series forecasting for vibration prediction on Industrial machine production?

I'm working on a machine learning project related to an industrial machine. The goal of the project is to build a model that would be able to predict the vibration of the machine while it's in ...
2
votes
0answers
20 views

History that lead to the word “predict” being used for the application of a model on data

Background The framework scikit-learn uses "predict" for the application of model on (new) input data and I have seen many people use that term. In the scientific papers that I have read (...
2
votes
1answer
401 views

ML methods for prediction, using categorical variables and time

Most of the time series analysis tutorials/textbooks I found time series data, usually deal with continuous numerical variables. I am currently trying to solve a problem that deals with multivariate ...
2
votes
1answer
124 views

How to deal with different length entities in a Keras DataGenerator?

I'm solivng a prediction problem where I need to predict the demand of multiple articles based on their performance during the last 7 days. To get the most out of the data I am trying to implement a ...
2
votes
0answers
128 views

Prediction issue with xgboost custom loss

I have an issue with xgboost custom objectives: I do not manage to get consistent forecasts. In other words, the scale of my forecasts is not in line with the values I would like to predict. I tried ...
2
votes
0answers
88 views

Results are too good.. what is wrong? How to predict correctly?

I am about to evaluate a neural network and want to check whether the predictions make sense. The variables: ...
2
votes
1answer
279 views

How to add previous predictions for new predictions in LSTM?

I am trying to train a model on a big data sequence like this [0.2 0.1 0.1 ..... 0.4 0.8] . I create X vectors with length 60 for inputs and Y scaler numbers as ...
2
votes
1answer
122 views

How do I use rnn to forecast to n periods with limited data?

So this is my 1st time trying to run a small time-series dataset through an RNN, but after a lot of searching, I haven't been able to find, 1. How I can use this to forecast to n periods ? (like in ...
2
votes
0answers
85 views

Prediction questions related to the dataset

I have been self-learning data science from different sources. I have a dataset which was sent to me by my friend from one of her college courses. The work is to be done in R preferably. Description: ...
2
votes
0answers
891 views

Test data predictions yield random results when making predictions from a saved model

I am classifying aerial imagery that is tiled into 256x256 tiles using Keras and TensorFlow. The model splits the training data (i.e. the 256x256 image tiles making up the study area) into 70% ...
2
votes
2answers
423 views

Event prediction sequence

I need to create an app to predict events. I'll explain my requirements: I have a set of intermediate events (eg.: 1, 2, 3...9) and a set of final events (eg.: A for OK and B for KO). These events ...
2
votes
0answers
597 views

NARX Network Multi-Step Forecasting Question

I've been attempting to do multi-step ahead prediction with the NARX (Non-Linear with Exogenous Inputs) Neural Network. As I understand it, this network can be defined mathematically as follow: $y(t+...
1
vote
0answers
15 views

Prediction method when the time series is not sequential?

I have multivariate time series data consisting of monthly sales of contraceptives at various delivery sites in a certain country, between January 2016 and June 2019. The data looks as follows: The ...
1
vote
0answers
10 views

Evaluation of reliability of suppliers by on time delivery

I am trying to create a weight that can help me properly evaluate the reliability of a company’s on time delivery ratios. I’m using historic delivery data. For example, comparing company A that ...
1
vote
1answer
18 views

Rule based prediction for known data

Lets say we have trained our model on 900 records (training data) . During prediction on test data of 100 records, assume model produces 95% accuracy. The question here is, can a mechanism be built, ...
1
vote
1answer
44 views

Random Forest. In a prediction less input is expected than features used

ValueError: Number of features of the model must match the input. Model n_features is 2 and input n_features is 7. I have the following error: I have not used any type of encoding(like one-hot etc.) I ...
1
vote
0answers
14 views

Error while using pre-trained model

I'm working on NLP task using RoBERTa model. As training last very long I saved my model, but now for some reason, part of my code doesn't work with this pre-trained model (getting an error), and ...
1
vote
1answer
33 views

How do you effectively predict the top 20% most likely customers to churn from a dataset?

I am looking to work out that if I have a dataset with 100,000 existing customers who didn't churn and 20,000 previous customers that churned in the past and the business objective is to target the 20%...
1
vote
1answer
32 views

Keras: Provide One-Hot-Encoded input values to neural network

I have a dataframe which has two columns of interest: A and B with string values. I am trying to build a prediction model which takes in a set of values in A as input and predicts the corresponding B ...
1
vote
1answer
46 views

Predicting high frequency sparse time series data in python

I have a dataset of a couple of EV charging stations (10 min frequency) over 1 year. This data consists of lots of 0's, since there is no continuous flow of cars coming to charge but rather ...
1
vote
0answers
20 views

Difficulty understanding the difference between Poisson, Quasi-Poisson, and Negative Binomial models

I will try to keep this short. As an assignment for my GLM course, we were given a dataset on the # of homicide victims a person knows, as well as the race of the person. The main idea is to answer ...
1
vote
0answers
9 views

Should I give regularly-spaced or irregular-timestamped data to a price predicting neural network?

I am building an application to predict the price of an item. Data is collected at regular 5-minute intervals while the application is running. Unfortunately, there is downtime, so there is not a full ...
1
vote
0answers
20 views

How to do prediction on survival data, using Random Forest

I should make prediction on survival data, using the random Forest method. My question is: should I follow the same approach as in logistic regression? taking into account only the status variable or ...
1
vote
0answers
104 views

LSTM giving almost constant output

I have used an LSTM with 4 layers deep each layer having 10 LSTM units to predict the AAPL stock 500 steps away by looking 50 steps back and it was predicting well (only a lag was there). However when ...
1
vote
0answers
15 views

Confidence interval for class membership probabilities

I would like to calculate confidence intervals for predicted probabilities of a class membership obtained with randomForest. I know I could use predict.all in randomForest(), which gives me the ...
1
vote
0answers
40 views

*(CATEGORIES[int(prediction[0][0])])* giving me different result for single image prediction from saved model

From a saved model, I am trying to predict a single image. I followed this code - https://www.youtube.com/watch?v=A4K6D_gx2Iw I am getting different result for two different command- ...
1
vote
1answer
34 views

target variable prediction among possible answers

I have a dataset on which I would like to apply a Machine Learning algorithm for multi-class classification. An example of my target variable (in string format, will be later ...
1
vote
0answers
20 views

Why does my model fail to predict on the whole dataset?

So I have about 3000 images with 6 classes and this is what I did: 1 - split into training set and test set prior to anything with 20% test size 2 - performed data augmentation on the under ...
1
vote
1answer
46 views

Regression performance varies hugely on shuffling training and testing data

I'm working on a regression problem to predict a variable y based on an input vector X with about 10 columns. To split the data for training and testing, I use the ...
1
vote
0answers
19 views

Stabilize Neural network prediction for class probability

I could not carry my question from stackoverflow I ve been trying to fit a neural network for binary setting using library(keras) and I am interested in class ...
1
vote
0answers
41 views

Why NARX neural network and Hammerstein-Wiener model perform worse than simple sigmoid network nonlinearity estimator on any predictions?

I am currently working on dynamic modeling and exploring different techniques and algorithms to deploy a dynamic time-series black-box model. My data looks like the following: I have 7 inputs and 1 ...
1
vote
0answers
22 views

Improve confidence interval accuracy

I am doing a linear regression on log-transformed data and I use the bayesian approach to model the predictive distribution and construct my 90% prediction Interval. The problem with this approach is ...
1
vote
0answers
79 views

Why are Neural Network predictions “correct”, but offset from true value? Not using any past lagged values

I recently asked a similar question, but didn't get a response that really addressed/fixed the issue. Additionally, I've done some more work since then. I'm sorry for the long question below, I just ...
1
vote
1answer
38 views

best NN architecture for point prediction

I'm training to predict a single value y (continuos in [0,1]) based on a number of variables ...
1
vote
0answers
23 views

When should I reverse normalizations to evaluate loss?

If I am training a neural network and have normalized the data before-hand, should I reverse the normalization to calculate the loss? This tutorial provides an example of this method. What if I'm ...
1
vote
1answer
71 views

How to use spectral clustering to predict?

In an academic paper, they talk about using a nearest neighbour algorithm to predict the cluster of a new point. And how the number of nearest neighbours is set to 10 in their example. What do they ...
1
vote
1answer
151 views

YOLO Dense Prediction

I have two questions about dense prediction in YOLOv4 paper What does it mean by the (hard negative, online hard) example mining method is not applicable to one-stage object detector, because this ...
1
vote
1answer
2k views

How to make predictions of multiple input samples at once in tf 2 with keras

I am quite confused on the output of model.predict when after training I validate my model on around 6000 samples I use the following pseudo code: ...
1
vote
0answers
22 views

Derivative of multi-output Gaussian Process

I am working on a project where I estimate transition and measurements models for a kalman filter using Gaussian Processes. In order to linearize the models I require the Jacobian of the estimated ...
1
vote
0answers
91 views

Keras Bidirectional LSTM: low training and validation loss but very bad predictions

I'm training a Bidirectional LSTM using Keras. My task is to predict the words order in a sentence, so, given a sentence, ...
1
vote
0answers
282 views

PyTorch time series prediction beyond test data

I am currently playing around with pytorch models for time series prediction. I have managed to successfully run a model to predict test data. I was wondering how can I use it to predict beyond test ...
1
vote
0answers
36 views

Difference between shap values and feature contributions

I always found both concepts a bit confusing since they are quite similar. Would someone provide clear example where to apply each? Shap values ref: https://towardsdatascience.com/explain-your-model-...