Questions tagged [prediction]

The tag has no usage guidance.

138 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
1answer
215 views

Why does CV yield lower score?

My training accuracy was better than my test accuracy, hence I thought my model was over-fitted and tried Cross-validation. The model further degraded. Is that my input data need to be sanitised ...
4
votes
0answers
3k views

Kalman filter for time series prediction

I have the information about the behaviour of 400 users across period of 1 months (30 days). Across those 30 days I measure 4 different information (let's call it A,B,C and D), hence I have a total of ...
3
votes
1answer
3k views

Making predictions / Loading model in TensorFlow 2.0

I use TensorFlow/Keras on a daily basis to make predictions for a project. Everything works fine but I was getting regular warnings about the transition to TensorFlow 2.0 and I thought this week I ...
3
votes
0answers
47 views

Timeseries prediction error measurement. How to deal with diffrent time scales?

I have some time series and a prediction model. Now I would like to measure how good/bad the prediction is for different products. The problem is that for each product the time points (frequency of ...
3
votes
0answers
162 views

Next events prediction based on previous events

I have data set of sequences of user executed commands sorted in the order of its occurrence. The data looks like this. ...
2
votes
0answers
19 views

History that lead to the word “predict” being used for the application of a model on data

Background The framework scikit-learn uses "predict" for the application of model on (new) input data and I have seen many people use that term. In the scientific papers that I have read (...
2
votes
1answer
65 views

How to incorporate the uncertainty of the model coefficients in the prediction interval of a multiple linear regression

I'm dealing with the modeling of small experimental data sets. As most experimental work does not generate thousands of samples, but rather a handful, I need to be inventive in how to deal with this ...
2
votes
1answer
311 views

ML methods for prediction, using categorical variables and time

Most of the time series analysis tutorials/textbooks I found time series data, usually deal with continuous numerical variables. I am currently trying to solve a problem that deals with multivariate ...
2
votes
0answers
114 views

Prediction issue with xgboost custom loss

I have an issue with xgboost custom objectives: I do not manage to get consistent forecasts. In other words, the scale of my forecasts is not in line with the values I would like to predict. I tried ...
2
votes
0answers
81 views

Results are too good.. what is wrong? How to predict correctly?

I am about to evaluate a neural network and want to check whether the predictions make sense. The variables: ...
2
votes
1answer
255 views

How to add previous predictions for new predictions in LSTM?

I am trying to train a model on a big data sequence like this [0.2 0.1 0.1 ..... 0.4 0.8] . I create X vectors with length 60 for inputs and Y scaler numbers as ...
2
votes
1answer
1k views

How to extract the sample split (values) of decision tree leaves ( terminal nodes) applying h2o library

Sorry for a long story, but it is a long story. :) I am using h2o library for python to build a decision tree and to extract a decision rules out of it. I use some data for training where labels get ...
2
votes
1answer
120 views

How do I use rnn to forecast to n periods with limited data?

So this is my 1st time trying to run a small time-series dataset through an RNN, but after a lot of searching, I haven't been able to find, 1. How I can use this to forecast to n periods ? (like in ...
2
votes
0answers
82 views

Prediction questions related to the dataset

I have been self-learning data science from different sources. I have a dataset which was sent to me by my friend from one of her college courses. The work is to be done in R preferably. Description: ...
2
votes
0answers
889 views

Test data predictions yield random results when making predictions from a saved model

I am classifying aerial imagery that is tiled into 256x256 tiles using Keras and TensorFlow. The model splits the training data (i.e. the 256x256 image tiles making up the study area) into 70% ...
2
votes
0answers
597 views

NARX Network Multi-Step Forecasting Question

I've been attempting to do multi-step ahead prediction with the NARX (Non-Linear with Exogenous Inputs) Neural Network. As I understand it, this network can be defined mathematically as follow: $y(t+...
1
vote
1answer
22 views

Predicting high frequency sparse time series data in python

I have a dataset of a couple of EV charging stations (10 min frequency) over 1 year. This data consists of lots of 0's, since there is no continuous flow of cars coming to charge but rather ...
1
vote
0answers
19 views

Difficulty understanding the difference between Poisson, Quasi-Poisson, and Negative Binomial models

I will try to keep this short. As an assignment for my GLM course, we were given a dataset on the # of homicide victims a person knows, as well as the race of the person. The main idea is to answer ...
1
vote
0answers
8 views

Should I give regularly-spaced or irregular-timestamped data to a price predicting neural network?

I am building an application to predict the price of an item. Data is collected at regular 5-minute intervals while the application is running. Unfortunately, there is downtime, so there is not a full ...
1
vote
0answers
18 views

How to do prediction on survival data, using Random Forest

I should make prediction on survival data, using the random Forest method. My question is: should I follow the same approach as in logistic regression? taking into account only the status variable or ...
1
vote
0answers
77 views

LSTM giving almost constant output

I have used an LSTM with 4 layers deep each layer having 10 LSTM units to predict the AAPL stock 500 steps away by looking 50 steps back and it was predicting well (only a lag was there). However when ...
1
vote
0answers
14 views

Confidence interval for class membership probabilities

I would like to calculate confidence intervals for predicted probabilities of a class membership obtained with randomForest. I know I could use predict.all in randomForest(), which gives me the ...
1
vote
0answers
34 views

*(CATEGORIES[int(prediction[0][0])])* giving me different result for single image prediction from saved model

From a saved model, I am trying to predict a single image. I followed this code - https://www.youtube.com/watch?v=A4K6D_gx2Iw I am getting different result for two different command- ...
1
vote
1answer
33 views

target variable prediction among possible answers

I have a dataset on which I would like to apply a Machine Learning algorithm for multi-class classification. An example of my target variable (in string format, will be later ...
1
vote
0answers
18 views

Why does my model fail to predict on the whole dataset?

So I have about 3000 images with 6 classes and this is what I did: 1 - split into training set and test set prior to anything with 20% test size 2 - performed data augmentation on the under ...
1
vote
0answers
19 views

Stabilize Neural network prediction for class probability

I could not carry my question from stackoverflow I ve been trying to fit a neural network for binary setting using library(keras) and I am interested in class ...
1
vote
0answers
27 views

Why NARX neural network and Hammerstein-Wiener model perform worse than simple sigmoid network nonlinearity estimator on any predictions?

I am currently working on dynamic modeling and exploring different techniques and algorithms to deploy a dynamic time-series black-box model. My data looks like the following: I have 7 inputs and 1 ...
1
vote
0answers
21 views

Improve confidence interval accuracy

I am doing a linear regression on log-transformed data and I use the bayesian approach to model the predictive distribution and construct my 90% prediction Interval. The problem with this approach is ...
1
vote
0answers
59 views

Why are Neural Network predictions “correct”, but offset from true value? Not using any past lagged values

I recently asked a similar question, but didn't get a response that really addressed/fixed the issue. Additionally, I've done some more work since then. I'm sorry for the long question below, I just ...
1
vote
1answer
51 views

Ingredients, Recipes and recipe ratings. I would like to predict the rating based on combination of ingredients

I would really appreciate some help on the first steps to my problem, suggestions of modeling techniques i could use or relevant research (i could not find any). I have a list of ingredients (150 in ...
1
vote
1answer
37 views

best NN architecture for point prediction

I'm training to predict a single value y (continuos in [0,1]) based on a number of variables ...
1
vote
0answers
18 views

When should I reverse normalizations to evaluate loss?

If I am training a neural network and have normalized the data before-hand, should I reverse the normalization to calculate the loss? This tutorial provides an example of this method. What if I'm ...
1
vote
1answer
53 views

How to use spectral clustering to predict?

In an academic paper, they talk about using a nearest neighbour algorithm to predict the cluster of a new point. And how the number of nearest neighbours is set to 10 in their example. What do they ...
1
vote
1answer
102 views

YOLO Dense Prediction

I have two questions about dense prediction in YOLOv4 paper What does it mean by the (hard negative, online hard) example mining method is not applicable to one-stage object detector, because this ...
1
vote
1answer
1k views

How to make predictions of multiple input samples at once in tf 2 with keras

I am quite confused on the output of model.predict when after training I validate my model on around 6000 samples I use the following pseudo code: ...
1
vote
0answers
20 views

Derivative of multi-output Gaussian Process

I am working on a project where I estimate transition and measurements models for a kalman filter using Gaussian Processes. In order to linearize the models I require the Jacobian of the estimated ...
1
vote
0answers
83 views

Keras Bidirectional LSTM: low training and validation loss but very bad predictions

I'm training a Bidirectional LSTM using Keras. My task is to predict the words order in a sentence, so, given a sentence, ...
1
vote
0answers
269 views

PyTorch time series prediction beyond test data

I am currently playing around with pytorch models for time series prediction. I have managed to successfully run a model to predict test data. I was wondering how can I use it to predict beyond test ...
1
vote
0answers
35 views

Difference between shap values and feature contributions

I always found both concepts a bit confusing since they are quite similar. Would someone provide clear example where to apply each? Shap values ref: https://towardsdatascience.com/explain-your-model-...
1
vote
1answer
60 views

Binary classification problem with imbalanced dataset, how to compare to random classifier

We have a very imbalanced dataset (2% of class 1). To the best of our knowledge, there is no baseline in the literature to the problem we want to solve - so we thought of comparing our performance to ...
1
vote
1answer
30 views

Dissecting performance issues with Random Forest

My task is to identify potential situation for trading and determine whether a candidate is going to succeed or not. I have a system in place to identify candidates, but there is a high rate of false ...
1
vote
2answers
37 views

Classification with feature not available at time of model creation

I have problem statement to predict the probability of solving a task depending on multiple features for e.g. when the task was created, the time needed to work on a task, etc Please find a dummy ...
1
vote
2answers
187 views

How to cluster categorical and numerical data in the same dataset?

I have a dataset in which it contains both numerical and categorical data. This can be done using supervised learning algorithms, but I am eager to see how this data can be clustered using some ...
1
vote
1answer
103 views

How to deal with different length entities in a Keras DataGenerator?

I'm solivng a prediction problem where I need to predict the demand of multiple articles based on their performance during the last 7 days. To get the most out of the data I am trying to implement a ...
1
vote
0answers
29 views

Predict with some probability the day of the month paycheck received through daily transactions

I am using R to do machine learning. I have daily shopping expenditure data of individuals over a couple of months and my goal is to be able to identify through their shopping pattern the day of the ...
1
vote
0answers
40 views

How to deal with similar feature values but each indicates to a different information?

If I have a feature with replicated values but each of these values indicates a different piece of information. example: feature 'street name' with value 'A' which some of these 'A's are for Boston ...
1
vote
1answer
64 views

How to measure/rate the effect of a exogenous covariate in a ARIMAX Model?

I have an ARIMA model, I'm trying to figure out how much an external variable (exogenous covariate) could improve the forecast, so I need to "synthesize" a rate that tell me the usefulness (or impact) ...
1
vote
1answer
51 views

Predicting when component will fail having its parameters data

I have a component and I need to predict when it will wear out and will need replacement. I monitor, let's say 5 parameters of this component, each one is monitored for every run cycle. So, the ...
1
vote
0answers
22 views

Multi-label learning, how to interpret the scores of instances

I am working on a multi-label learning classification problem. When I tune the hyperparameters of the model, the sign of each label (each line on the MLL) remains the same while the scores change. ...
1
vote
0answers
54 views

Unable to Print or Save Predicted Results in Orange?

I have applied some models (Logistic, Tree, SVM, Neural Network, etc) in order to predict my results. However, when I printed or saved my predicted results, I was unable to print the Complete ...