# Tag Info

### Time series prediction using ARIMA vs LSTM

Statement 1 is correct, statement 2 is correct, but requires elaboration, and statement 3 is incorrect for seasonal ARIMA: The following might point you in the right direction but hopefully you'll ...
• 6,638
Accepted

### Is a 100% model accuracy on out-of-sample data overfitting?

High validation scores like accuracy generally mean that you are not overfitting, however it should lead to caution and may indicate something went wrong. It could also mean that the problem is not ...
• 8,978
Accepted

### What do "compile", "fit", and "predict" do in Keras sequential models?

Let's first see what we need to do when we want to train a model. First, we want to decide a model architecture, this is the number of hidden layers and activation functions, etc. (compile) Secondly,...
• 8,478
Accepted

### Prediction interval around LSTM time series forecast

Directly, this is not possible. However, if you model it in a different way you can get out confidence intervals. You could instead of a normal regression approach it as estimating a continuous ...
• 8,978
Accepted

### how to interpret predictions from model?

Alright so I rewrote some parts of your model such that it makes more sense for a classification problem. The first and most obvious reason your network was not working is due to the number of output ...
• 8,478

### 99% validation accuracy but 0% prediction results (UNET Architecture)

There is no "mismatch" of accuracy. Your problem is that you have an image segmentation problem where 99% of the pixels should be zero. So getting 99% accuracy is trivially easy. A model that predicts ...
• 27.2k

### Accuracy for Kmeans clustering

Accuracy is a measure of comparing the true label to the predicted label. K-Means is an unsupervised clustering algorithm where a predicted label does not exist. So, accuracy can not be directly ...
• 274
Accepted

### Is There a Way to Re-Calibrate Predicted Probabilities After Using Class Weights?

A more general adjustment for resampling (not just the simple undersampling in your linked paper) exists: Add $\ln\left(\frac{p_1(1-r_1)}{(1-p_1)r_1}\right)$ to the log-odds of each prediction, where ...
• 9,304

### Calculate confidence score of a neural network prediction

One way to estimate the level of confidence we have about an ANN prediction is to use dropout perturbations. The idea was proposed in this paper: Dropout as a Bayesian Approximation. Representing ...
• 5,677

### Why are predictions from my LSTM Neural Network lagging behind true values?

Welcome to the site. I think you were right that the prediction lags behind the true value because the series is autoregressive (i.e. a strong way to predict tomorrow’s value is “It will be about the ...

### Predicting with categorical data

Yep this is a common problem. What I would do is use SKLearns label encoder. With a similar API to SKLearn models, it can be fit to your category - meaning that any ...
• 383

### How to Predict the future values of time horizon with Keras?

This answer goes a little bit in a different direction, but I hope it still answers your question. It uses the idea of a rolling forecast/prediction. Because you use the word horizon, I will assume ...
• 13.8k
Accepted

### Why can't my neural network learn how to predict the squares of natural numbers?

Decrease the number of hidden layers; you can omit the dense layer with $50$ neurons. Furthermore, train your network more. You should also provide more data. It is not much at the moment. Your ...
• 13.3k

### Time series prediction using ARIMA vs LSTM

Adding to @AN6U5's respond. From a purely theoretical perspective, this paper has show RNN are universal approximators. I haven't read the paper in details, so I don't know if the proof can be applied ...
• 1,108

### Encode multi-class response variable

It depends on the meaning of the classes, and whether they have any meaningful order. If they are ordinal or a scale, then there is a meaningful ordering, and it can potentially be reasonable to order ...
• 2,968

### Time series prediction using ARIMA vs LSTM

As an extreme case, I had a chance to study on Forex (Foreign Exchange Rate) forecast and intensively compared performances of LSTM, windowed-MLP and ARIMA. As many articles say, Forex time series is ...

### Time series prediction using ARIMA vs LSTM

I’ve come to the same conclusion as yourself and others, traditional forecasting is still probably the most applicable and maybe reliable for time series of numeric values. There is some slight bleed ...
• 165

### Time series prediction using ARIMA vs LSTM

ARIMA models are linear and LSTM models are nonlinear. Some other parametric nonlinear time series models that statisticians have studied are Threshold Autoregressive Models (TAR) and Smooth ...
• 205
Accepted

### What does a predicted probability really mean, without considering the accuracy of the underlying model?

Accuracy is measured in classification model by comparing the predicted labels to the actual known labels. The predicted labels are a function of both the predicted probabilities for each class and a ...
• 953
Accepted

### Simple prediction with Keras

What you are trying to do here is forecast the future values of a time series. This is a predictive problem and the future values will depend on a number of latent factors. I will assume all we have ...
• 8,478
Accepted

### how to get prediction from trained random forest model?

Use the CountVectorizer you have fitted to preprocess your custom input then feed it to your model for prediction. ...
• 3,858

### what is the interest of TimeDistributed after an LSTM layer?

Ok let's say you have an LSTM() layer with return_sequences = True set. That means each LSTM cell in it is outputting its value. ...
• 5,677

### What is the minimum amount of data required for sales prediction with ML

As @Ethan said there is no general answer to this question. There are multiple perspectives that you need to take into consideration. Amount of the data: The general tendency is more data will lead ...
• 1,828

### Why do decision trees have low accuracy?

It's not true in general. Decision trees tends to overfit in comparison to other algorithms, which provide too low accuracy. But if you use a decision tree in the right way i.e you prepare data in the ...
• 1,339

### Are Machine Learning Weather Prediction models better than classic weather forecast?

I'm not a meteorologist but in my humble opinion, Numerical Weather Prediction and especially WRF (stands for Weather Research and Forecasting - a high resolution & mesoscale model, unlike the old ...

### Batching in Recurrent Neural Networks (RNNs) when there is only a single instance per time step?

Your edit is not right. from the keras documentation you can actually understand the difference between timesteps and batches. I take your examples: For the first example. You have 4 instances, or ...
• 85
Accepted

### Using machine learning technique to predict commodity prices

Based on your question there are couple of things which I would assume to answer your question: As you need to predict the commodity price the data which is collected is time series data. Since you ...
• 2,337

### Is it possible to use the saved xgboost model (with one-hot encoding features) on unseen data (without one-hot encoding) for prediction?

A model is built on a specific set of features, which may include categorical features encoded using one-hot encoding. If you have new data with additional categories, your model has no idea how to ...
• 2,108