Questions tagged [lstm]

LSTM stands for Long Short-Term Memory. When we use this term most of the time we refer to a recurrent neural network or a block (part) of a bigger network.

Filter by
Sorted by
Tagged with
0
votes
0answers
67 views

How to deal with missing values in LSTM? Masking

I try to use LSTM for time series data prediction. The input data has the following form. missing valueBut I have some problem to use the Masking to deal with the data. Because for (samples,timestep,...
0
votes
0answers
24 views

Train MountainCar-v0 with LSTM

In mountain car envoriment we can accelerate car to left or right. When I get random samples for training, I'm getting 2:1 ratio for acceleration to left. When I train my LSTM model, it reaches ~ 70% ...
0
votes
0answers
51 views

Using Keras/TS for Multivariate Time Series Prediction w/ Univariate output?

I've been reading through a few tutorials for using Keras/TensorFlow for multivariate time-series prediction (primarily using LSTM models). One example uses air pollution as an example. In this ...
0
votes
2answers
68 views

How to apply a different Loss function to one specific Label?

I got a recurrent neural network in Keras, which classifies on 14 labels. The first label is the most important one and should be predicted with the highest accuracy. The other labels don't have to be ...
0
votes
1answer
80 views

Apply LSTM to each matrix element with Keras

I'm trying to apply a LSTM/GRU to each entry of a matrix $X$ note: Each matrix element is a time-series, so shape of X is (batch_size, rows, cols, time_steps, dims) $ y_{i,j}= \begin{cases} ...
0
votes
0answers
76 views

Combining 2D Detection with Disparity Maps to Learn 3D Object Geometry

Since the disparity map above is a representation of the object's distance from the camera's origin, is it reasonable to assume that a network (perhaps a convolutional LSTM) could be trained to ...
0
votes
1answer
56 views

Intuition behind the RNN/LSTM hidden state?

What's the intuition behind the hidden states of RNN/LSTM? Are they similar to the hidden states of HMM (Hidden Markov Model)? Thanks!
0
votes
0answers
23 views

is it possible to implement LSTM with input shape (sample,timestep,timestep,feature)?

I'm new to Keras. I am trying to implement this model https://www.aclweb.org/anthology/D15-1167 for document classification, and I want to use LSTM for getting sentence representation. I have trained ...
0
votes
1answer
88 views

LSTM fot text classification always returns the same results

Hello fellow Data Scientists, I'm trying to make a classifier that was to classify sequences of text into some predefined classes, but i always get the same output, can anyone help me understand why? ...
0
votes
1answer
882 views

Using LSTM for multi label classification

I am trying to use LSTMs to train and predict authors using reviews data and metadata ...
0
votes
1answer
59 views

LSTM - Incorporate word embedding in layer with multiple records in same date

I have a time series data having more than one record in a single date. Number of records in a single date is not consistent. I have 3 input features namely phrase, cost and weight. My goal is to ...
0
votes
1answer
35 views

How can I explain the cause of different performances for two different LSTM models and improve the performance?

I've built two different models for Load Forecasting. Dataset has six features. The performance evaluation metric is the Mean Absolute Percentage Error(MAPE). Both models are based on LSTM. Here is ...
0
votes
0answers
41 views

Spatial and temporal information processing together (CNN and LSTM)

I have small problem that requires to process both spatial and temporal information. I need to predict vehicle's trajectory based on previous trajectory information and map information. My current ...
0
votes
1answer
44 views

How to get a output of a hidden layer of a single-layer LSTM

How can get the hidden layer outputs in a simple one-layer lstm? ...
0
votes
0answers
47 views

LSTM forcasting: time series as input and a unique value for each as output

I am sorry for the mistakes I will make in this post, I'm new to deep learning ^^' I am trying to build an LSTM model that can help me predict some unique value according to time series indices and ...
0
votes
0answers
52 views

LSTM architecture for multivariate time series

For a multivariate time series analysis, which of the following LSTM architectures would work better and why? 1) Having two independent LSTM layers (one for the time series variable and one for the ...
0
votes
1answer
45 views

Saving LSTM hidden states while training and predicting for multi-class time series classification

I am trying to use an LSTM for multi-class classification of time series data. The training set has dimensions (390, 179), i.e. 390 objects with 179 time steps each. There are 37 possible classes. ...
0
votes
1answer
37 views

How to use LSTM for time series data?

I've an ECG data spread over time. The duration for each data is around 3 minutes (approx 180 seconds). Each second around 200 recordings were taken. So total length for each sample is approx 36000. ...
0
votes
2answers
901 views

How to implement an LSTM RNN with multiple input features

EDIT: Now I didn't convert to list. I am training LSTM for multiple time-series in an array which has a structure: 450x801. There are 450 time series with each of 801 timesteps / time series. The ...
0
votes
0answers
61 views

How multi layer LSTM are interconnected?

I am trying to understand the layers in LSTM for my own implementation using Python. I started with Keras to getting familiarized with the layer flow. I have tried the below code in Keras and I have ...
0
votes
1answer
55 views

LSTM with input of actual time step

I'm working on an implementation of LSTM neural network to forecast energy consumption. I have a dataset with load, series of weather parameters and indicator of it's bank holiday or not. I first ...
0
votes
1answer
204 views

How to make forecast in LSTM with specific/defined feature values

I am analyzing the avocado dataset to predict the future prices of avocado depending on the region and type (organic/conventional). I've trained my model which seems to be working. The test results ...
0
votes
1answer
72 views

How to predict past test set on time series data using LSTM

I'm trying to do a regression on some inventory amounts with the following model using Keras: ...
0
votes
0answers
41 views

LSTM model for many time series

Let's say one has many time series for which one wants to build a predictive model (based on LSTM). Which of the following cases would be more optimal and why? 1) building one model for all the time ...
0
votes
1answer
178 views

How to read specific column with specific row in x_test using python

I have a dataset with four input. here I am trying to predict X1 input in next time period using lstm model. Here I put x_train 80% and x_test 20% . In x_test first input some of rows are with 0 ...
0
votes
0answers
4k views

cannot reshape array of size 4 into shape (4,3)

I have a dataset with three inputs X1,X2,X3. I tried to predict next value of X1 using lstm . I wrote the code for lstm and while trying model.predict I got an error ...
0
votes
0answers
553 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
0
votes
1answer
44 views

LSTM get next output with Keras

So I'm learning RNN, and tried to do a prediction LSTM, but I do not understand how the output works. I have this LSTM RNN: ...
0
votes
0answers
39 views

Error when checking input while running the LSTM model using panda python

I have a data set include with temperature, humidity and wind. Here I want to predict future temperature value in next hour. I used LSTM to predict future temperature value. But when I run the model ...
0
votes
2answers
449 views

Which performs better in time series forecasting, LSTM or SVR?

I have run LSTM and SVR models on various datasets having sample values in the range of 1-4000 and the MAPE obtained in SVR was consistently lesser than that obtained through LSTM. I was told the ...
0
votes
2answers
176 views

Keras input for multivariate classification with LSTM using current features and previous timesteps features and y values

I am working on a multivariate binary classification problem. What I want to do is to predict a binary classification given the features at the current timestep and the data (features+real ...
0
votes
2answers
43 views

Understanding Layers in Recurrent Neural Networks for NLP

In convolution neural networks, we have a concept that inner layers learn fine features like lines and edges, while outer layers learn more complex shapes. Do we have any such understanding for ...
0
votes
1answer
30 views

How to identify new clusters that the training data has never seen

I have to identify the different operational states of a server. I have readings related to the different sensors of the server ( like temp sensor,fan speed sensor,job load sensor etc).The data I have ...
0
votes
0answers
43 views

Choosing loss function in Keras for prediction binary_crossentropy or categorical_crossentropy

What loss function in keras should I chose for binary_crossentropy or categorical_crossentropy? I have data like : $w1,w2,w3,w2,w2,w1,w3,w5,w9,w5,w4...$ I want to predict sequence: input: $w1,w2,w3$...
0
votes
1answer
24 views

May I use the same data in several time series intervals?

I am playing with RNNs / LTSMs for a classification task in predicting financial data. I have a time-series going many years back, and are planning to divide it into a number of shorter time-...
0
votes
2answers
698 views

Why LSTM models do not require labels for each step?

For time related problems like, for example, stock prediction: Let's say we have 300 days of data, 10 features, and one target: the price. Why, for the training, we only need the price of the 300th ...
0
votes
1answer
278 views

How to structure time series for binary classification in Keras?

I'm trying to classify churn (1 or 0) for a user based on day-to-day time series and activity levels, something like this: ...
0
votes
0answers
55 views

Duplicate QUORA question detection:Kaggle Dataset

I have tried to use 2 BILSTMs along with the attention layer but the validation accuracy is not improving at all. Could anyone suggest an alternative to increase the accuracy? Layer structuring: ...
0
votes
0answers
2k views

What are best activation and regularization method for LSTM?

In Keras there are: ...
0
votes
0answers
1k views

InvalidArgumentError: incompatible shapes: [32,153] vs [32,5] , when using VAE

I'm working on a sequence to sequence model using LSTM, the model worked perfectly with an autoencoder, but when I try to use a Variational autoencoder by adding the mean and deviation layer and ...
0
votes
1answer
270 views

Error: keras merge LSTM layers in sum mode

I want to merge two sequential models in sum mode into one model using keras as: ...
0
votes
1answer
167 views

how can LSTM output ever be negative with 0 initialization?

From the lstm equations, e.g. as they appear on p406 of the Deep Learning Book, it looks to me like initializing with zeros (as is common practice), must always produce a strictly positive output. ...
0
votes
1answer
1k views

Is it always better to using stacked LSTM than single LSTM?

I am currently studying LSTM and RNNs. I came across several concepts like Multidimensional LSTM and Stacked LSTM. I have used Stacked LSTM and it gives me a better performance than single LSTM. As ...
0
votes
1answer
59 views

Model for classifying time-series data with distinct features?

I've heard about time-series classification being done with TCN's and CNN's combined with LSTM's very often, citing that CNN's would provide insight both forward and in the past since you already have ...
0
votes
1answer
241 views

Is the LSTM share the same model parameter in each block?

I learn the LSTM recently, and a little bit confuse about the model parameters about LSTM, The follow is the LSTM structure And it is equation as (I slightly ignore the bias in each equation): $$...
0
votes
1answer
69 views

What does the below phrase in the lstm blog mean? - Data Science

I am a newbie to data science. I was reading this blog When I was half way through, I came into this sentence Further, each series of data has been partitioned into overlapping windows of 2.56 ...
0
votes
1answer
268 views

Architecture help for multivariate input and output LSTM models

I am working on a sequence prediction problem using Keras. My end-goal is to have my input be several features, one being a categorical variable, that I have used 1 hot encoding for, and another ...
0
votes
1answer
321 views

LSTM for prediction of next location step - help with standardization

I have a few questions regarding the topic and I hope someone might have experience with any of them. What I am trying to do is train an LSTM network, whose input is a sequence of N steps in a XYZ ...
0
votes
2answers
941 views

Multivariate LSTM RMSE value is getting very high

I want to predict a time series with multiple variables. I am using Keras's LSTM class. Here is my data set description : I want to predict var1(t-1) and my X variables are var3(t-1) , var4(t-1) , ...
0
votes
1answer
63 views

Information about LTSM RNN backpropagation algorithm

I am attempting to make a LTSM RNN in python from scratch and I have completed the code for forward pass but I am struggling to find a clear outline of the equations I need to calculate to get the ...