Questions tagged [lstm]

LSTM stands for Long Short-Term Memory. When we use this term most of the time we refer to a recurrent neural network or a block (part) of a bigger network.

491 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
101 views

Whats the difference between add.LSTM(num_hidden, droput=0.5) and add.Dropout(0.5) in Keras?

Could anyone please explain what is the difference between these two cases, specified in the title. I believe I am not the only one who is confused. I have read that it is preferrable to add Dropout ...
0
votes
0answers
60 views

How do I multiple individual time-series data to train a LSTM model?

I have 100 univariate time-series from individual patients measuring glucose levels. Each time-series is ~20k. I need to train my LSTM model using all of the data. I don't think concatenating all ...
0
votes
0answers
178 views

Multivariate supervised LSTM for for regression only (not for prediction)

I am a beginner with machine learning. I want to get a multivariate regression model with LSTM. I followed this tutorial by Jason Brownlee: https://machinelearningmastery.com/multivariate-time-series-...
0
votes
0answers
57 views

Neural Network Architecture to approximate simple function

What neural network architecture would approximate this function? This is monotonically decreasing non negative time series, that has non-stationary mean. $$ q(t) = \frac{qi}{(1+b*D*t)^(\frac{1}{b})}...
0
votes
0answers
24 views

Does someone have a low level inplemenation of tensorflow's ConvLSTM2D

Right now I am using the ConvLSTM2D module of tensorflow and it works. But now I would like to feed an additional input between the convolutional stage and the lstm module. Therefore I would need a ...
0
votes
1answer
168 views

Attention model with seq2seq over sequence

On the official tensorflow page there is one exmple of a decoder (https://www.tensorflow.org/tutorials/text/nmt_with_attention#next_steps): ...
0
votes
1answer
267 views

Multi-class classification with discrete output: Which loss function and activation to choose?

I'm working with a multi-class classification problem, using Keras Sequential models. In my dataset, the output class has one of the following values: ...
0
votes
0answers
291 views

LSTM data preparation with multiple independent observation runs

I'm struggling to wrap my head around how to correctly deal with multiple independent time series observations for training an LSTM. If I simply concatenate my observation runs, then there will be an ...
0
votes
1answer
338 views

Embedding layer before LSTM layer

I am toying around with a clustering and churn prediction framework, cluschurn which they deployed in production at Snap, Inc. In their research paper, paper_link, they use 14 days of user data and ...
0
votes
2answers
268 views

How to feed training set labels into Keras LSTM

I’m implementing an LSTM with Keras and I know that I have to reshape the training dataset in a 3D object. Basically I have a ...
0
votes
3answers
138 views

How to apply a different Loss function to one specific Label?

I got a recurrent neural network in Keras, which classifies on 14 labels. The first label is the most important one and should be predicted with the highest accuracy. The other labels don't have to be ...
0
votes
0answers
113 views

Combining 2D Detection with Disparity Maps to Learn 3D Object Geometry

Since the disparity map above is a representation of the object's distance from the camera's origin, is it reasonable to assume that a network (perhaps a convolutional LSTM) could be trained to ...
0
votes
1answer
125 views

Intuition behind the RNN/LSTM hidden state?

What's the intuition behind the hidden states of RNN/LSTM? Are they similar to the hidden states of HMM (Hidden Markov Model)?
0
votes
0answers
24 views

is it possible to implement LSTM with input shape (sample,timestep,timestep,feature)?

I'm new to Keras. I am trying to implement this model https://www.aclweb.org/anthology/D15-1167 for document classification, and I want to use LSTM for getting sentence representation. I have trained ...
0
votes
1answer
39 views

How can I explain the cause of different performances for two different LSTM models and improve the performance?

I've built two different models for Load Forecasting. Dataset has six features. The performance evaluation metric is the Mean Absolute Percentage Error(MAPE). Both models are based on LSTM. Here is ...
0
votes
0answers
51 views

Spatial and temporal information processing together (CNN and LSTM)

I have small problem that requires to process both spatial and temporal information. I need to predict vehicle's trajectory based on previous trajectory information and map information. My current ...
0
votes
1answer
108 views

How to get a output of a hidden layer of a single-layer LSTM

How can get the hidden layer outputs in a simple one-layer lstm? ...
0
votes
0answers
66 views

LSTM architecture for multivariate time series

For a multivariate time series analysis, which of the following LSTM architectures would work better and why? 1) Having two independent LSTM layers (one for the time series variable and one for the ...
0
votes
1answer
57 views

How to use LSTM for time series data?

I've an ECG data spread over time. The duration for each data is around 3 minutes (approx 180 seconds). Each second around 200 recordings were taken. So total length for each sample is approx 36000. ...
0
votes
0answers
49 views

LSTM model for many time series

Let's say one has many time series for which one wants to build a predictive model (based on LSTM). Which of the following cases would be more optimal and why? 1) building one model for all the time ...
0
votes
0answers
5k views

cannot reshape array of size 4 into shape (4,3)

I have a dataset with three inputs X1,X2,X3. I tried to predict next value of X1 using lstm . I wrote the code for lstm and while trying model.predict I got an error ...
0
votes
0answers
803 views

Timestamp sequence classification

I am trying to classify a series of timestamps using RNN with LSTM. The data consists of timing information extracted from the uplink packets recorded during a website fetch. The dataset contains 100 ...
0
votes
0answers
43 views

Error when checking input while running the LSTM model using panda python

I have a data set include with temperature, humidity and wind. Here I want to predict future temperature value in next hour. I used LSTM to predict future temperature value. But when I run the model ...
0
votes
2answers
813 views

Which performs better in time series forecasting, LSTM or SVR?

I have run LSTM and SVR models on various datasets having sample values in the range of 1-4000 and the MAPE obtained in SVR was consistently lesser than that obtained through LSTM. I was told the ...
0
votes
2answers
231 views

Keras input for multivariate classification with LSTM using current features and previous timesteps features and y values

I am working on a multivariate binary classification problem. What I want to do is to predict a binary classification given the features at the current timestep and the data (features+real ...
0
votes
2answers
63 views

Understanding Layers in Recurrent Neural Networks for NLP

In convolution neural networks, we have a concept that inner layers learn fine features like lines and edges, while outer layers learn more complex shapes. Do we have any such understanding for ...
0
votes
0answers
48 views

Choosing loss function in Keras for prediction binary_crossentropy or categorical_crossentropy

What loss function in keras should I chose for binary_crossentropy or categorical_crossentropy? I have data like : $w1,w2,w3,w2,w2,w1,w3,w5,w9,w5,w4...$ I want to predict sequence: input: $w1,w2,w3$...
0
votes
0answers
62 views

Duplicate QUORA question detection:Kaggle Dataset

I have tried to use 2 BILSTMs along with the attention layer but the validation accuracy is not improving at all. Could anyone suggest an alternative to increase the accuracy? Layer structuring: ...
0
votes
2answers
313 views

Error: keras merge LSTM layers in sum mode

I want to merge two sequential models in sum mode into one model using keras as: ...
0
votes
1answer
359 views

LSTM - How to prepare train from a dataset which contains multiple observations for different events

I m using LSTM in a project related to MobiFall dataset which contains falls and daily activitives - such as walking, sitting etc - sensed by accelerometer, gyroscope and orientation sensors in x,y,z ...
0
votes
1answer
216 views

Keras LSTM model not performant

I have trained a LSTM model to detect fake domain names. My dataset is like this: domain,fake google, 0 bezqcuoqzcjloc,1 ... with 50% normal and 50% fake ...
0
votes
1answer
247 views

Process mining with ML

I have a little more general question. My dataset consists of N sequences of events. Example of one sequence could be [A,B,C,D,X,Y] and another [A,B,Z], where letters represent different events. The ...
0
votes
1answer
862 views

Understanding dimensions of Keras LSTM target

I'm learning about Keras and LSTMs and came across this tutorial, but I don't understand the dimensions of the target variable. Quoting the article below: The training y data in this case is the ...
0
votes
1answer
81 views

Encoder-Decoder performance time

I have two encoder-decoder models. *First model: *Second model: When I check the performance of the models I get approximately the same performance time (First model ~ 42 sec, Second model ~ 40 ...
0
votes
0answers
18 views

ANN algorithm for system selection

I have a dataset of computer systems with system characteristics as parameters. I want to rank best systems based on these parameters. The system works on a recurrent neural network model with the ...
0
votes
1answer
2k views

LSTM with multiple entries per time step

I have a dataset with sales numbers for around 100 related products. Every day, the number of sales of each product is recorded along with other relevant information (what day of the week is it, is it ...
0
votes
1answer
29 views

ML algorithm for high dimensional time series forecasting

I'm trying to make a forecasting model for goods prices in an economy (trying to forecast inflation). Dataset: has 300 goods prices % monthly variations for last 6 years. And also added $n$ ...
0
votes
1answer
21 views

How to detect time for the future events in time series data?

I am dealing with IOT data from a mechanical machine. On the input I have ~100 features that are measured every minute. On the output, I have labels of zeros and ones, where zero indicates the absence ...
-1
votes
1answer
46 views

Algorithm for Multivariable timeseries prediction (COVID forecast)

I am trying to forecast tomorrow's COVID-19 cases in my country. I tried a simple Linear Regression implementation based on the "new_positives" field but it does not work very well. I had ...
-1
votes
1answer
115 views

Can a machine learning model be trained on Call Detail Record(CDR) Data to predict user's daily locations?

I have a CDR data for two months and my goal is to extract daily or frequent locations(cell towers) of the user along with the departure and arrival time on those locations. The spatial resolution of ...
-1
votes
2answers
594 views

LSTM to predict Sin(x) from x

I would like to pass a series of values $x_1, x_2...$ as input to the model to predict $y_1 = sin(x_1), y_2 = sin(x_2)...$ -I created dataset: $x=[0.1,0.2,...]$ and $y=[sin(0.1),sin(0.2),...]$ -I ...

1
6 7 8 9
10