Questions tagged [lstm]
LSTM stands for Long Short-Term Memory. When we use this term most of the time we refer to a recurrent neural network or a block (part) of a bigger network.
660
questions
0
votes
0answers
7 views
non-broadcastable output operand with shape (6594,1) doesn't match the broadcast shape (6594,8) using LSTM in python
I have a data 6594 and I want to predict next future value using LSTM.
When I wrote the code and tried to do scaler inverse of predicting value and then I got this error.
Can anyone help me to solve ...
0
votes
0answers
6 views
Weather Forecasting: CNN-LSTM or ConvLSTM?
I am trying to develop a weather forecast model where satellite images (temperature, velocity field etc) are stacked over time. Since the prediction model needs to analyze both spatial features and ...
0
votes
1answer
16 views
Understanding LSTM Keras implementation
So I understand what LSTM units are. But I have trouble understanding the implementation / function in Keras framework.
Let's say, I add a layer
...
0
votes
0answers
26 views
Adapting Pytorch tutorial “NMT from Scratch…” for dynamic RNN
I have taken the code from the tutorial and attempted to modify it to include bi-directionality and any arbitrary numbers of layers for GRU.
Link to the tutorial which uses uni-directional, single ...
0
votes
0answers
7 views
Bi-Directional LSTM/GRU better than LSTM/GRU?
Is there any research paper or blog post that discusses 'is Bi-Directional LSTM/GRU better than LSTM/GRU' under scenario and data set?
0
votes
0answers
5 views
Effective Time Series Forecasting using Keras/LSTM
I am working on time series forecasting for an engineering component (turbo charger). I have dataset containing field data from sensors (=features) taken every day for different turbocharger for their ...
0
votes
0answers
8 views
chatbot encoder/decoder: why do we need to use chatbot answer as the decoder inputs?
I am looking into the chatbot tutorial at:
https://medium.com/predict/creating-a-chatbot-from-scratch-using-keras-and-tensorflow-59e8fc76be79
It uses sequence to sequence model with encoder/decoder ...
1
vote
1answer
16 views
Time Series Classification for 1 hour blocks
I am doing some analysis on time series.
The time series would consist of 3 channels and contain 5 minute interval data.
What I want is to be able to give it a 1 hour block of 5 minute interval data ...
2
votes
4answers
136 views
What is difference between feed forward neural network and lstm?
What is the difference between feed forward neural network and lstm? How do they differ in their architecture?
0
votes
0answers
20 views
Running LSTM model on a big data sample using pyspark
I was wondering how does one run an LSTM model on a big dataframe in pyspark. Ideally, one wants to run the model parallelly on different nodes of a spark cluster. But how does one do that?
0
votes
0answers
38 views
Combining 2D Detection with Disparity Maps to Learn 3D Object Geometry
Since the disparity map above is a representation of the object's distance from the camera's origin, is it reasonable to assume that a network (perhaps a convolutional LSTM) could be trained to ...
0
votes
1answer
10 views
Intuition behind the RNN/LSTM hidden state?
What's the intuition behind the hidden states of RNN/LSTM? Are they similar to the hidden states of HMM (Hidden Markov Model)? Thanks!
0
votes
0answers
9 views
predict next text/word. HMM or LSTM? Which is better and what's the pro and con of each method?
I am trying to do a prediction of next word given some previous words. Would it be better to use HMM model or LSTM model? What's the pro and con of each method? Are there examples? Thank you!
0
votes
1answer
43 views
'list' object has no attribute 'values' when we are using append in python
Here I have a dataset with three inputs. Here I generated y value using append. After the append I got the output like this:
y.append(rec.iloc[0]['y'])
Then I ...
0
votes
1answer
17 views
TLDR Bot - Sentence Tagging w/ BERT
Currently making a bot that condenses news articles. I'm tagging sentences as important or not important using a simple BERT classifier. The results were... not great. I'm really interested in how I ...
0
votes
0answers
30 views
Continous Learning and Shifting Patterns
I've been intensively studying neural networks which try to predict a vector based on a given input matrix.
The input matrix is a N x H matrix and the output vector a N x 1 vector.
The network is ...
0
votes
0answers
10 views
is it possible to implement LSTM with input shape (sample,timestep,timestep,feature)?
I'm new to Keras. I am trying to implement this model https://www.aclweb.org/anthology/D15-1167 for document classification, and I want to use LSTM for getting sentence representation. I have trained ...
0
votes
0answers
6 views
How to plot the LSTM model
I am using the following simple LSTM model that is implemented using Keras.
...
-1
votes
0answers
20 views
Predicting three next word based on input data using LSTM
I am working on an assignment on next word Prediction. I am trying to create a model which can be used to generate next words based on the input like swift key and gives three options to chose as the ...
1
vote
1answer
27 views
Structure of LSTM gates
It is my impression that a single layer LSTM architecture consists of $t$ LSTM cells that are identical duplicates, where $t$ is the number of time steps. Then there are gates within the LSTM cell. I ...
0
votes
0answers
9 views
FastText and CharEmbedding
i have got a question. i don't understand how to develop my DLModel.
I'm working on DGA Detection with this type of dataset:
...
0
votes
1answer
16 views
LSTM fot text classification always returns the same results
Hello fellow Data Scientists,
I'm trying to make a classifier that was to classify sequences of text into some predefined classes, but i always get the same output, can anyone help me understand why?
...
0
votes
0answers
9 views
How to build Keras Model for Data set which contains both Time_Series Data and other Feature Data?
I have a data set which contains Time Series Data and other features data. Usually we using RNN or any Variant of RNN like LSTM for time series data and simple Dense Layer for features Data. I need to ...
0
votes
0answers
22 views
How to improve model confidence for each category in binary classification problem?
I am new to machine learning and expanding upon an introductory tutorial I followed with some artificial housing data I created. I asked this question on stackoverflow and was referenced to the data ...
0
votes
0answers
17 views
LSTM pulse signal prediction
i'm trying to capture long-term dependencies using LSTM, by creating a unit pulse signal every 62 points.
The idea is to go back 62 time-steps and copy the value for the next time-step, so as to ...
0
votes
0answers
13 views
How many seconds ahead of one paramenter can I try to forcast from the code
I would like to test this code for several (x) seconds of prediction of the output.
How long should the window of the past values in order to x seconds in the future of one value being known all the ...
0
votes
1answer
32 views
Using LSTM for multi label classification
I am trying to use LSTMs to train and predict authors using reviews data and metadata
...
2
votes
1answer
27 views
transform a supervised neural network to reinforcement learning?
I have a functional LSTM model that works with an acceptable performance. How can I now convert this supervised model to a reinforcement learning model for improving the performane? Is there any ...
0
votes
1answer
25 views
LSTM - Incorporate word embedding in layer with multiple records in same date
I have a time series data having more than one record in a single date. Number of records in a single date is not consistent.
I have 3 input features namely phrase, cost and weight. My goal is to ...
0
votes
1answer
23 views
How can I explain the cause of different performances for two different LSTM models and improve the performance?
I've built two different models for Load Forecasting. Dataset has six features. The performance evaluation metric is the Mean Absolute Percentage Error(MAPE). Both models are based on LSTM. Here is ...
1
vote
0answers
8 views
How to create a seq2seq without specifying a fixed decoder length?
Based on the model presented in this answer:
...
0
votes
0answers
14 views
High Level Discussion: Generate synthetic sensor data using data from surrounding sensors
Let's assume I have readings coming from sensors. For every sensor, I have the following information:
all the data it reads
its location
Now, given an arbitrary sensor at an arbitrary location ...
1
vote
1answer
27 views
Language modelling for Spell Checker
I am working on spell checkers, I want to create a spell checker, I am confused about which model to use
Word-Level modelling
Character-Level modelling
plus I am preferring neural networks over ...
1
vote
1answer
27 views
Error on custom RNN/LSTM with multiple inputs
I want to implement a custom RNN/LSTM model similar to this. The model should take two separate vectors as input and process them. I was following keras tutorial to implement a custom keras layer and ...
1
vote
0answers
31 views
Pytorch lstm model very high loss in eval mode against train mode
I am using a Siamese network with a 2-layer lstm encoder and dropout=0.5 to classify string similarity.
For each batch, I am randomly generating similar and ...
0
votes
1answer
20 views
Connection between Embedding and LSTM and Dense layer
I am building a "predict next word" model using the following model architecture. The codes fine, but I have a few questions:
...
0
votes
1answer
45 views
ReLU for combating the problem of vanishing gradient in RNN?
For solving the problem of vanishing gradients in feedforward neural networks, ReLU activation function can be used.
When we talk about solving the vanishing gradient problem in RNN, we use a more ...
-1
votes
2answers
51 views
LSTM to predict Sin(x) from x
Hi I want to pass a series of values x1, x2... as input to the model to predict y1 = sin(x1), y2 = sin(x2)...
-I created dataset: x=[0.1,0.2,...] and y=[sin(0.1),sin(0.2),...]
-I normalize x in [0,1]...
2
votes
1answer
126 views
Running out of memory when training Keras LSTM model for binary classification on image sequences
I'm trying to come up with a Keras model based on LSTM layers that would do binary classification on image sequences.
The input data has the following shape: ...
0
votes
1answer
26 views
The loss and accuracy of this LSTM both drop to nearly 0 at the same epoch
I'm trying to train an LSTM to predict the the Nth token using the N-1 tokens preceding it
For each One-Hot encoded token, I ...
0
votes
0answers
25 views
Spatial and temporal information processing together (CNN and LSTM)
I have small problem that requires to process both spatial and temporal information.
I need to predict vehicle's trajectory based on previous trajectory information and map information. My current ...
2
votes
1answer
113 views
Autoencoders for the compression of time series
I am trying to use autoencoder (simple, convolutional, LSTM) to compress time series.
Here are the models I tried.
Simple autoencoder:
...
0
votes
1answer
20 views
How can I build a seq2seq model , which is topic aware
I have developed a chatbot, which is basically a seq2seq LSTM network. Which can generate text based on input text. But the problem I am having right now is it is not topic aware.
As an example :
...
4
votes
1answer
119 views
Forecasting via LSTM or XGBoost… is it really a forecast or
I guess I understand the idea of predictions made via LSTM or XGBoost models, but want to reach out to the community to confirm my thoughts.
This tutorial does a nice job explaining step by step of ...
2
votes
0answers
21 views
How can RNN handle variable sized inputs?
I came across this answer which is specific to Keras. But my question is at concept level. I am getting confused, How can RNN handle variable size inputs?
here
Let us suppose we want to do a ...
0
votes
1answer
27 views
Padding the sentences is consuming huge memory
I prepared a lstm model using tensorflow which has a max_sequence_length of 5000 and I'm padding the small sentences with 0's. I then deployed and tested the model ...
0
votes
2answers
51 views
How to normalize a data set of multiple time series?
I have the a data set representing the electricity consumption of 25 000 customer.
The electricity readings are taken from each smart meter each 15 min for a period of 3 days. The data is takes from ...
3
votes
2answers
68 views
Why can we not split train test data with 0.01 as parameter or 99% training data
Most of the blogs mention about a good thumb rule to be 80-20 split for the train and test respectively.
My special case is a time series dataset and it is for the stock prices, which IMO is very ...
0
votes
2answers
51 views
Using LSTM for binary text Classification, getting almost same accuracy at each epoch
I am doing Twitter sentiment classification. For that I am using LSTM with pretrained 50d GloVe word embeddings(not training them as of now, might do in future).
The tweets are of variable lengths ...
0
votes
1answer
20 views
How to get a output of a hidden layer of a single-layer LSTM
How can get the hidden layer outputs in a simple one-layer lstm?
...
