Questions tagged [lstm]

LSTM stands for Long Short-Term Memory. When we use this term most of the time we refer to a recurrent neural network or a block (part) of a bigger network.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

What kind of Neural Network should I build to classify each instance of a time series sequence?

Let's say, I have the time-series dataset below-left. I would like to train a model in such a way that if I feed the model with an input like below-right, it should be able to classify each sample ...
0
votes
0answers
37 views

Modelling feature interactions in LSTM network

I created a binary model from 28 features, each sequence is 10 samples long. I tried these two models: ...
0
votes
0answers
10 views

Time series forecasting when one of the series is known

I have a problem where there are two time series $\{x_t\}_{t \geq 1}$ and $\{z_t\}_{t \geq 1}$. These two time series are correlated for fixed time instant but uncorrelated with each other across time....
1
vote
0answers
52 views

Which One is the Best Way to Create Training Sequences for LSTM-based Class Prediction on Time-series Data?

Let's say I have time-series data in the following way. I need to create training sequences of a fixed length as an input to my LSTM model on PyTorch. ...
1
vote
1answer
59 views

LSTM for Stock Return Prediction

I am writing my masters thesis and am using LSTMs for daily stock return prediction. So far I am only predicting numerical values but will soon explore a classification style problem and predict ...
0
votes
1answer
352 views

Predicting out-of-sample time points with LSTM

I'm working on a time series forecasting problem using LSTM. The data is univariate and non-stationary. I followed this tutorial. The data is processed as the following: First, the difference between ...
0
votes
0answers
19 views

LSTM long sequences reduction algorithm

suppose I have a large multi-variate TimeSeries dataset with very long sequences (~50k) I want to reduce each sequence size to constant size for LSTM training. I thought about splitting each sequence ...
-1
votes
1answer
57 views

Neural network for time series forecasting with an auxiliary data

Lets say we have 2 data sets. First is the close price time series data set and we want to predict future values of it. The second is volumes of each price from the first data set and we do not want ...
0
votes
1answer
83 views

How to pass a sequence of 4 images into LSTM and CNN-LSTM

I got an assignment and stuck with it while going down the rabbit hole of learning PyTorch, LSTM, and CNN. Provided the well-known MNIST library I take combinations of 4 numbers and per combination, ...
1
vote
0answers
15 views

Time series classification with handcrafted features

I have a dataset with handcrafted statistical features such as follows: ...
2
votes
1answer
174 views

How to present longitudinal data to LSTM for multiclass prediction

I need to implement a deep learning algorithm to predict an ordinal value, called 'Entity', using longitudinal health records data. I read a few articles and guides but I couldn't find a clear ...
0
votes
0answers
29 views

How to Classify Game Stages Based on Bitrate Time Series Data

I need suggestions for my project and would be glad if you would give me a hand. I have a dataset of frames obtained from the old-school game DOOM. Each frame in the dataset has the following columns: ...
0
votes
1answer
181 views

How to improve LSTM accuracy on multiclass text classification?

So, I'm trying to build a LSTM model to classify multiclass text label. The goal is to make a prediction about user rating (1, 2, 3, 4, 5) based on their review. My hyperparameter is like this: ...
0
votes
1answer
147 views

Advantages of CNN vs. LSTM for sequence data like text or log-files

When do you tend to use CNN rather than LSTM (or the other way round) in classification or generation tasks of sequential data like text or log-data? What are the reasons for the decision and what ...
0
votes
0answers
80 views

LSTM with multiple entries for the same timestamp

I have a dataset where I have multiple entries for the same timestamp and I want to use LSTM to forecast the next timestamp given the previous 5 timesteps. From https://machinelearningmastery.com/...
0
votes
0answers
130 views

Pytorch: how to pass the hidden state between the samples in LSTM?

I am trying to boost the performance of a object detection task with sequential information, using ConvLSTM. A typical ConvLSTM model takes a 5D tensor with shape ...
0
votes
1answer
70 views

Problems with Concatenating Embedded Categorical and Numerical variables for LSTM use

I am new to here and new to Deep Learning too, so apologies in advance for any ill formatted code or wordings. I have a data set where I track 4 variables with 2 categorical and 3 numerical fields, ...
1
vote
0answers
23 views

Bidirectional LSTM usage with sensor data

I am applying a deep LSTM network in order to classify time-series data from different sensors. In the field (energy) I often see the research using bidirectional LSTMs for forecasting. I don't get it ...
0
votes
1answer
52 views

Set seed for a Class that calls Keras Models

I have class that I use to optimize parameters of a Keras LSTM model. It is known that to set seed for keras, one must input the follow on its code. But what I'm not understanding is where to put it ...
2
votes
0answers
18 views

How to modify a Convolutional Neural Network architecture built for a univariate time series to multivariate time series?

I have built a CNN (in combination with a LSTM cell) that takes 1D time series-like data as an input and performs classification. I am obtaining a good performance, but the complete data has actually ...
0
votes
0answers
22 views

Does a 3-D input shape (time series with features) to an LSTM Model Evaluate the Label at each Time Step?

I have a problem similar to the one posed in this video: https://www.youtube.com/watch?v=flMCYqIn3eg In that video, she had a set of data on a number of individual debtors and needed to find out if ...
0
votes
0answers
15 views

Can LSTM be used to predict value as regression problem?

I have time-series data as shown below. Which model is generally preferred if grig_id is needed to be predicted? Is it possible to use LSTM with a sigmoid ...
1
vote
1answer
27 views

Semantic analysis score as input to LSTM model for improving stock price prediction accuracy [closed]

I have created a univariate LSTM model that is predicting value of Open Price based on last 5 years opening price of a particular stock. I'm getting a decent accuracy. Now, I want to do sentiment ...
0
votes
0answers
25 views

PyTorch LSTM with varying time steps

Is it possible to create an LSTM in PyTorch where the time steps are varying? For example, heights where measurements are taken at various times. The data might look like this: Person id Inches tall ...
0
votes
1answer
660 views

Sentence embeddings with LSTM to classify the sentences is not working

I am trying to build LSTM NN to classify the sentences. I have seen many examples where sentences are converted to word vectors using glove, word2Vec and so on here is an example of it. This solution ...
0
votes
0answers
15 views

Treating Null Degrees of an Angle

I have a dataset that measures the flight details of objects, based on what action was performed. It looks similar to below: ...
1
vote
1answer
19 views

How can I convert my predictions to text after predicting using RNN?

I'm building PoS tagger for our language. I give tokens to the words and tags using Tokenizer(). Functions for word and tag are different. ...
2
votes
0answers
44 views

Determining Confidence Probabilities for Distribution

I have a LSTM neural network that predicts the number of items required in each room for the next time step. So for example for room A, B, C and D the model predicts A -> 3 items B -> 4 items C ...
2
votes
0answers
49 views

Time series forecasting. How use future values

I have a time series dataset containing hourly data from a few year, like below. Let's assume that I want to make prediction for the next 3 hours (2021-01-01 19:00, 2021-01-01 20:00, 2021-01-01 21:00)....
1
vote
0answers
48 views

Padding before or after truncation for stateful LSTM in Keras

I am training an LSTM on a dataset with variable timesteps (between 10 and 6000). Using the truncated backpropagation through time (TBPTT) technique, I am truncating the sequences to windows of 128 ...
0
votes
1answer
18 views

Correct LSTM model to predict shuffled data

For a year I've been collecting data from my RPi: [0 core load, 1 core load, 2 core load, 3 core load, environment temperature, fan speed, CPU temperature] Now I ...
0
votes
1answer
252 views

Help improving time series prediction with LSTM on PyTorch

So, I am trying to use a LSTM model to forecast temperature data on PyTorch. I am relatively new to both PyTorch and the use of recurrent networks so I took a model I found on the internet to start. ...
0
votes
0answers
24 views

What is learnt by a model having multiple LSTM layers, each getting a slice of the same input data?

I came across the following architecture: - Generation of training and testing data ...
0
votes
0answers
35 views

Output of a network to it's input, keras

I'm trying to create a neural network in keras for time series forecast. I've build a concept, and now I'm not quite sure if it is possible to implement using keras. I have a potentially complicated ...
0
votes
0answers
11 views

What is the encoders job and how does it do that LSTM

I am studying LSTM-RNNs and ran into a problem! I am not sure what exactly the Encoder's job is, or better: how he does it? I know that the Encoder is transforming the input in a way, that the Decoder ...
0
votes
0answers
13 views

One LSTM for two currencies or two LSTM one for each currency?

Suppose I am building an LSTM model for currency forecasting. Assume that I am working on two rates: USD vs GBP and USD vs EUR. Should I build one LSTM model with input size of two features (GBP and ...
0
votes
1answer
19 views

Is LSTM or pretrained BERTForMasked LM usable for predicting changed word in a sentence using a small dataset? (2000 samples)

I have a small (2000 samples) dataset of newspaper headlines and their humorous conterparts where only one word is changed to sound silly, for example: Original headline: Police <officer> ...
0
votes
0answers
26 views

LSTM Train accuracy decreases in training time during the epoch

I'm training an LSTM model for sentiment analysis on a text corpus. There's a thing that I believe is not normal because I never have seen it in training my models. At the start of the epoch, the ...
0
votes
1answer
92 views

What is the input of LSTM network?

Hello I am trying to understand LSTMs but have a few problems: What is the input? Since LSTM is seq2seq I would think it is a sequence of words, but in a Codecademy lesson is mentioned that each ...
1
vote
0answers
8 views

why would you mask out padded activations from the training loss?

I've followed taming-lstm for training a LSTM model on a NLP task in batches with various sentence lengths. One of his main points is: Trick 3: Mask out network outputs we don’t want to consider in ...
0
votes
0answers
18 views

transformers require a large d_model even when the input cardinality is low?

I'm training a transformer encoder for an NLP task over character data, so the cardinality of my input is 26. I've noticed that if I want to create a strong model, I need make $x$ == my embedding ...
0
votes
0answers
71 views

Trying to input a list of strings into my LSTM model

I'm training a model for dialogue act classification. I'm trying to write it so that I can enter a singular list of strings and receive a prediction for each of the strings. I've come to understand ...
1
vote
1answer
124 views

How to Prepare data for LSTM

I'm having difficulties to wrap my head around how I can prepare my dataset to train an LSTM. Below is a screenshot of a subset representation of my dataset. There are several other feature not ...
1
vote
0answers
28 views

How to visualize ner dataset tagged using BILOU?

I have a dataset for ner which is tagged using BILOU tagging method and example of same is below ...
2
votes
1answer
129 views

Timeseries LSTM: does test data need to come after training data?

I have one single, very long time series. I want to train an LSTM to distinguish between two behaviours (A or B) at every timestep (sequence-to-sequence). Because the time series is very long, I plan ...
0
votes
0answers
25 views

How to make an lstm ensemble with different input shapes using keras

This is what I got so far for making an lstm ensemble with one model input for each of the lstm models and for the ensemble model and it works perfectly. ...
0
votes
0answers
18 views
1
vote
1answer
67 views

which Model to apply on panel data where unique id has 6-8 records and total records are 2,000,000?

I am new to such panel data where I have multiple observation for same ID in different Quarter and I am not sure what kind of machine learning algorithm I can apply. I have data from Q1-18 till Q4-...
0
votes
1answer
25 views

Performing anomalie detection on a battery volatge using LSTM-RNN

I am trying to detect anomalies in a battery output voltage for one month. I have the next data frame, as it is shown the data is collected each minute for each day so I have almost 1420 sample per ...
0
votes
1answer
67 views

Regression with LSTM network: use multiple time series as input

I've spent a few days on this and am starting to think I'm missing the obvious solution as this doesn't seem like a very uncommon problem. As an example dataset: I have 100 measurements with each a ...

1 2 3
4
5
21