Questions tagged [gru]
The gru tag has no usage guidance.
20
questions
0
votes
0answers
3 views
When training on a paragraph containing large number of words,does GRU end up predicting repeated outputs
Is it correct,that if we train GRUs on paragraphs containing a large number of words(say 10,000),then the GRU will end up predicting repeated outputs or in worst case,the predicted output will not ...
0
votes
0answers
18 views
multivariate biLSTM text classification
I have made a model that takes vacancy data and classifies it with (bi)LSTM. The variables of the initial dataset are: positiontitle ...
0
votes
0answers
61 views
Embedding a categorical variable and concatenating with a numerical variable, in a many-to-one sequence problem with multiple features
I have a small data set where I track 4 variables across 4 time periods, 1 categorical and 1 numerical variable. Below is picture of data set that I am using:
cat1 - Categorical variable encoded
num1 ...
0
votes
0answers
38 views
GRU - why gamma is close to 0 or 1 resolves the vanishing gradient problem?
Background
It is explained that in GRU (Gated Recurrent Unit), the gate value $\Gamma$ close to zero mitigates the vanishing gradient problem.
Coursera Sequence Model by Andrew Ng - Week 1 Gated ...
0
votes
0answers
45 views
Pytorch: Reduce forward prediction dimensions of GRU network / Improving Network Architecture
I am currently working on a GRU network to predict a time series, please note that I am completely new to machine learning and pytorch. Also I have never had a formal education in programming. This ...
0
votes
3answers
120 views
Converting a speech recognition model from CNNs to GRUs
I am trying to convert the simple audio recognition example from TensorFlow to use GRUs instead of CNNs.
The idea is to classify an audio clip onto a set of 8 labels: ...
0
votes
1answer
53 views
How is the hidden state of a GRU initialized
This is a GRU. Now, what will be the value of $h_t$, at $t$=$0$. That is, what will be the value of the hidden state at just the starting?
0
votes
1answer
62 views
Why is the variance of my model predictions much smaller than the training data?
I trained a GRU model on some data and then created a bunch of predictions on a test set.
The predictions are really bad, as indicated by a near zero R2 score.
I notice that the variance of the model ...
0
votes
1answer
43 views
LSTM / GRU weights during test time
I am working on a historic time series dataset and using RNN, LSTM, GRU models, and I didn't find an answer if in test time, the h (or h, c) weights should be zeors for each batch?
If the weights ...
2
votes
1answer
29 views
GRU and LSTM does not "take risk" predicting
I tested LSTM and GRU models to predict the exchange rate between currencies. I do not take the raw price but a the delta with the previous day, so the data is stationnary around zero.
My problem is ...
2
votes
0answers
154 views
Custom GRU With 3D Spatial Convolution Layer In Keras
I am trying to implement a custom GRU model that is shown in this paper 3D-R2N2 The GRU pipeline looks like:
The original implementation is theano based and I am trying to apply the model in tf2/...
1
vote
1answer
984 views
How to add a Decoder & Attention Layer to Bidirectional Encoder with tensorflow 2.0
I am a beginner in machine learning and I'm trying to create a spelling correction model that spell checks for a small amount of vocab (approximately 1000 phrases). Currently, I am refering to the ...
1
vote
0answers
59 views
LSTM / GRU prediction with hidden state?
I am trying to predict a value based on time series by series of 24 periods (the 25th period)
While training I have a validation set with I babysit the training (RMSE) and each epoch, eval the ...
1
vote
1answer
185 views
Using GRU with FeedForward layers in Python
I'm trying to reproduce the codes in this paper here for the multi-labeling problem (11 classes), which is using
...
1
vote
1answer
129 views
Keras RNN (batch_size
I created an RNN model for text classification with the LSTM layer, but when I put the batch_size in the fit method, my model trained on the whole batch instead of just the mini-batch _size.
This also ...
6
votes
1answer
3k views
TensorFlow / Keras: What is stateful = True in LSTM layers?
Could you elaborate on this argument? I found the brief explanation from the docs unsatisfying:
stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will ...
2
votes
1answer
339 views
Impact of varying sequence length in ensemble GRU model
I am using ensemble gru for my project and keeping different cell sizes for different models !For example, first gru model is of size 16 and the second is of 8 and 4 for the third model.
The model is ...
2
votes
0answers
32 views
Wiggle in the initial part of an LSTM prediction
I working on using LSTMs and GRUs to make time series predictions. For the most part the predictions are pretty good.
However, there seems to be a wiggle (or initial up-then-down) before the ...
2
votes
0answers
59 views
GRU learns small-scale features, but misses large scales
Playing around with weather data, I have set up a simple RNN with one layer of GRUs. It is trained to recover the temperature of the next day, given weather data of the last 5 days, each with 1-hour ...
160
votes
6answers
151k views
When to use GRU over LSTM?
The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates).
Why do we make use of GRU ...
