Questions tagged [gru]
The gru tag has no usage guidance.
30
questions
0
votes
0
answers
14
views
Sending rolling statistics to RNN
I'm curious if anyone has seen cases where sending rolling statistics such as mean, median, min, max, standard deviation, skewness, kurtosis, etc. have been helpful for model accuracy?
If so please ...
- 21
0
votes
0
answers
16
views
Finding a template RNN for time series analysis
I would like to create a RNN, that uses one (A) or several time series (with the same length, A, B, C...) as an input and creates another time series (Z) as an output from that .
Basically all time ...
- 1
0
votes
0
answers
10
views
Use unclassified texts to improve BERT and RNN GRUN token classification model
I have a training (gold) labelled dataset than consists of 10000 sentences. The task is to create a model that classifies correctly unseen data with B-I-O tags.
I have used a BERT and a GRU RNN model.
...
0
votes
0
answers
18
views
GRU as a Classifier
Hello Data Scientists,
I have sensor data dataset consists of (10 features and labels), the labels classify the data to (normal or 4 type of attacks). The Label is encoded (0,1,2,3,4). There is a ...
- 1
0
votes
1
answer
413
views
How can I convert a numpy array of tensors to tensor of tensors?
It is my first GRU model so pardon the stupidity. I am trying to learn by training a simple GRU network on variable length sequences. The sequences are numpy arrays of tensors. The length of numpy ...
0
votes
0
answers
8
views
Is this GRU learning good?
Result seems to be a little out of "expected" values.
It's timeseries dataset.
- 101
0
votes
1
answer
215
views
Why are the hidden states of an RNN initialised every epoch instead of every batch?
Why are the hidden states of RNNs/LSTMs/GRUs generally re-initialised only once an epoch has finished, not once a batch has finished?
0
votes
0
answers
50
views
How do I implement recurrent activations for LSTM/GRU cells in Pytorch?
Although Tensorflow has simple parameters with which I can initialize the recurrent activation of a GRU or LSTM cell, Pytorch does not.
What is the best way to add recurrent activation in pytorch?
<...
- 164
2
votes
0
answers
74
views
TF: What is the difference between the 'kernel weights' and the 'recurrent kernel weights' in LSTMs/GRUs?
Context:
I am trying to understand the differences between the GRU/LSTM cells from tensorflow and pytorch (for research reproducibility) and noticed that TensorFlow differentiates between the ...
- 164
0
votes
0
answers
85
views
Why are GRU layer dimensions incompatible using ragged tensor input?
I am attempting to create a sequential model in Keras that accepts a 3-dimensional ragged tensor as an input, creates an embedding, and feeds into a GRU layer. While I can get the model to accept the ...
- 1
0
votes
0
answers
19
views
Do linear layer after GRU saved the sequence output order?
I'm dealing with the following senario:
My input has the shape of: [batch_size, input_sequence_length, input_features]
where:
input_sequence_length = 10
...
- 363
0
votes
0
answers
7
views
training a recurrent mode to learn a transition function
I have recently started using recurrent deep learning model. I am not still very familiar how to use them properly. I used "Sequential Neural Models with Stochastic Layers" method to learn ...
- 101
0
votes
0
answers
21
views
Is there any benefit to stack multiple GRU one after the other?
I'm working on time series problems.
On the web I saw 2 type of models:
Models which used one GRU with multiple layers.
Models which used multiple ...
- 363
0
votes
0
answers
20
views
model gives similar results to the input rather then target
I have trained a model after finding the best hyperparameters using the keras_tuner library.
bellow is my model and the tuning test function (Also range values):
<...
- 101
1
vote
0
answers
32
views
RNN to model DNA sequencing classification
I have a DNA sequence dataset each mapped to a certain class.
e,g
TCAGCCGAGAGCTCATCGATCGTACGT 2
ATGCAGTGCATCGATCGATCGTAGAAC 3
Where the number after the sequence specifies the type of protein this ...
0
votes
3
answers
226
views
Converting a speech recognition model from CNNs to GRUs
I am trying to convert the simple audio recognition example from TensorFlow to use GRUs instead of CNNs.
The idea is to classify an audio clip onto a set of 8 labels: ...
- 101
0
votes
1
answer
406
views
How is the hidden state of a GRU initialized
This is a GRU. Now, what will be the value of $h_t$, at $t$=$0$. That is, what will be the value of the hidden state at just the starting?
- 1
0
votes
1
answer
348
views
Why is the variance of my model predictions much smaller than the training data?
I trained a GRU model on some data and then created a bunch of predictions on a test set.
The predictions are really bad, as indicated by a near zero R2 score.
I notice that the variance of the model ...
- 101
0
votes
1
answer
69
views
LSTM / GRU weights during test time
I am working on a historic time series dataset and using RNN, LSTM, GRU models, and I didn't find an answer if in test time, the h (or h, c) weights should be zeors for each batch?
If the weights ...
- 11
2
votes
1
answer
39
views
GRU and LSTM does not "take risk" predicting
I tested LSTM and GRU models to predict the exchange rate between currencies. I do not take the raw price but a the delta with the previous day, so the data is stationnary around zero.
My problem is ...
- 21
2
votes
0
answers
240
views
Custom GRU With 3D Spatial Convolution Layer In Keras
I am trying to implement a custom GRU model that is shown in this paper 3D-R2N2 The GRU pipeline looks like:
The original implementation is theano based and I am trying to apply the model in tf2/...
- 21
1
vote
1
answer
1k
views
How to add a Decoder & Attention Layer to Bidirectional Encoder with tensorflow 2.0
I am a beginner in machine learning and I'm trying to create a spelling correction model that spell checks for a small amount of vocab (approximately 1000 phrases). Currently, I am refering to the ...
- 11
1
vote
0
answers
86
views
LSTM / GRU prediction with hidden state?
I am trying to predict a value based on time series by series of 24 periods (the 25th period)
While training I have a validation set with I babysit the training (RMSE) and each epoch, eval the ...
- 11
1
vote
1
answer
293
views
Using GRU with FeedForward layers in Python
I'm trying to reproduce the codes in this paper here for the multi-labeling problem (11 classes), which is using
...
- 23
1
vote
1
answer
307
views
Keras RNN (batch_size
I created an RNN model for text classification with the LSTM layer, but when I put the batch_size in the fit method, my model trained on the whole batch instead of just the mini-batch _size.
This also ...
- 38
8
votes
1
answer
6k
views
TensorFlow / Keras: What is stateful = True in LSTM layers?
Could you elaborate on this argument? I found the brief explanation from the docs unsatisfying:
stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will ...
- 6,015
2
votes
1
answer
543
views
Impact of varying sequence length in ensemble GRU model
I am using ensemble gru for my project and keeping different cell sizes for different models !For example, first gru model is of size 16 and the second is of 8 and 4 for the third model.
The model is ...
- 21
2
votes
0
answers
35
views
Wiggle in the initial part of an LSTM prediction
I working on using LSTMs and GRUs to make time series predictions. For the most part the predictions are pretty good.
However, there seems to be a wiggle (or initial up-then-down) before the ...
2
votes
0
answers
61
views
GRU learns small-scale features, but misses large scales
Playing around with weather data, I have set up a simple RNN with one layer of GRUs. It is trained to recover the temperature of the next day, given weather data of the last 5 days, each with 1-hour ...
- 21
178
votes
6
answers
178k
views
When to use GRU over LSTM?
The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates).
Why do we make use of GRU ...
- 2,021