Questions tagged [gru]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
14 views

Sending rolling statistics to RNN

I'm curious if anyone has seen cases where sending rolling statistics such as mean, median, min, max, standard deviation, skewness, kurtosis, etc. have been helpful for model accuracy? If so please ...
noNameTed's user avatar
0 votes
0 answers
16 views

Finding a template RNN for time series analysis

I would like to create a RNN, that uses one (A) or several time series (with the same length, A, B, C...) as an input and creates another time series (Z) as an output from that . Basically all time ...
xlaub's user avatar
  • 1
0 votes
0 answers
10 views

Use unclassified texts to improve BERT and RNN GRUN token classification model

I have a training (gold) labelled dataset than consists of 10000 sentences. The task is to create a model that classifies correctly unseen data with B-I-O tags. I have used a BERT and a GRU RNN model. ...
Spyros Triantsfyllou's user avatar
0 votes
0 answers
18 views

GRU as a Classifier

Hello Data Scientists, I have sensor data dataset consists of (10 features and labels), the labels classify the data to (normal or 4 type of attacks). The Label is encoded (0,1,2,3,4). There is a ...
Sarah 's user avatar
0 votes
1 answer
413 views

How can I convert a numpy array of tensors to tensor of tensors?

It is my first GRU model so pardon the stupidity. I am trying to learn by training a simple GRU network on variable length sequences. The sequences are numpy arrays of tensors. The length of numpy ...
Ayush Gupta's user avatar
0 votes
0 answers
8 views

Is this GRU learning good?

Result seems to be a little out of "expected" values. It's timeseries dataset.
Paul Paku's user avatar
  • 101
0 votes
1 answer
215 views

Why are the hidden states of an RNN initialised every epoch instead of every batch?

Why are the hidden states of RNNs/LSTMs/GRUs generally re-initialised only once an epoch has finished, not once a batch has finished?
postnubilaphoebus's user avatar
0 votes
0 answers
50 views

How do I implement recurrent activations for LSTM/GRU cells in Pytorch?

Although Tensorflow has simple parameters with which I can initialize the recurrent activation of a GRU or LSTM cell, Pytorch does not. What is the best way to add recurrent activation in pytorch? <...
Robin van Hoorn's user avatar
2 votes
0 answers
74 views

TF: What is the difference between the 'kernel weights' and the 'recurrent kernel weights' in LSTMs/GRUs?

Context: I am trying to understand the differences between the GRU/LSTM cells from tensorflow and pytorch (for research reproducibility) and noticed that TensorFlow differentiates between the ...
Robin van Hoorn's user avatar
0 votes
0 answers
85 views

Why are GRU layer dimensions incompatible using ragged tensor input?

I am attempting to create a sequential model in Keras that accepts a 3-dimensional ragged tensor as an input, creates an embedding, and feeds into a GRU layer. While I can get the model to accept the ...
saganaga's user avatar
0 votes
0 answers
19 views

Do linear layer after GRU saved the sequence output order?

I'm dealing with the following senario: My input has the shape of: [batch_size, input_sequence_length, input_features] where: input_sequence_length = 10 ...
user3668129's user avatar
0 votes
0 answers
7 views

training a recurrent mode to learn a transition function

I have recently started using recurrent deep learning model. I am not still very familiar how to use them properly. I used "Sequential Neural Models with Stochastic Layers" method to learn ...
Dalek's user avatar
  • 101
0 votes
0 answers
21 views

Is there any benefit to stack multiple GRU one after the other?

I'm working on time series problems. On the web I saw 2 type of models: Models which used one GRU with multiple layers. Models which used multiple ...
user3668129's user avatar
0 votes
0 answers
20 views

model gives similar results to the input rather then target

I have trained a model after finding the best hyperparameters using the keras_tuner library. bellow is my model and the tuning test function (Also range values): <...
ANAS.C's user avatar
  • 101
1 vote
0 answers
32 views

RNN to model DNA sequencing classification

I have a DNA sequence dataset each mapped to a certain class. e,g TCAGCCGAGAGCTCATCGATCGTACGT 2 ATGCAGTGCATCGATCGATCGTAGAAC 3 Where the number after the sequence specifies the type of protein this ...
Juliet Soujbel's user avatar
0 votes
3 answers
226 views

Converting a speech recognition model from CNNs to GRUs

I am trying to convert the simple audio recognition example from TensorFlow to use GRUs instead of CNNs. The idea is to classify an audio clip onto a set of 8 labels: ...
M-V's user avatar
  • 101
0 votes
1 answer
406 views

How is the hidden state of a GRU initialized

This is a GRU. Now, what will be the value of $h_t$, at $t$=$0$. That is, what will be the value of the hidden state at just the starting?
Batman's user avatar
  • 1
0 votes
1 answer
348 views

Why is the variance of my model predictions much smaller than the training data?

I trained a GRU model on some data and then created a bunch of predictions on a test set. The predictions are really bad, as indicated by a near zero R2 score. I notice that the variance of the model ...
eartoolbox's user avatar
0 votes
1 answer
69 views

LSTM / GRU weights during test time

I am working on a historic time series dataset and using RNN, LSTM, GRU models, and I didn't find an answer if in test time, the h (or h, c) weights should be zeors for each batch? If the weights ...
Yuval Asher's user avatar
2 votes
1 answer
39 views

GRU and LSTM does not "take risk" predicting

I tested LSTM and GRU models to predict the exchange rate between currencies. I do not take the raw price but a the delta with the previous day, so the data is stationnary around zero. My problem is ...
alarty's user avatar
  • 21
2 votes
0 answers
240 views

Custom GRU With 3D Spatial Convolution Layer In Keras

I am trying to implement a custom GRU model that is shown in this paper 3D-R2N2 The GRU pipeline looks like: The original implementation is theano based and I am trying to apply the model in tf2/...
b15h0y's user avatar
  • 21
1 vote
1 answer
1k views

How to add a Decoder & Attention Layer to Bidirectional Encoder with tensorflow 2.0

I am a beginner in machine learning and I'm trying to create a spelling correction model that spell checks for a small amount of vocab (approximately 1000 phrases). Currently, I am refering to the ...
Dom's user avatar
  • 11
1 vote
0 answers
86 views

LSTM / GRU prediction with hidden state?

I am trying to predict a value based on time series by series of 24 periods (the 25th period) While training I have a validation set with I babysit the training (RMSE) and each epoch, eval the ...
Yuval Asher's user avatar
1 vote
1 answer
293 views

Using GRU with FeedForward layers in Python

I'm trying to reproduce the codes in this paper here for the multi-labeling problem (11 classes), which is using ...
Zahra Hnn's user avatar
1 vote
1 answer
307 views

Keras RNN (batch_size

I created an RNN model for text classification with the LSTM layer, but when I put the batch_size in the fit method, my model trained on the whole batch instead of just the mini-batch _size. This also ...
cho_uc's user avatar
  • 38
8 votes
1 answer
6k views

TensorFlow / Keras: What is stateful = True in LSTM layers?

Could you elaborate on this argument? I found the brief explanation from the docs unsatisfying: stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will ...
Leevo's user avatar
  • 6,015
2 votes
1 answer
543 views

Impact of varying sequence length in ensemble GRU model

I am using ensemble gru for my project and keeping different cell sizes for different models !For example, first gru model is of size 16 and the second is of 8 and 4 for the third model. The model is ...
Mogambo0001's user avatar
2 votes
0 answers
35 views

Wiggle in the initial part of an LSTM prediction

I working on using LSTMs and GRUs to make time series predictions. For the most part the predictions are pretty good. However, there seems to be a wiggle (or initial up-then-down) before the ...
AGirlHasNoUsername's user avatar
2 votes
0 answers
61 views

GRU learns small-scale features, but misses large scales

Playing around with weather data, I have set up a simple RNN with one layer of GRUs. It is trained to recover the temperature of the next day, given weather data of the last 5 days, each with 1-hour ...
rugermini's user avatar
178 votes
6 answers
178k views

When to use GRU over LSTM?

The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates). Why do we make use of GRU ...
Sayali Sonawane's user avatar