Questions tagged [epochs]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
54 views

How can I choose num of epochs and batch size?

I have the coco 2014 dataset and need to train it as training is around 82700 and testing is 40500. However, I got the same sentence with different values every time with ...
1
vote
1answer
19 views

How does epochs related with converging the model?

I have read on Internet that epochs is used to give the time for the model to converge but I don't know how ? . I was thinking that epochs is used because to train the model sufficient times . How ...
0
votes
0answers
34 views

How many epochs should all the data be trained on after training with validation finds when validation and training diverge?

One uses and train/test split to use their training data to get an idea of how many epochs to train with. If the validation accuracy starts going down while the training accuracy is still going up, ...
0
votes
0answers
63 views

Implementing Connectivity: “IndexError: too many indices for array: array is 3-dimensional, but 4 were indexed”

I am trying to implement connectivity as a feature within my code, but am unsure of how to fix this error code. Here is my code up until the point of the error. ...
0
votes
0answers
21 views

Why do we do small number of iterations per epoch and large number of epochs rather than one epoch iterate on entire batch until small gradient?

Why do we do many epochs and one iteration per epoch rather than one epoch and iterate while gradient is not within tolerance in Keras deep learning or by default?
0
votes
1answer
211 views

How to specify steps_per_epoch and validation steps on infinite dataset?

I have a huge csv dataset with a size of 200 GB. I'm using CsvDataset to make dataset generator for loading data from the disk while training the model. I want all the data to be passed on each epoch. ...
0
votes
0answers
18 views

Sudden drop in loss at epoch start, then gradual raise

I'm building an autoencoder for natural language words. The question: Why do I see at the start of each epoch a sudden drop in the loss and then gradual bounce back (loss raises but slowly) followed ...
0
votes
1answer
19 views

How to interpret this Plot of Model Loss from a BiLSTM model?

Hi everyone, the above graph is produced by a BiLSTM model i just trained and tested. I can't seem to interpret it while it is very different from the references that i acquired by googling online. ...
0
votes
1answer
576 views

How to train the model with for loop instead of the built-in epochs

i want to use a for loop for epochs instead of the built-in ones. Does these parts are similar. 1) ...
0
votes
0answers
14 views

When the generator fit calls the “fit_generator” function that i've created

To understand better how the fit generation works I want to know if the "fit generation function" is called only once per epoch (And in each epoch is trining to minimize the gradient of a ...
3
votes
2answers
1k views

Scikit learn linear regression - learning rate and epoch adjustment

I am trying to learn linear regression using ordinary least squares and gradient descent from scratch. I read the documentation for the Scikit learn function and I do not see a means to adjust the ...
0
votes
1answer
31 views

Does training of neural networks follow the same order in each epoch?

Each epoch uses the weight from the end of the previous epoch(correct me if I am wrong). Is the updating of parameters after each batch always in the same order? To rephrase, are the batches always in ...
1
vote
2answers
2k views

Opinions on an LSTM hyper-parameter tuning process I am using

I am training an LSTM to predict a price chart. I am using Bayesian optimization to speed things slightly since I have a large number of hyperparameters and only my CPU as a resource. Making 100 ...
2
votes
3answers
547 views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
0
votes
0answers
78 views

'loss: nan' during training of Neural Network in python

I am training a neural network in python. But the accuracy is very low. ...
2
votes
2answers
2k views

How can I tune LSTM hyperparameters?

If anyone is there to answer these, that'll be great. I'm in the midst of a Final Year Project on LSTM. Currently, I’m stuck and confused over LSTM codes. There are 4 hyperparameters that I can play ...
0
votes
2answers
513 views

Epochs or Loss Convergence

I was training a Deep Neural Network using transfer learning and the loss value as of now is close to 1.7. I am using a dataset of 31,000 images and I do apply data augmentation techniques to help the ...
6
votes
3answers
5k views

How to combine GridSearchCV with Early Stopping?

I'm a beginner in machine learning and want to train a CNN (for image recognition) with optimized hyperparameter like dropout rate, learning rate and number of epochs. The optimal hyperparameter I ...
1
vote
1answer
33 views

How would keras model learn at every epoch?

I know concept of Epochs, batch size and iteration. let's say, Total_data = 6400 Batch_size = 64 Iteration = 100 In this, basically we are taking in 64 data points to computer memory and ...
3
votes
1answer
131 views

How to get the number of steps until a certain accuracy in keras?

I want to see how many steps does it take for my model to reach a certain accuracy.Say 90 percent on cifar10.How can I get this info from the keras model ? EDIT: accuracy in each epoch is accessible ...
0
votes
1answer
58 views

How to find learning rate decay?

Given the number of epochs, batch size and learning rate, is there a formula by which I can calculate the learning rate decay in mini batch SGD?
30
votes
5answers
39k views

What to set in steps_per_epoch in Keras' fit_generator?

I am replicating, in Keras, the work of a paper where I know the values of epoch and batch_size. Since the dataset is quite ...
1
vote
1answer
142 views

what exactly happens during each epoch in neural network training

Across different epochs, which of the following is/are updated? initial weights (initial ConvNet filter matrices, initial fully connected weights) hyper parameters: number of ConvNet filters, size ...
0
votes
1answer
242 views

Difference between “reducing batch_size” and “increasing epochs” to decrease loss amount?

In my experience, both reducing batch_size and increasing epochs can decrease loss amount. But I like to know is there any ...
2
votes
1answer
146 views

What is the difference? “Adding more LSTM layers” or “Increasing epochs”?

To get more accurate results which one is better? Adding more layers or increasing number of epochs? I like to know the difference between effects of these two approaches?
1
vote
1answer
492 views

Computing number of batches in one epoch

I have been reading through Stanford's code examples for their Deep Learning course, and I see that they have computed ...
1
vote
1answer
1k views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
7
votes
2answers
2k views

Keras Fit Generator Function

I want to know if my thinking is correct? Total Images = 120,000 So in the Keras Fit Generator function, I made the batch_size = 24 and steps per epoch = 500 ,which is 12000 and only one-tenth of ...
1
vote
1answer
196 views

How to interpret a drastic accuracy loss while training a neuronal net (CNN)?

How can one interpret a drastic accuracy loss after ~38 epochs? Maybe more dropout should be added to the CNN network? (x-axis shows the number of epochs)
1
vote
1answer
4k views

Early stopping and final Loss or weights of models

In a deep model, I used the Early stopping technique as below in Keras: ...
1
vote
2answers
222 views

What is the logic of the epoch?

What is the logic of the epoch? For example, 1 time, 2 times, etc. I just do not know what else is working to give better results than I know.
1
vote
0answers
31 views

If an NMT dataset is artificially enlarged by splitting sequences up, should it still train for the same number of epochs?

I have a neural machine translation dataset that looks something like this (letters represent words in an input sentence): ...
2
votes
4answers
1k views

Is it better to optimize hyperparameters or run multiple epochs?

Whenever I train a neural network I only have it go through a few epochs ( 1 to 3). This is because I am training them on a bad CPU and it would take some time to have the neural network go though ...
2
votes
1answer
84 views

How to determine the number of forward and backward passes in deep learning (CNN)? [closed]

Is there a way to determine the number of forward and backward passes in the training of a neural network using python?