Questions tagged [epochs]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
2answers
155 views

Opinions on an LSTM hyper-parameter tuning process I am using

I am training an LSTM to predict a price chart. I am using Bayesian optimization to speed things slightly since I have a large number of hyperparameters and only my CPU as a resource. Making 100 ...
1
vote
3answers
58 views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
0
votes
0answers
27 views

'loss: nan' during training of Neural Network in python

I am training a neural network in python. But the accuracy is very low. ...
0
votes
0answers
92 views

Keras: equivalence of `epochs=1000, steps_per_epoch=1` and `epochs=1, steps_per_epoch=1000`

I am training a Keras model on randomly generated data using fit_generator. Except for monitoring purposes, is A: ...
1
vote
1answer
273 views

How can I tune LSTM hyperparameters?

If anyone is there to answer these, that'll be great. I'm in the midst of a Final Year Project on LSTM. Currently, I’m stuck and confused over LSTM codes. There are 4 hyperparameters that I can play ...
0
votes
2answers
54 views

Epochs or Loss Convergence

I was training a Deep Neural Network using transfer learning and the loss value as of now is close to 1.7. I am using a dataset of 31,000 images and I do apply data augmentation techniques to help the ...
2
votes
3answers
2k views

How to combine GridSearchCV with Early Stopping?

I'm a beginner in machine learning and want to train a CNN (for image recognition) with optimized hyperparameter like dropout rate, learning rate and number of epochs. The optimal hyperparameter I ...
1
vote
1answer
19 views

How would keras model learn at every epoch?

I know concept of Epochs, batch size and iteration. let's say, Total_data = 6400 Batch_size = 64 Iteration = 100 In this, basically we are taking in 64 data points to computer memory and ...
2
votes
1answer
39 views

How to get the number of steps until a certain accuracy in keras?

I want to see how many steps does it take for my model to reach a certain accuracy.Say 90 percent on cifar10.How can I get this info from the keras model ? EDIT: accuracy in each epoch is accessible ...
0
votes
1answer
51 views

How to find learning rate decay?

Given the number of epochs, batch size and learning rate, is there a formula by which I can calculate the learning rate decay in mini batch SGD?
18
votes
4answers
20k views

What to set in steps_per_epoch in Keras' fit_generator?

I am replicating, in Keras, the work of a paper where I know the values of epoch and batch_size. Since the dataset is quite ...
1
vote
1answer
72 views

what exactly happens during each epoch in neural network training

Across different epochs, which of the following is/are updated? initial weights (initial ConvNet filter matrices, initial fully connected weights) hyper parameters: number of ConvNet filters, size ...
0
votes
1answer
131 views

Difference between “reducing batch_size” and “increasing epochs” to decrease loss amount?

In my experience, both reducing batch_size and increasing epochs can decrease loss amount. But I like to know is there any ...
2
votes
1answer
59 views

What is the difference? “Adding more LSTM layers” or “Increasing epochs”?

To get more accurate results which one is better? Adding more layers or increasing number of epochs? I like to know the difference between effects of these two approaches?
1
vote
1answer
130 views

Computing number of batches in one epoch

I have been reading through Stanford's code examples for their Deep Learning course, and I see that they have computed ...
1
vote
1answer
498 views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
7
votes
2answers
1k views

Keras Fit Generator Function

I want to know if my thinking is correct? Total Images = 120,000 So in the Keras Fit Generator function, I made the batch_size = 24 and steps per epoch = 500 ,which is 12000 and only one-tenth of ...
1
vote
1answer
161 views

How to interpret a drastic accuracy loss while training a neuronal net (CNN)?

How can one interpret a drastic accuracy loss after ~38 epochs? Maybe more dropout should be added to the CNN network? (x-axis shows the number of epochs)
1
vote
1answer
3k views

Early stopping and final Loss or weights of models

In a deep model, I used the Early stopping technique as below in Keras: ...
1
vote
0answers
24 views

If an NMT dataset is artificially enlarged by splitting sequences up, should it still train for the same number of epochs?

I have a neural machine translation dataset that looks something like this (letters represent words in an input sentence): ...
2
votes
4answers
727 views

Is it better to optimize hyperparameters or run multiple epochs?

Whenever I train a neural network I only have it go through a few epochs ( 1 to 3). This is because I am training them on a bad CPU and it would take some time to have the neural network go though ...
2
votes
1answer
72 views

How to determine the number of forward and backward passes in deep learning (CNN)? [closed]

Is there a way to determine the number of forward and backward passes in the training of a neural network using python?