Questions tagged [epochs]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

How to set batch size and steps per epoch when using TFRecord files?

I have a training data that consists of 6011 images. Now , I have converted this data to tfrecord files , where each file consists of 128 records and there are 47 files ( note that the last file ...
1
vote
0answers
21 views

The case of (1,478) dim and parameters of neural network to find out

colleagues, actually I am kind'a new to NN, but hard trying.. I have data: Index: 40073 entries (excluded from training, UID) Columns: 484 entries dtypes: bool(468), float64(2), int64(13), object(1) I ...
1
vote
0answers
12 views

Are less training epochs better in the following scenario

So I have a scenario in which the training data is being generated in response to what the Neural Network backed actor is doing. In essence its giving feedback to the Neural Network based on all of ...
3
votes
2answers
769 views

Which is meant by +/-9.2e18 years in timespan?

I was able to convert the 9.2e18 AD to a date, but I am confused about the exact date. Which date is 9.2e18 AD and and 9.2e18 BC? Time span (absolute) - [9.2e18 BC, 9.2e18 AD] i.e +/- 9.2e18 years ...
0
votes
1answer
86 views

How can I choose num of epochs and batch size?

I have the coco 2014 dataset and need to train it as training is around 82700 and testing is 40500. However, I got the same sentence with different values every time with ...
1
vote
1answer
44 views

How does epochs related with converging the model?

I have read on Internet that epochs is used to give the time for the model to converge but I don't know how ? . I was thinking that epochs is used because to train the model sufficient times . How ...
0
votes
0answers
42 views

How many epochs should all the data be trained on after training with validation finds when validation and training diverge?

One uses and train/test split to use their training data to get an idea of how many epochs to train with. If the validation accuracy starts going down while the training accuracy is still going up, ...
1
vote
0answers
124 views

Implementing Connectivity: "IndexError: too many indices for array: array is 3-dimensional, but 4 were indexed"

I am trying to implement connectivity as a feature within my code, but am unsure of how to fix this error code. Here is my code up until the point of the error. ...
0
votes
1answer
377 views

How to specify steps_per_epoch and validation steps on infinite dataset?

I have a huge csv dataset with a size of 200 GB. I'm using CsvDataset to make dataset generator for loading data from the disk while training the model. I want all the data to be passed on each epoch. ...
0
votes
1answer
41 views

How to interpret this Plot of Model Loss from a BiLSTM model?

Hi everyone, the above graph is produced by a BiLSTM model i just trained and tested. I can't seem to interpret it while it is very different from the references that i acquired by googling online. ...
0
votes
1answer
822 views

How to train the model with for loop instead of the built-in epochs

i want to use a for loop for epochs instead of the built-in ones. Does these parts are similar. 1) ...
3
votes
2answers
2k views

Scikit learn linear regression - learning rate and epoch adjustment

I am trying to learn linear regression using ordinary least squares and gradient descent from scratch. I read the documentation for the Scikit learn function and I do not see a means to adjust the ...
0
votes
1answer
39 views

Does training of neural networks follow the same order in each epoch?

Each epoch uses the weight from the end of the previous epoch(correct me if I am wrong). Is the updating of parameters after each batch always in the same order? To rephrase, are the batches always in ...
2
votes
2answers
4k views

Opinions on an LSTM hyper-parameter tuning process I am using

I am training an LSTM to predict a price chart. I am using Bayesian optimization to speed things slightly since I have a large number of hyperparameters and only my CPU as a resource. Making 100 ...
2
votes
3answers
803 views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
0
votes
0answers
100 views

'loss: nan' during training of Neural Network in python

I am training a neural network in python. But the accuracy is very low. ...
2
votes
2answers
2k views

How can I tune LSTM hyperparameters?

If anyone is there to answer these, that'll be great. I'm in the midst of a Final Year Project on LSTM. Currently, I’m stuck and confused over LSTM codes. There are 4 hyperparameters that I can play ...
0
votes
2answers
670 views

Epochs or Loss Convergence

I was training a Deep Neural Network using transfer learning and the loss value as of now is close to 1.7. I am using a dataset of 31,000 images and I do apply data augmentation techniques to help the ...
8
votes
3answers
6k views

How to combine GridSearchCV with Early Stopping?

I'm a beginner in machine learning and want to train a CNN (for image recognition) with optimized hyperparameter like dropout rate, learning rate and number of epochs. The optimal hyperparameter I ...
1
vote
1answer
61 views

How would keras model learn at every epoch?

I know concept of Epochs, batch size and iteration. let's say, Total_data = 6400 Batch_size = 64 Iteration = 100 In this, basically we are taking in 64 data points to computer memory and ...
3
votes
1answer
150 views

How to get the number of steps until a certain accuracy in keras?

I want to see how many steps does it take for my model to reach a certain accuracy.Say 90 percent on cifar10.How can I get this info from the keras model ? EDIT: accuracy in each epoch is accessible ...
0
votes
1answer
62 views

How to find learning rate decay?

Given the number of epochs, batch size and learning rate, is there a formula by which I can calculate the learning rate decay in mini batch SGD?
32
votes
5answers
46k views

What to set in steps_per_epoch in Keras' fit_generator?

I am replicating, in Keras, the work of a paper where I know the values of epoch and batch_size. Since the dataset is quite ...
1
vote
1answer
176 views

what exactly happens during each epoch in neural network training

Across different epochs, which of the following is/are updated? initial weights (initial ConvNet filter matrices, initial fully connected weights) hyper parameters: number of ConvNet filters, size ...
0
votes
1answer
272 views

Difference between "reducing batch_size" and "increasing epochs" to decrease loss amount?

In my experience, both reducing batch_size and increasing epochs can decrease loss amount. But I like to know is there any ...
3
votes
1answer
189 views

What is the difference? "Adding more LSTM layers" or "Increasing epochs"?

To get more accurate results which one is better? Adding more layers or increasing number of epochs? I like to know the difference between effects of these two approaches?
1
vote
1answer
683 views

Computing number of batches in one epoch

I have been reading through Stanford's code examples for their Deep Learning course, and I see that they have computed ...
1
vote
1answer
1k views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
7
votes
2answers
2k views

Keras Fit Generator Function

I want to know if my thinking is correct? Total Images = 120,000 So in the Keras Fit Generator function, I made the batch_size = 24 and steps per epoch = 500 ,which is 12000 and only one-tenth of ...
1
vote
1answer
203 views

How to interpret a drastic accuracy loss while training a neuronal net (CNN)?

How can one interpret a drastic accuracy loss after ~38 epochs? Maybe more dropout should be added to the CNN network? (x-axis shows the number of epochs)
2
votes
1answer
4k views

Early stopping and final Loss or weights of models

In a deep model, I used the Early stopping technique as below in Keras: ...
1
vote
2answers
281 views

What is the logic of the epoch?

What is the logic of the epoch? For example, 1 time, 2 times, etc. I just do not know what else is working to give better results than I know.
2
votes
4answers
1k views

Is it better to optimize hyperparameters or run multiple epochs?

Whenever I train a neural network I only have it go through a few epochs ( 1 to 3). This is because I am training them on a bad CPU and it would take some time to have the neural network go though ...
2
votes
1answer
85 views

How to determine the number of forward and backward passes in deep learning (CNN)? [closed]

Is there a way to determine the number of forward and backward passes in the training of a neural network using python?