Questions tagged [epochs]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
30 views

Should I need to cure the curve for the model?

I have several classification models that used for image classification. The epochs is set to 100 for both. Model A gave me accuracy 99.7 and stopped at epoch 100 but Model B gave me 99.93 but take ...
user5520049's user avatar
0 votes
0 answers
28 views

Is it the right approach to select the model when it gives highest accuracy on validation dataset?

I am training the Densenet121 Model on an image dataset. I divided the dataset into 80% for training and 20% for testing. Then I further divided the training data into 85% for training and 15% for ...
Dawood Ahmad's user avatar
0 votes
0 answers
15 views

Batch normalization getting Val accuracy of 000e00

I am currently stuck on batch normalization. I have code written out but when I do it it keeps giving me a val_accuracy of 00e00 and stops after 2 epochs (I am wanting to run 20). I am not sure what ...
Nidia Torres's user avatar
1 vote
0 answers
17 views

Epochs for new batch when online training?

I am online training a RNN with fixed batch size k on a time series. Initially I train my model with n batches and a number of e epochs. When a new batch n+1 is available, I would like to update the ...
Marx's user avatar
  • 11
0 votes
0 answers
30 views

Overfitting followed by well-fitting with large number of epochs

A few months ago I found an article it was explaining that some experiments had shown some networks would start well-fitting after overfitting happened in higher epochs. e.g. overfitting starts at ...
Ali Ent's user avatar
  • 101
0 votes
0 answers
483 views

Proof that averaging weights is equal to averaging gradients (FedSGD vs FedAvg)

The first paper of Federated Learning "Communication-Efficient Learning of Deep Networks from Decentralized Data" presents FedSGD and FedAvg. In Federated Learning the learning task is ...
CasellaJr's user avatar
  • 229
0 votes
2 answers
92 views

Is 500 epochs too much for a CNN project?

I am working on a project where I need to train a model with a data set of 250 images. My epochs count is 500. Is that too much? Will it overfit? I did this because ...
Ayush Kumar's user avatar
0 votes
1 answer
140 views

how can i set learning rate for big data?

will it need more epochs for training or it is not a necessary and what is the learning rate I should set for this data with optimizer adam?
sam's user avatar
  • 35
2 votes
1 answer
611 views

Is fitting a model in a for loop equivalent to using epochs>1?

I'm using tensorflow to train a network to do an image segmentation task, and I have a question about the behavior of model.fit between epochs, specifically: Is ...
Brionius's user avatar
  • 121
1 vote
0 answers
23 views

The case of (1,478) dim and parameters of neural network to find out

colleagues, actually I am kind'a new to NN, but hard trying.. I have data: Index: 40073 entries (excluded from training, UID) Columns: 484 entries dtypes: bool(468), float64(2), int64(13), object(1) I ...
Gleb Karpushkin's user avatar
1 vote
0 answers
14 views

Are less training epochs better in the following scenario

So I have a scenario in which the training data is being generated in response to what the Neural Network backed actor is doing. In essence its giving feedback to the Neural Network based on all of ...
John Sohn's user avatar
3 votes
2 answers
868 views

Which is meant by +/-9.2e18 years in timespan?

I was able to convert the 9.2e18 AD to a date, but I am confused about the exact date. Which date is 9.2e18 AD and and 9.2e18 BC? Time span (absolute) - [9.2e18 BC, 9.2e18 AD] i.e +/- 9.2e18 years ...
Rinshan Kolayil's user avatar
0 votes
1 answer
842 views

How can I choose num of epochs and batch size?

I have the coco 2014 dataset and need to train it as training is around 82700 and testing is 40500. However, I got the same sentence with different values every time with ...
user5520049's user avatar
1 vote
1 answer
812 views

How does epochs related with converging the model?

I have read on Internet that epochs is used to give the time for the model to converge but I don't know how ? . I was thinking that epochs is used because to train the model sufficient times . How ...
Hamza's user avatar
  • 229
0 votes
0 answers
68 views

How many epochs should all the data be trained on after training with validation finds when validation and training diverge?

One uses and train/test split to use their training data to get an idea of how many epochs to train with. If the validation accuracy starts going down while the training accuracy is still going up, ...
user14094230's user avatar
1 vote
0 answers
184 views

Implementing Connectivity: "IndexError: too many indices for array: array is 3-dimensional, but 4 were indexed"

I am trying to implement connectivity as a feature within my code, but am unsure of how to fix this error code. Here is my code up until the point of the error. ...
Joe's user avatar
  • 11
0 votes
1 answer
1k views

How to specify steps_per_epoch and validation steps on infinite dataset?

I have a huge csv dataset with a size of 200 GB. I'm using CsvDataset to make dataset generator for loading data from the disk while training the model. I want all the data to be passed on each epoch. ...
DevLoverUmar's user avatar
0 votes
1 answer
97 views

How to interpret this Plot of Model Loss from a BiLSTM model?

Hi everyone, the above graph is produced by a BiLSTM model i just trained and tested. I can't seem to interpret it while it is very different from the references that i acquired by googling online. ...
yts61's user avatar
  • 101
0 votes
1 answer
1k views

How to train the model with for loop instead of the built-in epochs

i want to use a for loop for epochs instead of the built-in ones. Does these parts are similar. 1) ...
phillipe cauchett's user avatar
3 votes
2 answers
6k views

Scikit learn linear regression - learning rate and epoch adjustment

I am trying to learn linear regression using ordinary least squares and gradient descent from scratch. I read the documentation for the Scikit learn function and I do not see a means to adjust the ...
chrisper's user avatar
0 votes
1 answer
118 views

Does training of neural networks follow the same order in each epoch?

Each epoch uses the weight from the end of the previous epoch(correct me if I am wrong). Is the updating of parameters after each batch always in the same order? To rephrase, are the batches always in ...
Borut Flis's user avatar
2 votes
2 answers
6k views

Opinions on an LSTM hyper-parameter tuning process I am using

I am training an LSTM to predict a price chart. I am using Bayesian optimization to speed things slightly since I have a large number of hyperparameters and only my CPU as a resource. Making 100 ...
user134132523's user avatar
4 votes
4 answers
2k views

Are weights of a neural network reset between epochs?

If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
user134132523's user avatar
0 votes
0 answers
207 views

'loss: nan' during training of Neural Network in python

I am training a neural network in python. But the accuracy is very low. ...
thenoirlatte's user avatar
2 votes
2 answers
3k views

How can I tune LSTM hyperparameters?

If anyone is there to answer these, that'll be great. I'm in the midst of a Final Year Project on LSTM. Currently, I’m stuck and confused over LSTM codes. There are 4 hyperparameters that I can play ...
Marcus's user avatar
  • 21
0 votes
2 answers
1k views

Epochs or Loss Convergence

I was training a Deep Neural Network using transfer learning and the loss value as of now is close to 1.7. I am using a dataset of 31,000 images and I do apply data augmentation techniques to help the ...
Aditya Mangalampalli's user avatar
8 votes
3 answers
10k views

How to combine GridSearchCV with Early Stopping?

I'm a beginner in machine learning and want to train a CNN (for image recognition) with optimized hyperparameter like dropout rate, learning rate and number of epochs. The optimal hyperparameter I ...
Code Now's user avatar
  • 393
1 vote
1 answer
115 views

How would keras model learn at every epoch?

I know concept of Epochs, batch size and iteration. let's say, Total_data = 6400 Batch_size = 64 Iteration = 100 In this, basically we are taking in 64 data points to computer memory and ...
S. Jay's user avatar
  • 11
3 votes
1 answer
352 views

How to get the number of steps until a certain accuracy in keras?

I want to see how many steps does it take for my model to reach a certain accuracy.Say 90 percent on cifar10.How can I get this info from the keras model ? EDIT: accuracy in each epoch is accessible ...
Moeinh77's user avatar
  • 221
0 votes
1 answer
87 views

How to find learning rate decay?

Given the number of epochs, batch size and learning rate, is there a formula by which I can calculate the learning rate decay in mini batch SGD?
yamini goel's user avatar
36 votes
5 answers
65k views

What to set in steps_per_epoch in Keras' fit_generator?

I am replicating, in Keras, the work of a paper where I know the values of epoch and batch_size. Since the dataset is quite ...
yamini goel's user avatar
1 vote
1 answer
416 views

what exactly happens during each epoch in neural network training

Across different epochs, which of the following is/are updated? initial weights (initial ConvNet filter matrices, initial fully connected weights) hyper parameters: number of ConvNet filters, size ...
feynman's user avatar
  • 237
0 votes
1 answer
504 views

Difference between "reducing batch_size" and "increasing epochs" to decrease loss amount?

In my experience, both reducing batch_size and increasing epochs can decrease loss amount. But I like to know is there any ...
user3486308's user avatar
  • 1,270
3 votes
1 answer
633 views

What is the difference? "Adding more LSTM layers" or "Increasing epochs"?

To get more accurate results which one is better? Adding more layers or increasing number of epochs? I like to know the difference between effects of these two approaches?
user3486308's user avatar
  • 1,270
2 votes
1 answer
2k views

Computing number of batches in one epoch

I have been reading through Stanford's code examples for their Deep Learning course, and I see that they have computed ...
Henry's user avatar
  • 53
1 vote
1 answer
3k views

Why Epochs take longer as learning proceeds?

I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
Soyol's user avatar
  • 135
7 votes
2 answers
2k views

Keras Fit Generator Function

I want to know if my thinking is correct? Total Images = 120,000 So in the Keras Fit Generator function, I made the batch_size = 24 and steps per epoch = 500 ,which is 12000 and only one-tenth of ...
Son kun's user avatar
  • 71
1 vote
1 answer
230 views

How to interpret a drastic accuracy loss while training a neuronal net (CNN)?

How can one interpret a drastic accuracy loss after ~38 epochs? Maybe more dropout should be added to the CNN network? (x-axis shows the number of epochs)
Predicted Life's user avatar
3 votes
1 answer
4k views

Early stopping and final Loss or weights of models

In a deep model, I used the Early stopping technique as below in Keras: ...
user7194905's user avatar
2 votes
2 answers
526 views

What is the logic of the epoch?

What is the logic of the epoch? For example, 1 time, 2 times, etc. I just do not know what else is working to give better results than I know.
Developer's user avatar
  • 1,099
2 votes
4 answers
2k views

Is it better to optimize hyperparameters or run multiple epochs?

Whenever I train a neural network I only have it go through a few epochs ( 1 to 3). This is because I am training them on a bad CPU and it would take some time to have the neural network go though ...
J Houseman's user avatar
2 votes
1 answer
164 views

How to determine the number of forward and backward passes in deep learning (CNN)? [closed]

Is there a way to determine the number of forward and backward passes in the training of a neural network using python?
N.IT's user avatar
  • 1,995