Questions tagged [epochs]
The epochs tag has no usage guidance.
42 questions
1
vote
1
answer
40
views
How does seeing training batches only once influence the generalization of a neural network?
I am referring to this question/scenario Train neural network with unlimited training data but unfortunately I can not comment.
As I am not seeing any training batch multiple times I would guess that ...
- 13
0
votes
1
answer
22
views
How are the mini-batches performance used to obtain the overall accuracy in ML packages?
For the sake of exemplification, let us consider the the time series convolutional neural network (CNN) classifier from the sktime (this question can be applied for ...
- 123
0
votes
1
answer
32
views
Should I need to cure the curve for the model?
I have several classification models that used for image classification. The epochs is set to 100 for both. Model A gave me accuracy 99.7 and stopped at epoch 100 but Model B gave me 99.93 but take ...
- 125
1
vote
0
answers
22
views
Epochs for new batch when online training?
I am online training a RNN with fixed batch size k on a time series. Initially I train my model with n batches and a number of e epochs. When a new batch n+1 is available, I would like to update the ...
- 11
0
votes
0
answers
34
views
Overfitting followed by well-fitting with large number of epochs
A few months ago I found an article it was explaining that some experiments had shown some networks would start well-fitting after overfitting happened in higher epochs. e.g. overfitting starts at ...
- 101
0
votes
0
answers
623
views
Proof that averaging weights is equal to averaging gradients (FedSGD vs FedAvg)
The first paper of Federated Learning "Communication-Efficient Learning of Deep Networks from Decentralized Data" presents FedSGD and FedAvg. In Federated Learning the learning task is ...
- 229
0
votes
2
answers
203
views
Is 500 epochs too much for a CNN project?
I am working on a project where I need to train a model with a data set of 250 images. My epochs count is 500. Is that too much? Will it overfit?
I did this because ...
0
votes
1
answer
163
views
how can i set learning rate for big data?
will it need more epochs for training or it is not a necessary and what is the learning rate I should set for this data with optimizer adam?
- 35
2
votes
1
answer
716
views
Is fitting a model in a for loop equivalent to using epochs>1?
I'm using tensorflow to train a network to do an image segmentation task, and I have a question about the behavior of model.fit between epochs, specifically:
Is ...
- 121
1
vote
0
answers
24
views
The case of (1,478) dim and parameters of neural network to find out
colleagues, actually I am kind'a new to NN, but hard trying..
I have data:
Index: 40073 entries (excluded from training, UID)
Columns: 484 entries
dtypes: bool(468), float64(2), int64(13), object(1)
I ...
1
vote
0
answers
16
views
Are less training epochs better in the following scenario
So I have a scenario in which the training data is being generated in response to what the Neural Network backed actor is doing. In essence its giving feedback to the Neural Network based on all of ...
- 41
3
votes
2
answers
923
views
Which is meant by +/-9.2e18 years in timespan?
I was able to convert the 9.2e18 AD to a date, but I am confused about the exact date. Which date is 9.2e18 AD and and 9.2e18 BC?
Time span (absolute) - [9.2e18 BC, 9.2e18 AD] i.e +/- 9.2e18 years
...
- 143
0
votes
1
answer
1k
views
How can I choose num of epochs and batch size?
I have the coco 2014 dataset and need to train it as training is around 82700 and testing is 40500. However, I got the same sentence with different values every time with ...
- 125
1
vote
1
answer
994
views
How does epochs related with converging the model?
I have read on Internet that epochs is used to give the time for the model to converge but I don't know how ? . I was thinking that epochs is used because to train the model sufficient times . How ...
- 240
0
votes
0
answers
89
views
How many epochs should all the data be trained on after training with validation finds when validation and training diverge?
One uses and train/test split to use their training data to get an idea of how many epochs to train with. If the validation accuracy starts going down while the training accuracy is still going up, ...
- 101
1
vote
0
answers
205
views
Implementing Connectivity: "IndexError: too many indices for array: array is 3-dimensional, but 4 were indexed"
I am trying to implement connectivity as a feature within my code, but am unsure of how to fix this error code. Here is my code up until the point of the error.
...
- 11
0
votes
1
answer
1k
views
How to specify steps_per_epoch and validation steps on infinite dataset?
I have a huge csv dataset with a size of 200 GB. I'm using CsvDataset to make dataset generator for loading data from the disk while training the model. I want all the data to be passed on each epoch. ...
- 121
0
votes
1
answer
116
views
How to interpret this Plot of Model Loss from a BiLSTM model?
Hi everyone,
the above graph is produced by a BiLSTM model i just trained and tested. I can't seem to interpret it while it is very different from the references that i acquired by googling online.
...
- 101
0
votes
1
answer
2k
views
How to train the model with for loop instead of the built-in epochs
i want to use a for loop for epochs instead of the built-in ones. Does these parts are similar.
1)
...
3
votes
2
answers
7k
views
Scikit learn linear regression - learning rate and epoch adjustment
I am trying to learn linear regression using ordinary least squares and gradient descent from scratch.
I read the documentation for the Scikit learn function and I do not see a means to adjust the ...
- 53
0
votes
1
answer
136
views
Does training of neural networks follow the same order in each epoch?
Each epoch uses the weight from the end of the previous epoch(correct me if I am wrong). Is the updating of parameters after each batch always in the same order? To rephrase, are the batches always in ...
- 199
2
votes
2
answers
7k
views
Opinions on an LSTM hyper-parameter tuning process I am using
I am training an LSTM to predict a price chart. I am using Bayesian optimization to speed things slightly since I have a large number of hyperparameters and only my CPU as a resource.
Making 100 ...
- 169
4
votes
4
answers
3k
views
Are weights of a neural network reset between epochs?
If an epoch is defined as the neural network training process after seeing the whole training data once. How is it that when starting the next epoch, the loss is almost always smaller than the first ...
- 169
0
votes
0
answers
230
views
'loss: nan' during training of Neural Network in python
I am training a neural network in python. But the accuracy is very low.
...
- 141
2
votes
2
answers
3k
views
How can I tune LSTM hyperparameters?
If anyone is there to answer these, that'll be great. I'm in the midst of a Final Year Project on LSTM.
Currently, I’m stuck and confused over LSTM codes. There are 4 hyperparameters that I can play ...
- 21
0
votes
2
answers
1k
views
Epochs or Loss Convergence
I was training a Deep Neural Network using transfer learning and the loss value as of now is close to 1.7. I am using a dataset of 31,000 images and I do apply data augmentation techniques to help the ...
9
votes
3
answers
12k
views
How to combine GridSearchCV with Early Stopping?
I'm a beginner in machine learning and want to train a CNN (for image recognition) with optimized hyperparameter like dropout rate, learning rate and number of epochs.
The optimal hyperparameter I ...
- 403
1
vote
1
answer
118
views
How would keras model learn at every epoch?
I know concept of Epochs, batch size and iteration.
let's say,
Total_data = 6400
Batch_size = 64
Iteration = 100
In this, basically we are taking in 64 data points to computer memory and ...
- 11
3
votes
1
answer
377
views
How to get the number of steps until a certain accuracy in keras?
I want to see how many steps does it take for my model to reach a certain accuracy.Say 90 percent on cifar10.How can I get this info from the keras model ?
EDIT:
accuracy in each epoch is accessible ...
- 221
0
votes
1
answer
92
views
How to find learning rate decay?
Given the number of epochs, batch size and learning rate, is there a formula by which I can calculate the learning rate decay in mini batch SGD?
- 761
37
votes
5
answers
67k
views
What to set in steps_per_epoch in Keras' fit_generator?
I am replicating, in Keras, the work of a paper where I know the values of epoch and batch_size. Since the dataset is quite ...
- 761
1
vote
1
answer
491
views
what exactly happens during each epoch in neural network training
Across different epochs, which of the following is/are updated?
initial weights (initial ConvNet filter matrices, initial fully connected weights)
hyper parameters: number of ConvNet filters, size ...
- 237
0
votes
1
answer
586
views
Difference between "reducing batch_size" and "increasing epochs" to decrease loss amount?
In my experience, both reducing batch_size and increasing epochs can decrease loss amount. But I like to know is there any ...
- 1,300
3
votes
1
answer
807
views
What is the difference? "Adding more LSTM layers" or "Increasing epochs"?
To get more accurate results which one is better? Adding more layers or increasing number of epochs? I like to know the difference between effects of these two approaches?
- 1,300
2
votes
1
answer
2k
views
Computing number of batches in one epoch
I have been reading through Stanford's code examples for their Deep Learning course, and I see that they have computed ...
- 53
1
vote
1
answer
4k
views
Why Epochs take longer as learning proceeds?
I am training a deep learning model in Tensorflow on GPU (Amazon AWS) and what I observe is that in the beginning each epoch ...
- 135
7
votes
2
answers
2k
views
Keras Fit Generator Function
I want to know if my thinking is correct?
Total Images = 120,000
So in the Keras Fit Generator function,
I made the batch_size = 24 and steps per epoch = 500 ,which is 12000 and only one-tenth of ...
- 71
1
vote
1
answer
234
views
How to interpret a drastic accuracy loss while training a neuronal net (CNN)?
How can one interpret a drastic accuracy loss after ~38 epochs? Maybe more dropout should be added to the CNN network?
(x-axis shows the number of epochs)
- 326
3
votes
1
answer
5k
views
Early stopping and final Loss or weights of models
In a deep model, I used the Early stopping technique as below in Keras:
...
- 307
2
votes
3
answers
659
views
What is the logic of the epoch?
What is the logic of the epoch? For example, 1 time, 2 times, etc. I just do not know what else is working to give better results than I know.
- 1,099
3
votes
4
answers
2k
views
Is it better to optimize hyperparameters or run multiple epochs?
Whenever I train a neural network I only have it go through a few epochs ( 1 to 3). This is because I am training them on a bad CPU and it would take some time to have the neural network go though ...
- 58
2
votes
1
answer
177
views
How to determine the number of forward and backward passes in deep learning (CNN)? [closed]
Is there a way to determine the number of forward and backward passes in the training of a neural network using python?
- 2,015