How would keras model learn at every epoch?

Question

I know concept of Epochs, batch size and iteration.

let's say,

Total_data = 6400

Batch_size = 64

Iteration = 100

In this, basically we are taking in 64 data points to computer memory and calculate and at each iteration we get weight updated. so after 100 iterations, we will fulfill one epoch.

My question is, after one epoch, we are using again the same 6400 data. How is it different from the first epoch in terms of learning? does the model select different 64 data point than first epoch in second epoch and try to learn? how does it internally really work?

I wish I can get some clear answers.

Thank you people in advance.

Answer 1

The data points are the same, but the model is different at each epoch. Weights are updated at each iteration so they will be different and in turn, the loss function will be different for the same data point at different epochs. What training process does is to change the weights slowly at each run to minimize the loss for the same data smaller and smaller.

Weights are modified in a way to minimize the error for the data points using an algorithm such as backpropagation in gradient descent. You might also want to check the explanation of backpropagation given by 3B1B in this youtube video.