I have a question on batch learning of neural network.
A neural network learns in batches and modifies weights in every iteration. Question: If I save checkpoints after a batch, and then load the weights at a later time and train with new batch, will it be different from training both batches in 1 go?
Example: If I have a batch size of 100 and training data of 1000 points. So would it be different, in outputted checkpoint file, if I train with 9 batches (900 data points) in one go -> save checkpoint -> load checkpoint next day -> train with last batch -> save checkpoint ... Vs give all 1000 datapoints (i.e., 10 batches) -> train -> save checkpoint file ?