I am new to regressions and we are doing a very simple exercise in a course I am taking to get a basic understanding of GD and SGD for a linear regression.
From my understanding, the only difference between GD and SGD is that instead of performing the algorithm on dataset size m as is done in GD, SGD performs the operation on subsets of m.
My question is -- for SGD does one simply perform the algorithm on the mini-batch, or is there some sort of summation of the results to come out with a final answer? Apologies if I am not asking in the correct terms, I am newer to some of the mathematical concepts involved.