Here in the David Silver Lecture series I perfectly understand how he took the expectation value in the theorem part by combining the following equation .
But how he removed the expectation part when talking stochastic gradient decent ?
Here in the David Silver Lecture series I perfectly understand how he took the expectation value in the theorem part by combining the following equation .
But how he removed the expectation part when talking stochastic gradient decent ?