I want to use Prioritized Experience Replay for whole episodes, instead for single transitions.
What's the best way to define the priorities - as episodes can be of different lengths? Personally I can think of summing up TD(0) / TD(n) errors or averaging them. What would this mean for hyperparameters like α and β?
Is there actually a 'correct way' from theoretical perspective?