Draw a transition in proportion to the size of its last TD error, so the buffer keeps returning the surprising ones and stops returning the solved ones.
supersedescorrects · extends
classifiesspecializes · part-of
substitutes forapproximates · alternative-to
depends onrequires · validates
Colour is the family; a dashed line is the second member of it.
Drag to pan · scroll to zoom · click a node to open it
This node
correctsfixes a defect in Experience Replayuniform sampling spends most updates on transitions with no error left
requiresdoes not work without Importance Samplingdrawing by error skews the expectation, and the weight puts it back
Referenced by
requiresRainbow does not work without thisno single ablation costs more than removing it