Take the best action known, except on an ε fraction of steps where the action is uniformly random. The cheapest exploration that still visits every action infinitely often, and the baseline anything cleverer has to beat.
supersedescorrects · extends
classifiesspecializes · part-of
substitutes forapproximates · alternative-to
depends onrequires · validates
Colour is the family; a dashed line is the second member of it.
Drag to pan · scroll to zoom · click a node to open it
This node
correctsfixes a defect in Q-Learningacting greedily never revisits an action its first sample underrated