Temporal Difference Learning

AI and Machine Learning · Reinforcement Learning · temporal-difference-learning.yaml

Updates a value estimate toward a later estimate rather than waiting for the final return. Learns from incomplete episodes, which is what makes online learning possible at all.

• supersedescorrects · extends
• classifiesspecializes · part-of
• substitutes forapproximates · alternative-to
• depends onrequires · validates

Colour is the family; a dashed line is the second member of it.

This node

• specializesis a specific case of Markov Decision Processestimates the value function the MDP defines

Referenced by

• specializesQ-Learning is a specific case of thisthe bootstrapped target is the best next action's value

References

• Background — Temporal difference learning on Wikipedia