Early Stopping

AI and Machine Learning · Training and Optimisation · early-stopping.yaml

Halts training when held-out loss stops improving. The cheapest regulariser there is, and it needs a validation split you are not otherwise using.

• supersedescorrects · extends
• classifiesspecializes · part-of
• substitutes forapproximates · alternative-to
• depends onrequires · validates

Colour is the family; a dashed line is the second member of it.

This node

• alternative-tois a competing approach to Weight Decaystops before overfitting rather than penalising capacity

References

• Background — Early stopping on Wikipedia