Label Smoothing

AI and Machine Learning · Training and Optimisation · 2015 · label-smoothing.yaml

Replaces the one-hot target with a slightly softened distribution, so the model is never asked to be infinitely confident.

• supersedescorrects · extends
• classifiesspecializes · part-of
• substitutes forapproximates · alternative-to
• depends onrequires · validates

Colour is the family; a dashed line is the second member of it.

This node

• correctsfixes a defect in Cross-Entropy Lossa one-hot target pushes logits apart without bound

References

• Rethinking the Inception Architecture for Computer Vision — Szegedy, Vanhoucke, Ioffe, Shlens, Wojna — 2015 · link