An online network predicts the output of a slowly updated target copy of itself, with no negatives at all. Should collapse to a constant and does not, which took the field some time to explain.
supersedescorrects · extends
classifiesspecializes · part-of
substitutes forapproximates · alternative-to
depends onrequires · validates
Colour is the family; a dashed line is the second member of it.
Drag to pan · scroll to zoom · click a node to open it
This node
correctsfixes a defect in Contrastive Learningnegative pairs turn out not to be necessary
Referenced by
extendsDINO adds capability to thiscentring and sharpening in place of a prediction head
References
Bootstrap your own latent: A new approach to self-supervised Learning — Grill et al. — 2020 · link