Keeps a queue of embeddings from previous batches, encoded by a slowly moving copy of the network, so the pool of negatives is decoupled from the batch size.
supersedescorrects · extends
classifiesspecializes · part-of
substitutes forapproximates · alternative-to
depends onrequires · validates
Colour is the family; a dashed line is the second member of it.
Drag to pan · scroll to zoom · click a node to open it
This node
correctsfixes a defect in Contrastive Learningnegatives need a batch bigger than memory allows
References
Momentum Contrast for Unsupervised Visual Representation Learning — He, Fan, Wu, Xie, Girshick — 2019 · link