Masked Autoencoder

AI and Machine Learning · Representation Learning · 2021 · also: MAE · masked-autoencoder.yaml

Hides most of the patches, encodes only the visible ones and reconstructs the rest with a light decoder. The high mask ratio is what makes it both a hard task and a cheap one.

Colour is the family; a dashed line is the second member of it.

Drag to pan · scroll to zoom · click a node to open it
G autoencoder Autoencoder bert BERT jepa JEPA masked-autoencoder Masked Autoencoder jepa->masked-autoencoder pixel targets spend capacity on unpredictable detail masked-autoencoder->autoencoder reconstructs patches hidden from the encoder masked-autoencoder->bert masked prediction moved from tokens to image patches vision-transformer Vision Transformer masked-autoencoder->vision-transformer the encoder can skip the masked patches entirely

This node

Referenced by

References