Word Embedding

AI and Machine Learning · Language Models · 2013 · also: word2vec · word-embedding.yaml

Maps words to dense vectors trained so that context predicts the word. Gave the field the observation that direction in the space carries meaning.

• supersedescorrects · extends
• classifiesspecializes · part-of
• substitutes forapproximates · alternative-to
• depends onrequires · validates

Colour is the family; a dashed line is the second member of it.

Referenced by

• correctsByte-Pair Encoding fixes a defect in thisa fixed word vocabulary cannot represent anything unseen

References

• Efficient Estimation of Word Representations in Vector Space — Mikolov, Chen, Corrado, Dean — 2013 · link
• Background — Word2vec on Wikipedia