A practical comparison between the different Word2Vec architectures. These are companion slides for this article: https://kavita-ganesan.com/comparison-between-cbow-skipgram-subword/
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Comparison between cbow, skip gram and skip-gram with subword information
1. Comparison Between CBOW, Skip-
Gram and Skip-Gram with Subword
Information [ See article ]
By: Kavita Ganesan
2. CBOW
This is a visual comparison
sum
visual
thisis acomparison
visual
thisis acomparison
visual visual visual
target word
By: Kavita Ganesan
target word
SkipGram
3. This is a visual comparison
sum
visual
th ishi
target word
SkipGram + Subword (SkipGramSI)
this<t s>
18. Final Thoughts
Plain word embeddings:
● Does not capture fine-grained semantic similarity
● Words are not directly replaceable with words closest in vector space
● Quality of embeddings is only as good as the training data