What are x variable and y variable in word2vec model if it is supervised learning. In both the flavours- CBOW and skip-gram model.
Though some blogs have explained it as unsupervised learning.
Thanks
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.
Sign up to join this communityWhat are x variable and y variable in word2vec model if it is supervised learning. In both the flavours- CBOW and skip-gram model.
Though some blogs have explained it as unsupervised learning.
Thanks
First I would call it self-supervised in the sense that you dont need human labeling, but still need labels for NN to learn.
Both CBOW and skip-gram are "combined" into word2vec but they are shallow-neural-network architectures (albeit different ones).
Since they are different architectures, they do different things:
CBOW learn to predict the word by the context. Or maximize the probability of the target word by looking at the context.
skip-gram model is designed to predict the context so given the word xyz it must understand it and tell us that there is a huge probability that the context abc__dfg is what "surrounds" xyz.
Given that, you could try to deduce yourself what should input and output data look like to model this desired input output of CBOW, skip-gram (matrix representation of words and than probabilities and a vector representing a word and multiclass output).
Check also this answer