3
$\begingroup$

I have to use a neural network to classify whether some reviews of hotels are deceptive or truthful. I also have to use pre-trained word embeddings to fed the neural networks. So I can use Word2vec to get the word vectors from a way larger dataset of hotels reviews. However, Word2vec gives the possibility to use continuous bag-of-words and continuous skip-gram models for this task. Which one would be generally better for this specific task?

$\endgroup$

1 Answer 1

1
$\begingroup$

I think this article gives general idea of pros / cons between CBOW and Skip Gram,

Link

According to Mikolov:

Skip-gram: works well with small amount of the training data, represents well even rare words or phrases.

CBOW: several times faster to train than the skip-gram, slightly better accuracy for the frequent words.

So without looking at data, assuming that you have large amount of data, CBOW might be my bet. However, if you have labels for "deceptive" and "truthful", it will be best to train both models, and use whichever outperforms via cross-validation.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.