I will be performing sentiment analysis on fiction. I'll be working with around 300 books of 350 pages. Before performing word2vec, can I limit the dictionary size by ignoring less frequent words? If so, what is the rule for defining the size?

  • $\begingroup$ Less frequent words may also play a important role in determining a sentence's sentiment. You can try to remove stopwords, punctuation, names. You can think of those words which hold less importance in sentiment determination $\endgroup$ – Shubham Panchal Apr 15 '19 at 8:26

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.