I am new to data science and trying to figure things out. I have been asked to create a countVectorizer with binary counts of 1-grams and TfidfVecortizer with 1-gram, both avoiding English stop words.

I created a list of custom stopwords using the most frequent words in my dataframe. From what I understand, countTokenizer is used to convert words in the dataframe into their occurrence frequency, but I believe this understanding is not accurate.

I want help with understanding exactly what both of these do and how do I go about achieving the task.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.