0
$\begingroup$

I am working on sentiment analysis project , where there are various customer reviews. So I am trying to clean those reviews.

So first thing i did is removing special characters, white spaces, numbers from text. Next I did is removing stop words(removing this, that, have etc.) After that i did stemming(removing ING, ed,y etc).

Below is my output.

What I want to know is that is tokenization needed here any more? Because my output after stemming looks like tokenization is done. enter image description here

Improve this question
$\endgroup$
2
  • 1
    $\begingroup$ No. You need not tokenize. It is already done for you. $\endgroup$
    – SrJ
    Commented Oct 13, 2021 at 18:15
  • $\begingroup$ Ok thanks. I knew the answer but wanted to be sure. $\endgroup$
    – Sakshi Maurya
    Commented Oct 14, 2021 at 7:25

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.