What is the difference between the word_tokenize, one imported directly from nltk and the other being imported from tokenize package of nltk?


So basically

from nltk import word_tokenize


from nltk.tokenize import word_tokenize

from nltk import word_tokenize is basing to the same tokenizeAPI as both are the same with the usage and I don't see any difference in the results which they give.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.