5
$\begingroup$

As discussed with Sean in this Meta post, I thought it would be nice to have a question which can help people who were confused like me, to know about the differences between text mining and NLP!

So, what are the differences between and ?


I have included my understanding as an answer. If possible, please explain your answer with a brief example!

$\endgroup$
  • $\begingroup$ More question rather than answer: Wouldn't you use text mining and NLP together? $\endgroup$ – Ismat Aug 3 '17 at 7:39
8
$\begingroup$

I agree with Sean's answer. NLP and text mining are usually used for different goals. Also, there is indeed an overlap and both definitions are vogue.

Other than the difference in goal, there is a difference in methods. Text mining techniques are usually shallow and do not consider the text structure.Usually, text mining will use bag of words, n-grams and possibly stemming over that.

In NLP methods usually involve the test structure. You can find there sentence splitting, part of speech tagging and parse tree construction.

Typical text mining method will consider the following sentences to indicate happiness while typical NLP methods detects that they are not

  1. I am not happy
  2. I will be happy when it will rain
  3. If it will rain, I'll be happy.
  4. She asked whether I am happy
  5. Are you happy?
$\endgroup$
  • $\begingroup$ Thanks for answering. Yeah, NLP seems more like taking out the latent features of the text, and text-ming is more like Exploratory Analytics on the text :) And would you agree with the explanation in my answer here? $\endgroup$ – Dawny33 Jan 20 '16 at 6:59
5
$\begingroup$

I have had this doubt since a long time. So, this post here helped me figure the differences between the two.

So, this is the difference between text mining and NLP:

Text Mining deals with the text itself, while NLP deals with the underlying/latent metadata.

Answering questions like - frequency counts of words, length of the sentence, presence/absence of certain words etc. is text mining.

NLP on the other hand allows you to answer questions like; - What is the sentiment? - What are the keywords? (using POS tagging & parsers) - What category of content it falls under? - Which are the entities in the sentence? And more

$\endgroup$
0
$\begingroup$

Just another point of view, Dig the topic names a bit deeper.

Text mining - mining of text (just as data mining, and the data is text data). mining is about extracting useful information from the available data. information could be patterns in text or matching structure but the semantics in the text is not considered. The goal is not about making the system understand what does the text conveys, rather about providing information to the user based on a certain step by step process.

Natural language processing - Natural language is what humans use for communication. processing such a data is NLP. The data could be speech or text. Thus, the main goal is towards understanding what is the semantic meaning conveyed in it. Now you know why we care about grammatical part of speeches and the lexical relations among them.

speech recognition systems could be a part of NLP, but it has nothing to do with text mining. And, it seems like NLP is the bigger fish and it uses text-mining, but its actually the other way around. text-mining uses NLP, because it makes sense to mine the data when you understand the data semantically.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.