I am looking for references(Papers/github projects) on how to use deep learning in a text extraction task.

Recently I was given a task to extract important information from documents of similar type, say for example legal merger documents. I have thousands of legal merger documents as inputs. A paralegal would go through the entire document and highlight important points from the document. This is the extracted text.

What I want to do: Given a document(say legal merger document) I want to use DL or NLP to extract the information from the legal document that would be similar to that of the information extracted by paralegal.

I am currently using bag of words model to extract text from the document, calculating sentiment and displaying the sentences with positive or negative sentiments. This yielded very bad results.

My knowledge in DL/NLP is very limited and I am particularly looking for some interesting papers and github projects related to text extraction using these frameworks. Can anyone please provide me with some references and suggestions on how to tackle this issue?

  • 1
    $\begingroup$ Phaneeth, Can you please explain how did you accomplish this task in a bit detail as I am also looking for a solution for a similar problem. Thank you in advance $\endgroup$ – SabVenkat Sep 3 '18 at 22:33
  • $\begingroup$ @Phaneeth could you explain a bit more about how you applied sequence to sequence modeling to highlight important points from a document? Or references to sources that helped you complete this task? $\endgroup$ – Jameezzz Dec 7 '18 at 22:22
  • $\begingroup$ @Phaneeth: Can you please share you code/approach? $\endgroup$ – Mauryas Mar 27 at 19:27

Jurafsky and Martin's NLP textbook has a chapter about information extraction that should be a good starting point. For example, if you want to extract company names it will tell you how to do that.

A paralegal would go through the entire document and highlight important points from the document.

What you need to do depends heavily on what your definition of "important" is here. It would help if you can give some specific examples.

  • $\begingroup$ Sorry for the late response. I have used sequence to sequence modeling to compete this task. $\endgroup$ – Phaneeth Aug 31 '18 at 16:04

protected by Community Mar 28 at 5:07

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.