Questions tagged [automatic-summarization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Sparse Matrix TextRank function?

I want to run the standard TextRank algorithm on a quite large corpus (100,000 documents x 15+- sentences per document). My purpose is text summarization. The standard implementation I am seeing ...
2
votes
1answer
16 views

summarizing time series dataset: extract time window sliding, change points, pattern seasonality in time series

I need to detect list of change points in time series dataset (temperature), and I need to split dataset into set of classes (patterns) and detect seasonality of each class (pattern). for example ...
0
votes
0answers
11 views

how to condense text to half of the orignal size in python?

i'm working on a python code that can summarize a text to about 50% preserving the idea. i found a library natural language toolkit in python but what it does is it summarizes to about 5%. is there a ...
0
votes
2answers
43 views

Targeted information extraction / focused extractive summarization

I have a large collection of project manuals, each with a large number of pages. Each manual contains some form of summary paragraphs, although these are not necessarily similar in structure or format ...
1
vote
0answers
37 views

Generate sentences using given data [closed]

I am working on an automated insights generation use case where I want to generate meaningful sentences from given aggregated data. For example, Data: ...
2
votes
0answers
22 views

Calculate a mean on condtions in a dataframe with dyplr

My table looks like this: ...
1
vote
0answers
14 views

Plotting Loss on Validation Set for Text Summarization Neural Net

I am using a seq2seq encoder-decoder neural net with attention to summarize text, but I think it may be overfitting. https://github.com/dongjun-Lee/text-summarization-tensorflow Is there a way to ...
2
votes
1answer
174 views

Detect sensitive data from unstructured text documents

I know this question is broad, but I need an advice to know if it's possible to achieve what I want to do. The problem is that I have around 2500 documents with sensitive data being replaced by four ...
2
votes
1answer
378 views

Is there a dataset with news articles and their headlines? [closed]

I need a set of news headlines and articles to help me in a project on automatic summarization. Is there such a dataset or something similar?
0
votes
1answer
228 views

Reducing text input size into word2vec without affecting performance too badly?

So I am implementing Word2Vec for the first time, and I have a set of training data that I would like to train a word2vec model on. Predictably, the problem is the dataset is rather large, and I have ...
2
votes
7answers
4k views

Should I use regex or machine learning?

I am thinking of two use cases: You submit a resume in PDF format to a web site and it extracts your contact information, job titles, etc. You receive an email from a friend that says, "let's have ...
2
votes
0answers
28 views

What other approaches are there for abstractive summarization, other then seq2seq?

I'm researching on abstractive text summarization, and has come across many recent papers. They all seem to be focusing on Sequence to Sequence models based on RNNs. Apart from RNNs, what other ...
1
vote
1answer
3k views

finding themes from text documents

I have a text documents that contain 1000s of abstracts from medical whitepapers. I want to find themes from that text. Any suggestions other than text clustering since clustering helped me to find ...
2
votes
2answers
893 views

Extractive text summarization, as a classification problem using deep networks

I understand that this is broad, but I merely require a few pointers. I wish to implement a text summarization system. I have already tried out an abstractive approach, now I am trying an extractive ...
2
votes
2answers
400 views

Extract sentences from beginning of news in single document summarization

I am working on Single Document Summarization task on News datasets. I do some experiments in this task. A simple experiment that I make and has a good result is extracting sentences just from ...