Questions tagged [automatic-summarization]
The automatic-summarization tag has no usage guidance.
30
questions
0
votes
1
answer
50
views
Library for Abstractive Summarization
Is there a Python library that supports abstractive summarization? (Excluding cloud-based models like GPT or ChatGPT). We can perform extractive summarization easily using the code below:
...
- 755
10
votes
1
answer
9k
views
How to summarize a long text using GPT-3
What is the best way to summarize a long text that exceeds 4096 token limit (like a podcast transcript for example)? As I understand I need to split the text into chunks to summarize, and then ...
- 203
0
votes
0
answers
31
views
Are there tools that would run many machine learning fits without much setup?
Are there tools that would run many machine learning fits without much setup?
Such tool could be useful for discovering what kind of model could be the best fit, without trying each of them manually.
- 416
0
votes
1
answer
511
views
Topic modelling or Keyword extraction for a small dataset
I am working on a project where I have a dataset which contains very less data. These are the comments of people. I have only 130 lines with 10 words per line. My goal is to identify the common topics ...
0
votes
0
answers
12
views
"Source paper" of the method Reduction in library Sumy
Does anybody know or can help me to find the source paper of the method "Reduction" of the library "sumy"?
This method is here: Reduction where it says that it is based on here, ...
0
votes
1
answer
130
views
Ideal Windows Size in Pk Evaluation Metric
I am very new to nlp. I am doing a text segmentation task and for evaluating my model I need to calculate Pk and Windiff scores. My question is what is the ideal value for window size (k) for Pk score ...
- 1
0
votes
0
answers
55
views
How to programmatically differentiate between extractive and abstractive summarization in NLP?
We are using different pre-trained models in python transformers library, to generate summaries(both extractive and abstractive). So is there a programmatic way, based on the output summary, we can ...
0
votes
0
answers
30
views
Which would be an ideal model to get a specific sub string from a bigger string?
I have a corpus of documents whose some lines have information like this:
wt 210 1b 14.4 oz (98 kg)
or
...
- 109
1
vote
0
answers
260
views
Huggingface Library - Multi-document summarization
Can BART, PEGASUS ... etc. API in huggingface library be used to directly perform multi document summarization?
(e.g. here: https://huggingface.co/transformers/model_doc/bart.html)
- 143
5
votes
1
answer
33k
views
How to use df.groupby() to select and sum specific columns w/o pandas trimming total number of columns
I got Column1, Column2, Column3, Column4, Column5, Column6
I'd like to group Column1 and get the row sum of Column3,4 and 5
When I apply groupby() and get this that is correct but it's leaving out ...
- 119
3
votes
0
answers
35
views
Dataset availability for automatic text summarization
I'm working on an automatic text summarization NLP problem and looking for a dataset with USA legal case reports similar to the Australian legal case reports dataset in UCI repository.
Can you please ...
- 379
0
votes
0
answers
26
views
Deriving answers to specific queries from a text
Introduction
I am looking to extract out sentence(s) from a news article for questions like 'who', 'when', 'what', 'why' and 'how'. Now I did some research and found bert model which can be utilised ...
- 1
0
votes
1
answer
49
views
Measuring the success of text summarization
I am trying to make a text summarization program that will take a text article and reduce it to a para or 2.
Since I am a newbie with no idea of NLP, it is hard to approach and break down the problem....
- 111
0
votes
0
answers
36
views
Summarize events per ID
Data:
Each corresponds to an event (a person's visit to the hospital, as an example). I have a series of data associated with this event (duration of visit, motive, etc...).
Objective:
Summarize the ...
- 191
1
vote
1
answer
717
views
UniLM - Unified Language Model for summarization
The UniLM claims to be the best approach for summarization task. But there doesn't seem to be any tutorial or how-to section in the README.md or any other blog. How exactly can I use this state-of-the-...
- 113
1
vote
2
answers
263
views
Text summarization with limited number of words
I am reviewing summarization techniques and haven't (yet) found an approach to limit the length of a summary. So for example a summarization function that gives me a summary that is ...
- 187
3
votes
0
answers
90
views
summarizing time series dataset: extract time window sliding, change points, pattern seasonality in time series
I need to detect list of change points in time series dataset (temperature), and I need to split dataset into set of classes (patterns) and detect seasonality of each class (pattern). for example ...
- 31
0
votes
2
answers
98
views
Targeted information extraction / focused extractive summarization
I have a large collection of project manuals, each with a large number of pages. Each manual contains some form of summary paragraphs, although these are not necessarily similar in structure or format ...
- 3
1
vote
0
answers
153
views
Generate sentences using given data [closed]
I am working on an automated insights generation use case where I want to generate meaningful sentences from given aggregated data.
For example,
Data:
...
- 143
2
votes
0
answers
38
views
Calculate a mean on condtions in a dataframe with dyplr
My table looks like this:
...
1
vote
3
answers
7k
views
1
vote
0
answers
38
views
Plotting Loss on Validation Set for Text Summarization Neural Net
I am using a seq2seq encoder-decoder neural net with attention to summarize text, but I think it may be overfitting. https://github.com/dongjun-Lee/text-summarization-tensorflow
Is there a way to ...
- 111
4
votes
1
answer
1k
views
Detect sensitive data from unstructured text documents [closed]
I know this question is broad, but I need an advice to know if it's possible to achieve what I want to do.
The problem is that I have around 2500 documents with sensitive data being replaced by four ...
- 41
2
votes
1
answer
1k
views
Is there a dataset with news articles and their headlines? [closed]
I need a set of news headlines and articles to help me in a project on automatic summarization. Is there such a dataset or something similar?
- 21
0
votes
1
answer
413
views
Reducing text input size into word2vec without affecting performance too badly?
So I am implementing Word2Vec for the first time, and I have a set of training data that I would like to train a word2vec model on. Predictably, the problem is the dataset is rather large, and I have ...
- 147
3
votes
7
answers
10k
views
Should I use regex or machine learning?
I am thinking of two use cases:
You submit a resume in PDF format to a web site and it extracts your contact information, job titles, etc.
You receive an email from a friend that says, "let's have ...
- 2,079
2
votes
0
answers
44
views
What other approaches are there for abstractive summarization, other then seq2seq?
I'm researching on abstractive text summarization, and has come across many recent papers. They all seem to be focusing on Sequence to Sequence models based on RNNs. Apart from RNNs, what other ...
- 21
1
vote
1
answer
8k
views
finding themes from text documents
I have a text documents that contain 1000s of abstracts from medical whitepapers. I want to find themes from that text. Any suggestions other than text clustering since clustering helped me to find ...
- 33
2
votes
2
answers
1k
views
Extractive text summarization, as a classification problem using deep networks
I understand that this is broad, but I merely require a few pointers.
I wish to implement a text summarization system. I have already tried out an abstractive approach, now I am trying an extractive ...
2
votes
2
answers
477
views
Extract sentences from beginning of news in single document summarization
I am working on Single Document Summarization task on News datasets. I do some experiments in this task. A simple experiment that I make and has a good result is extracting sentences just from ...
