Skip to main content

Questions tagged [automatic-summarization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
9 views

Is this how you would go about this NLP Project?

What do you think of these steps? And where can I find help with this project? I am in a business class and was assigned a data science problem. I was advised to seek out a coder at my school who can ...
Layla M's user avatar
0 votes
0 answers
12 views

Resources on website summarization using LLMs

I am working on a problem where I have to summarize business websites. I have to generate a short 100 word summary of the primary function of a given website. I am familiar with langchain url ...
Vinay Varahabhotla's user avatar
0 votes
0 answers
37 views

Looking for Code to Generate CNN Architecture Visualization from Model Summary [duplicate]

I am looking for code that generates a Convolutional Neural Network (CNN) architecture image from a model summary (similar to the attached image). Thanks for the help!
Hadil .H's user avatar
0 votes
1 answer
79 views

Library for Abstractive Summarization

Is there a Python library that supports abstractive summarization? (Excluding cloud-based models like GPT or ChatGPT). We can perform extractive summarization easily using the code below: ...
william007's user avatar
10 votes
1 answer
9k views

How to summarize a long text using GPT-3

What is the best way to summarize a long text that exceeds 4096 token limit (like a podcast transcript for example)? As I understand I need to split the text into chunks to summarize, and then ...
Poma's user avatar
  • 203
0 votes
0 answers
31 views

Are there tools that would run many machine learning fits without much setup?

Are there tools that would run many machine learning fits without much setup? Such tool could be useful for discovering what kind of model could be the best fit, without trying each of them manually.
mavavilj's user avatar
  • 416
0 votes
1 answer
617 views

Topic modelling or Keyword extraction for a small dataset

I am working on a project where I have a dataset which contains very less data. These are the comments of people. I have only 130 lines with 10 words per line. My goal is to identify the common topics ...
ASHUTOSH MITRA's user avatar
0 votes
0 answers
16 views

"Source paper" of the method Reduction in library Sumy

Does anybody know or can help me to find the source paper of the method "Reduction" of the library "sumy"? This method is here: Reduction where it says that it is based on here, ...
DanielTheRocketMan's user avatar
0 votes
1 answer
135 views

Ideal Windows Size in Pk Evaluation Metric

I am very new to nlp. I am doing a text segmentation task and for evaluating my model I need to calculate Pk and Windiff scores. My question is what is the ideal value for window size (k) for Pk score ...
Maak's user avatar
  • 1
0 votes
0 answers
63 views

How to programmatically differentiate between extractive and abstractive summarization in NLP?

We are using different pre-trained models in python transformers library, to generate summaries(both extractive and abstractive). So is there a programmatic way, based on the output summary, we can ...
Vignesh Nayak Manel's user avatar
0 votes
0 answers
30 views

Which would be an ideal model to get a specific sub string from a bigger string?

I have a corpus of documents whose some lines have information like this: wt 210 1b 14.4 oz (98 kg) or ...
abhishah901's user avatar
1 vote
0 answers
269 views

Huggingface Library - Multi-document summarization

Can BART, PEGASUS ... etc. API in huggingface library be used to directly perform multi document summarization? (e.g. here: https://huggingface.co/transformers/model_doc/bart.html)
asahi kibou's user avatar
5 votes
1 answer
36k views

How to use df.groupby() to select and sum specific columns w/o pandas trimming total number of columns

I got Column1, Column2, Column3, Column4, Column5, Column6 I'd like to group Column1 and get the row sum of Column3,4 and 5 When I apply groupby() and get this that is correct but it's leaving out ...
Steven's user avatar
  • 119
3 votes
0 answers
44 views

Dataset availability for automatic text summarization

I'm working on an automatic text summarization NLP problem and looking for a dataset with USA legal case reports similar to the Australian legal case reports dataset in UCI repository. Can you please ...
VishwaV's user avatar
  • 379
0 votes
0 answers
28 views

Deriving answers to specific queries from a text

Introduction I am looking to extract out sentence(s) from a news article for questions like 'who', 'when', 'what', 'why' and 'how'. Now I did some research and found bert model which can be utilised ...
Vimath's user avatar
  • 1
0 votes
1 answer
52 views

Measuring the success of text summarization

I am trying to make a text summarization program that will take a text article and reduce it to a para or 2. Since I am a newbie with no idea of NLP, it is hard to approach and break down the problem....
debaghtk's user avatar
  • 111
0 votes
0 answers
36 views

Summarize events per ID

Data: Each corresponds to an event (a person's visit to the hospital, as an example). I have a series of data associated with this event (duration of visit, motive, etc...). Objective: Summarize the ...
Diogo Santos's user avatar
1 vote
1 answer
729 views

UniLM - Unified Language Model for summarization

The UniLM claims to be the best approach for summarization task. But there doesn't seem to be any tutorial or how-to section in the README.md or any other blog. How exactly can I use this state-of-the-...
Nabin's user avatar
  • 113
1 vote
2 answers
288 views

Text summarization with limited number of words

I am reviewing summarization techniques and haven't (yet) found an approach to limit the length of a summary. So for example a summarization function that gives me a summary that is ...
Carol.Kar's user avatar
  • 187
3 votes
0 answers
92 views

summarizing time series dataset: extract time window sliding, change points, pattern seasonality in time series

I need to detect list of change points in time series dataset (temperature), and I need to split dataset into set of classes (patterns) and detect seasonality of each class (pattern). for example ...
Mina Younan's user avatar
0 votes
2 answers
99 views

Targeted information extraction / focused extractive summarization

I have a large collection of project manuals, each with a large number of pages. Each manual contains some form of summary paragraphs, although these are not necessarily similar in structure or format ...
HtG's user avatar
  • 3
1 vote
0 answers
153 views

Generate sentences using given data [closed]

I am working on an automated insights generation use case where I want to generate meaningful sentences from given aggregated data. For example, Data: ...
ProgramSpree's user avatar
2 votes
0 answers
40 views

Calculate a mean on condtions in a dataframe with dyplr

My table looks like this: ...
Christina Lucas's user avatar
1 vote
4 answers
8k views

Column sum in SPSS (with filter and grouped by date)?

...
Daniel Rivas's user avatar
1 vote
0 answers
38 views

Plotting Loss on Validation Set for Text Summarization Neural Net

I am using a seq2seq encoder-decoder neural net with attention to summarize text, but I think it may be overfitting. https://github.com/dongjun-Lee/text-summarization-tensorflow Is there a way to ...
J Doe's user avatar
  • 111
4 votes
1 answer
1k views

Detect sensitive data from unstructured text documents [closed]

I know this question is broad, but I need an advice to know if it's possible to achieve what I want to do. The problem is that I have around 2500 documents with sensitive data being replaced by four ...
user971961's user avatar
2 votes
1 answer
1k views

Is there a dataset with news articles and their headlines? [closed]

I need a set of news headlines and articles to help me in a project on automatic summarization. Is there such a dataset or something similar?
mosafattah's user avatar
0 votes
1 answer
445 views

Reducing text input size into word2vec without affecting performance too badly?

So I am implementing Word2Vec for the first time, and I have a set of training data that I would like to train a word2vec model on. Predictably, the problem is the dataset is rather large, and I have ...
ocean800's user avatar
  • 147
3 votes
7 answers
10k views

Should I use regex or machine learning?

I am thinking of two use cases: You submit a resume in PDF format to a web site and it extracts your contact information, job titles, etc. You receive an email from a friend that says, "let's have ...
I_Play_With_Data's user avatar
2 votes
0 answers
45 views

What other approaches are there for abstractive summarization, other then seq2seq?

I'm researching on abstractive text summarization, and has come across many recent papers. They all seem to be focusing on Sequence to Sequence models based on RNNs. Apart from RNNs, what other ...
Dee's user avatar
  • 21
1 vote
1 answer
8k views

finding themes from text documents

I have a text documents that contain 1000s of abstracts from medical whitepapers. I want to find themes from that text. Any suggestions other than text clustering since clustering helped me to find ...
sona_1105's user avatar
2 votes
2 answers
1k views

Extractive text summarization, as a classification problem using deep networks

I understand that this is broad, but I merely require a few pointers. I wish to implement a text summarization system. I have already tried out an abstractive approach, now I am trying an extractive ...
darthvader1996's user avatar
2 votes
2 answers
480 views

Extract sentences from beginning of news in single document summarization

I am working on Single Document Summarization task on News datasets. I do some experiments in this task. A simple experiment that I make and has a good result is extracting sentences just from ...
Mahmood Kohansal's user avatar