I need a set of news headlines and articles to help me in a project on automatic summarization. Is there such a dataset or something similar?

  • 4
    $\begingroup$ This is better suited for opendata.stackexchange.com $\endgroup$
    – oW_
    Commented Sep 10, 2018 at 16:57
  • $\begingroup$ Take a look at here. $\endgroup$ Commented Sep 10, 2018 at 17:06
  • 1
    $\begingroup$ There's one with Medium.com Blog posts! $\endgroup$
    – Aditya
    Commented Sep 11, 2018 at 6:31

1 Answer 1


The most widely used ones in text summarization research is the DUC dataset. If you see a paper using dataset "DUC 2015" or "DUC 2016" that's from here.

I have also personally used the Reuters arcihve. You just need to download each article with wget or something similar. See also here.

The CNN / DailyMail dataset is also widely used in summarization especially in recent years, although it labels itself as a Q&A dataset.

  • $\begingroup$ How can you log in to get the DUC dataset? I can't figure out how I can register with my institution's email. $\endgroup$
    – mosafattah
    Commented Sep 12, 2018 at 9:55
  • $\begingroup$ The link in the answer has instructions about how to request access to the dataset. Why not read it? $\endgroup$
    – user12075
    Commented Sep 12, 2018 at 14:26

Not the answer you're looking for? Browse other questions tagged or ask your own question.