6 Performance Evaluation of Large-Scale Summarization Systems

DOI: 10.1201/9781003371199-6

6.1 Evaluation of Summaries

Standard datasets for the evaluation of summaries are available extensively in the text summarization research. Few benchmark datasets extensively used for reporting accuracies of text summarization systems are:

  1. i. Document Understanding Conference (DUC) datasets [1] such as DUC 2001, DUC 2002, DUC 2003, DUC 2004, DUC 2005, DUC 2006, and DUC 2007

Document Understanding Conferences (DUC) was sponsored by the Advanced Research and Development Activity (ARDA). The conference series is run by the National Institute of Standards and Technology (NIST) to further progress in summarization and enable researchers to participate ...

Get Computational Techniques for Text Summarization based on Cognitive Intelligence now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.