6. Text Summarization and Text Generation

Learning Objectives

By the end of this chapter, you will be able to:

  • Describe automated text summarization and its benefits
  • Describe the TextRank algorithm
  • Implement text summarization using Gensim
  • Implement text summarization using word frequency
  • Generate text using Markov chains

In this chapter, you will learn about the various ways in which text can be summarized and generated.


One huge challenge when dealing with text data is that data can be huge in size and can come in various forms, such as documents, emails, and web pages. Reading and understanding such data is a cumbersome task. Also, people tend to be less patient when it comes to reading huge amounts of information; ...

Get Natural Language Processing Fundamentals now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.