Python Natural Language Processing

What kind of preprocessing is required?

In our example of text summarization, if a raw dataset contains HTML tags, long text, repeated text, then during the process of developing your application, as well as in your output, you don't need the following data:

• You don't need HTML tags, so you can remove them
• You don't need repeated sentences, so you can remove them as well
• If there is long text content then if you can find stop words and high frequency small words, you should remove them