Hands-On Exploratory Data Analysis with Python

Extracting keywords

The next step is to extract the keywords from the title. There are several ways we can extract keywords. Here, we are going to use the TfidfVectorizer utility method provided by the sklearn.feature_extraction module. Let's get started:

1. To use the library, we need to import the essential libraries:

from sklearn.feature_extraction.text import TfidfVectorizerfrom sklearn.cluster import MiniBatchKMeansfrom sklearn.decomposition import PCAfrom sklearn.manifold import TSNE

2. Next, let's learn how to extract the keywords:

tfidf = TfidfVectorizer(   min_df = 5,    max_df = 0.95,    max_features = 8000,    stop_words = 'english')tfidf.fit(df.Title)text = tfidf.transform(df.Title)

You can find out more about TfidfVectorizer by reading the ...