Building Machine Learning Systems with Python - Third Edition

Our first estimator

Now, we have everything in place to create our own first vectorizer. The most convenient way to do it is to inherit it from BaseEstimator. It requires us to implement the following three methods:

• get_feature_names(): This returns a list of strings of the features that we will return in transform().
• fit(document, y=None): As we are not implementing a classifier, we can ignore this one and simply return self.
• transform(documents): This returns numpy.array(), containing an array of a shape (len(documents), len(get_feature_names)). This means, for every document in documents, it has to return a value for every feature name in get_feature_names().

Here is the implementation:

sent_word_net = load_sent_word_net()
    
 class LinguisticVectorizer(BaseEstimator): ...