Training and combining ngram taggers
In addition to UnigramTagger
, there are two more NgramTagger
subclasses: BigramTagger
and TrigramTagger
. The BigramTagger
subclass uses the previous tag as part of its context, while the TrigramTagger
subclass uses the previous two tags. An ngram is a subsequence of n items, so the BigramTagger
subclass looks at two items (the previous tagged word and the current word), and the TrigramTagger
subclass looks at three items.
These two taggers are good at handling words whose part-of-speech tag is context-dependent. Many words have a different part of speech depending on how they are used. For example, we've been talking about taggers that tag words. In this case, tag is used as a verb. But the result of tagging ...
Get Natural Language Processing: Python and NLTK now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.