Text Mining and Visualization

RapidMiner for Text Analytic Fundamentals 23

FIGURE 1.36: Analyzing the corpus: Process I Step B – Extract Content operator.

FIGURE 1.37: Analyzing the corpus: Process I Step B – Tokenize operator.

Finally, the last operator, Filter Stopwords (Dictionary), is a customized list of words

that you create in which to remove tokens that clutter the results and have no benefit in

their inclusion. This custom dictionary is created via Windows Notepad, and is saved as a

.txt file extension. In this case, the custom stopword dictionary is saved as speechstop.txt

(a copy of which is included with the processes for this chapter) and contains the words

represen