How it works...
In step 1, we used BasicLineIterator, which is a basic, single-line sentence iterator without any customization involved.
In step 2, we used LineSentenceIterator to iterate through multi-sentence text data. Each line is considered a sentence here. We can use them for multiple lines of text.
In step 3, CollectionSentenceIterator will accept a list of strings as text input where each string represents a sentence (document). This can be a list of tweets or articles.
In step 4, FileSentenceIterator processes sentences in a file/directory. Sentences will be processed line by line from each file.
For anything complex, we recommend that you use UimaSentenceIterator, which is a proper machine learning level pipeline. It iterates over ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access