December 2015
Intermediate to advanced
176 pages
3h 25m
English
If we have a good grasp of the analysis process described so far, a pipeline of an analyzer should be as shown in the following picture:

Text to be analyzed is primarily processed by the character filters. Then, a filter divides the text by tokenizers and tokens are obtained. In the final step, the token filters modify tokens.
Read now
Unlock full access