August 2019
Intermediate to advanced
560 pages
13h 41m
English
We will use the same input text and perform our analysis using the Kibana Dev Tools console. First, issue the command and click on the green arrow button in the top-right side of the panel. We collect the tokens generated in the panel on the right-hand side, as shown in the following screenshot. Then, we compile all the tokens generated into a table and list the English translation for each token:
The total number of tokens generated from the input text by the smartcn analyzer is 16. We can see that a three-character word is generated by smartcn. It seems to be better at text segmentation than the icu_analyzer analyzer. However, ...
Read now
Unlock full access