July 2017
Beginner to intermediate
486 pages
13h 49m
English
The linguistics aspect of normalization includes the concept text normalization. Text normalization is the process of transforming the given text into a single canonical form. Let's take an example to understand text normalization properly. If you are making a search application and you want the user to enter John, then John becomes a search string and all the strings that contain the word John should also pop up. If you are preparing data to search, then people prefer to take the stemmed format; even if you search flying or flew, ultimately these are forms that are derived from the word fly. So, the search system uses the stemmed form and other derived forms are removed. If you recall Chapter 3,
Read now
Unlock full access