Text Mining and Visualization

Mining Unstructured User Reviews with Python 105

UTF-8 is one such encoding standard. In fact it is the de facto standard with over 90%

of all webpages now encoded as such. Figure 5.7 shows the word pillreports and a mocked

up version of the same word using strange but recognizable characters from other alphabets.

The mapping between the characters and the original ASCII byte is shown. In the mocked

up version, the layer of hex code points between the character and the subsequent byte(s)

is displayed. The original ASCII characters have a code point that maps to the same byte

as back in 1963.

5.1.4.3 Character Encoding in Python

The previous section