Skip to Main Content
Unicode Explained
book

Unicode Explained

by Jukka K. Korpela
June 2006
Beginner content levelBeginner
688 pages
26h 18m
English
O'Reilly Media, Inc.
Content preview from Unicode Explained
The files are in UTF-8 encoding, except NamesList.txt, which is ISO-8859-1. How-
ever, characters outside the ASCII range (Basic Latin block) appear in comments
only, except when noted otherwise in the description of the file. Thus, in most
cases, you can view and process the files as if they were ASCII encoded, at least if
you ignore the comments.
A comment starts with # and ends at the end of line. A comment does not belong
to the data itself but describes it.
One line corresponds to one logical record, typically specifying the value of a
property for one character.
Fields of a record are separated by semicolons. In some files, there is a semicolon
after the last field, too. When the fields are referred to in text, they are considered
as numbered starting from zero—as common in programming, since programming
language designers think in terms of displacements from a base address.
Leading and trailing spaces in a field are not significant.
The first field of a record usually indicates a code point or code point range. The
other fields specify property values for the code point(s).
Code points are expressed in the usual hexadecimal notation but without the “U+”
prefix, using at least four digits for a code number, with leading zeros as necessary.
A code point range is described by writing two periods (..) between code points
—e.g., 0000..007F.
However, in the UnicodeData.txt ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Unicode Demystified

Unicode Demystified

Richard Gillam
Fonts & Encodings

Fonts & Encodings

Yannis Haralambous
Core Java™ Data Objects

Core Java™ Data Objects

Sameer Tyagi, Keiron McCammon, Michael Vorburger, Heiko Bobzin

Publisher Resources

ISBN: 059610121XCatalog PageErrata