Compiler Construction

Chapter 2

Lexical Analyzer

This is the first phase of a compiler. The compiler spends most of its time (20–30% of compile time) in this phase because reading character by character is done only in this phase. If a lexical analyzer is implemented efficiently, the overall efficiency of the compiler improves. Lexical analyzers are used in text processing, query processing, and pattern matching tools.

CHAPTER OUTLINE

2.1  Introduction

2.2  Advantages of Separating Lexical Analysis from Syntax Analysis

2.3  Secondary Tasks of a Lexical Analyzer

2.4  Error Recovery in Lexical Analysis

2.5  Tokens, Patterns, Lexemes

2.6  Strategies for Implementing a Lexical Analyzer

2.7  Input Buffering

2.8  Specification of Tokens

2.9  Recognition of Tokens

2.10  Finite ...