book

Mastering Regular Expressions, 3rd Edition

Name: Mastering Regular Expressions, 3rd Edition
Author: Jeffrey E.F. Friedl
ISBN: 9780596528126

by Jeffrey E.F. Friedl

August 2006

Intermediate to advanced

542 pages

15h 33m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Cover Page
Title Page
Copyright Page
Dedication
Table of Contents
Preface
1: Introduction to Regular Expressions
Solving Real ProblemsRegular Expressions as a LanguageThe Filename AnalogyThe Language AnalogyThe Regular-Expression Frame of MindIf You Have Some Regular-Expression ExperienceSearching Text Files: EgrepEgrep MetacharactersStart and End of the LineCharacter ClassesMatching Any Character with DotAlternationIgnoring Differences in CapitalizationWord BoundariesIn a NutshellOptional ItemsOther Quantifiers: RepetitionParentheses and BackreferencesThe Great EscapeExpanding the FoundationLinguistic DiversificationThe Goal of a Regular ExpressionA Few More ExamplesRegular Expression NomenclatureImproving on the Status QuoSummaryPersonal Glimpses
2: Extended Introductory Examples
About the ExamplesA Short Introduction to PerlMatching Text with Regular ExpressionsToward a More Real-World ExampleSide Effects of a Successful MatchIntertwined Regular ExpressionsIntermissionModifying Text with Regular ExpressionsExample: Form LetterExample: Prettifying a Stock PriceAutomated EditingA Small Mail UtilityAdding Commas to a Number with LookaroundText-to-HTML ConversionThat Doubled-Word Thing
3: Overview of Regular Expression Features and Flavors
A Casual Stroll Across the Regex LandscapeThe Origins of Regular ExpressionsAt a GlanceCare and Handling of Regular ExpressionsIntegrated HandlingProcedural and Object-Oriented HandlingA Search-and-Replace ExampleSearch and Replace in Other LanguagesCare and Handling: SummaryStrings, Character Encodings, and ModesStrings as Regular ExpressionsCharacter-Encoding IssuesUnicodeRegex Modes and Match ModesCommon Metacharacters and FeaturesCharacter RepresentationsCharacter Classes and Class-Like ConstructsAnchors and Other “Zero-Width Assertions”Comments and Mode ModifiersGrouping, Capturing, Conditionals, and ControlGuide to the Advanced Chapters
4: The Mechanics of Expression Processing
Start Your Engines!Two Kinds of EnginesNew StandardsRegex Engine TypesFrom the Department of Redundancy DepartmentTesting the Engine TypeMatch BasicsAbout the ExamplesRule 1: The Match That Begins Earliest WinsEngine Pieces and PartsRule 2: The Standard Quantifiers Are GreedyRegex-Directed Versus Text-DirectedNFA Engine: Regex-DirectedDFA Engine: Text-DirectedFirst Thoughts: NFA and DFA in ComparisonBacktrackingA Really Crummy AnalogyTwo Important Points on BacktrackingSaved StatesBacktracking and GreedinessMore About Greediness and BacktrackingProblems of GreedinessMulti-Character “Quotes”Using Lazy QuantifiersGreediness and Laziness Always Favor a MatchThe Essence of Greediness, Laziness, and BacktrackingPossessive Quantifiers and Atomic GroupingPossessive Quantifiers, ?+, *+, ++, and {m,n}+The Backtracking of LookaroundIs Alternation Greedy?Taking Advantage of Ordered AlternationNFA, DFA, and POSIX“The Longest-Leftmost”POSIX and the Longest-Leftmost RuleSpeed and EfficiencySummary: NFA and DFA in ComparisonSummary

5: Practical Regex Techniques
Regex Balancing ActA Few Short ExamplesContinuing with Continuation LinesMatching an IP AddressWorking with FilenamesMatching Balanced Sets of ParenthesesWatching Out for Unwanted MatchesMatching Delimited TextKnowing Your Data and Making AssumptionsStripping Leading and Trailing WhitespaceHTML-Related ExamplesMatching an HTML TagMatching an HTML LinkExamining an HTTP URLValidating a HostnamePlucking Out a URL in the Real WorldExtended ExamplesKeeping in Sync with Your DataParsing CSV Files
6: Crafting an Efficient Expression
A Sobering ExampleA Simple Change—Placing Your Best Foot ForwardEfficiency Versus CorrectnessAdvancing Further—Localizing the GreedinessReality CheckA Global View of BacktrackingMore Work for a POSIX NFAWork Required During a Non-MatchBeing More SpecificAlternation Can Be ExpensiveBenchmarkingKnow What You’re MeasuringBenchmarking with PHPBenchmarking with JavaBenchmarking with VB.NETBenchmarking with RubyBenchmarking with PythonBenchmarking with TclCommon OptimizationsNo Free LunchEveryone’s Lunch is DifferentThe Mechanics of Regex ApplicationPre-Application OptimizationsOptimizations with the TransmissionOptimizations of the Regex ItselfTechniques for Faster ExpressionsCommon Sense TechniquesExpose Literal TextExpose AnchorsLazy Versus Greedy: Be SpecificSplit Into Multiple Regular ExpressionsMimic Initial-Character DiscriminationUse Atomic Grouping and Possessive QuantifiersLead the Engine to a MatchUnrolling the LoopMethod 1: Building a Regex From Past ExperiencesThe Real “Unrolling-the-Loop” PatternMethod 2: A Top-Down ViewMethod 3: An Internet HostnameObservationsUsing Atomic Grouping and Possessive QuantifiersShort Unrolling ExamplesUnrolling C CommentsThe Freeflowing RegexA Helping Hand to Guide the MatchA Well-Guided Regex is a Fast RegexWrapupIn Summary: Think!
7: Perl
Regular Expressions as a Language ComponentPerl’s Greatest StrengthPerl’s Greatest WeaknessPerl’s Regex FlavorRegex Operands and Regex LiteralsHow Regex Literals Are ParsedRegex ModifiersRegex-Related PerlismsExpression ContextDynamic Scope and Regex Match EffectsSpecial Variables Modified by a MatchThe qr/···/ Operator and Regex ObjectsBuilding and Using Regex ObjectsViewing Regex ObjectsUsing Regex Objects for EfficiencyThe Match OperatorMatch’s Regex OperandSpecifying the Match Target OperandDifferent Uses of the Match OperatorIterative Matching: Scalar Context, with /gThe Match Operator’s Environmental RelationsThe Substitution OperatorThe Replacement OperandThe /e ModifierContext and Return ValueThe Split OperatorBasic SplitReturning Empty ElementsSplit’s Special Regex OperandsSplit’s Match Operand with Capturing ParenthesesFun with Perl EnhancementsUsing a Dynamic Regex to Match Nested PairsUsing the Embedded-Code ConstructUsing local in an Embedded-Code ConstructA Warning About Embedded Code and my VariablesMatching Nested Constructs with Embedded CodeOverloading Regex LiteralsProblems with Regex-Literal OverloadingMimicking Named Capture
Perl Efficiency Issues
“There’s More Than One Way to Do It”Regex Compilation, the /o Modifier, qr/···/, and EfficiencyUnderstanding the “Pre-Match” CopyThe Study FunctionBenchmarkingRegex Debugging InformationFinal Comments
8: Java
Java’s Regex FlavorJava Support for \p{···} and \P{···}Unicode Line TerminatorsUsing java.util.regexThe Pattern.compile() FactoryPattern’s matcher methodThe Matcher ObjectApplying the RegexQuerying Match ResultsSimple Search and ReplaceAdvanced Search and ReplaceIn-Place Search and ReplaceThe Matcher’s RegionMethod ChainingMethods for Building a ScannerOther Matcher MethodsOther Pattern MethodsPattern’s split Method, with One ArgumentPattern’s split Method, with Two ArgumentsAdditional ExamplesAdding Width and Height Attributes to Image TagsValidating HTML with Multiple Patterns Per MatcherParsing Comma-Separated Values (CSV) TextJava Version DifferencesDifferences Between 1.4.2 and 1.5.0Differences Between 1.5.0 and 1.6
9: .NET
.NET’s Regex FlavorAdditional Comments on the FlavorUsing .NET Regular ExpressionsRegex QuickstartPackage OverviewCore Object OverviewCore Object DetailsCreating Regex ObjectsUsing Regex ObjectsUsing Match ObjectsUsing Group ObjectsStatic “Convenience” FunctionsRegex CachingSupport FunctionsAdvanced .NETRegex AssembliesMatching Nested ConstructsCapture Objects
10: PHP
PHP’s Regex FlavorThe Preg Function Interface“Pattern” ArgumentsThe Preg Functionspreg_matchpreg_match_allpreg_replacepreg_replace_callbackpreg_splitpreg_greppreg_quote“Missing” Preg Functionspreg_regex_to_patternSyntax-Checking an Unknown Pattern ArgumentSyntax-Checking an Unknown RegexRecursive ExpressionsMatching Text with Nested ParenthesesNo Backtracking Into RecursionMatching a Set of Nested ParenthesesPHP Efficiency IssuesThe S Pattern Modifier: “Study”Extended ExamplesCSV Parsing with PHPChecking Tagged Data for Proper Nesting
Index
About the Author
Colophon
Footnotes
Chapter 1Chapter 2Chapter 3Chapter 4Chapter 5Chapter 6Chapter 7Chapter 8Chapter 9Chapter 10

Overview

Regular expressions are an extremely powerful tool for manipulating text and data. They are now standard features in a wide range of languages and popular tools, including Perl, Python, Ruby, Java, VB.NET and C# (and any language using the .NET Framework), PHP, and MySQL.

If you don't use regular expressions yet, you will discover in this book a whole new world of mastery over your data. If you already use them, you'll appreciate this book's unprecedented detail and breadth of coverage. If you think you know all you need to know about regularexpressions, this book is a stunning eye-opener.

As this book shows, a command of regular expressions is an invaluable skill. Regular expressions allow you to code complex and subtle text processing that you never imagined could be automated. Regular expressions can save you time and aggravation. They can be used to craft elegant solutions to a wide range of problems. Once you've mastered regular expressions, they'll become an invaluable part of your toolkit. You will wonder how you ever got by without them.

Yet despite their wide availability, flexibility, and unparalleled power, regular expressions are frequently underutilized. Yet what is power in the hands of an expert can be fraught with peril for the unwary. Mastering Regular Expressions will help you navigate the minefield to becoming an expert and help you optimize your use of regular expressions.

Mastering Regular Expressions, Third Edition, now includes a full chapter devoted to PHP and its powerful and expressive suite of regular expression functions, in addition to enhanced PHP coverage in the central "core" chapters. Furthermore, this edition has been updated throughout to reflect advances in other languages, including expanded in-depth coverage of Sun's java.util.regex package, which has emerged as the standard Java regex implementation.Topics include:

A comparison of features among different versions of many languages and tools
How the regular expression engine works
Optimization (major savings available here!)
Matching just what you want, but not what you don't want
Sections and chapters on individual languages

Written in the lucid, entertaining tone that makes a complex, dry topic become crystal-clear to programmers, and sprinkled with solutions to complex real-world problems, Mastering Regular Expressions, Third Edition offers a wealth information that you can put to immediateuse.

Reviews of this new edition and the second edition:

"There isn't a better (or more useful) book available on regular expressions."

--Zak Greant, Managing Director, eZ Systems

"A real tour-de-force of a book which not only covers the mechanics of regexes in extraordinary detail but also talks about efficiency and the use of regexes in Perl, Java, and .NET...If you use regular expressions as part of your professional work (even if you already have a good book on whatever language you're programming in) I would strongly recommend this book to you."

--Dr. Chris Brown, Linux Format

"The author does an outstanding job leading the reader from regexnovice to master. The book is extremely easy to read and chock full ofuseful and relevant examples...Regular expressions are valuable toolsthat every developer should have in their toolbox. Mastering RegularExpressions is the definitive guide to the subject, and an outstandingresource that belongs on every programmer's bookshelf. Ten out of TenHorseshoes."

--Jason Menard, Java Ranch

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Regular Expressions Cookbook, 2nd Edition

Publisher Resources

ISBN: 0596528124Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills