book

The Linux Command Line

Name: The Linux Command Line
Author: William E. Shotts Jr.
ISBN: 9781593273897

by William E. Shotts Jr.

January 2012

Beginner

480 pages

17h 46m

English

No Starch Press

Read now

Unlock full access

The Linux Command Line
Dedication
Acknowledgments
Introduction
Why Use the Command Line?What This Book Is AboutWho Should Read This BookWhat’s in This BookHow to Read This BookPrerequisites
I. Learning the Shell
1. What Is the Shell?
Terminal EmulatorsYour First KeystrokesCommand HistoryCursor MovementTry Some Simple CommandsEnding a Terminal Session
2. Navigation
Understanding the Filesystem TreeThe Current Working DirectoryListing the Contents of a DirectoryChanging the Current Working DirectoryAbsolute PathnamesRelative PathnamesSome Helpful Shortcuts
3. Exploring the System
More Fun with lsOptions and ArgumentsA Longer Look at Long FormatDetermining a File’s Type with fileViewing File Contents with lessA Guided TourSymbolic Links
4. Manipulating Files and Directories
Wildcardsmkdir—Create Directoriescp—Copy Files and Directoriesmv—Move and Rename Filesrm—Remove Files and Directoriesln—Create LinksHard LinksSymbolic LinksLet’s Build a PlaygroundCreating DirectoriesCopying FilesMoving and Renaming FilesCreating Hard LinksCreating Symbolic LinksRemoving Files and DirectoriesFinal Note
5. Working with Commands
What Exactly Are Commands?Identifying Commandstype—Display a Command’s Typewhich—Display an Executable’s LocationGetting a Command’s Documentationhelp—Get Help for Shell Builtins--help—Display Usage Informationman—Display a Program’s Manual Pageapropos—Display Appropriate Commandswhatis—Display a Very Brief Description of a Commandinfo—Display a Program’s Info EntryREADME and Other Program Documentation FilesCreating Your Own Commands with aliasRevisiting Old Friends

6. Redirection
Standard Input, Output, and ErrorRedirecting Standard OutputRedirecting Standard ErrorRedirecting Standard Output and Standard Error to One FileDisposing of Unwanted OutputRedirecting Standard Inputcat—Concatenate FilesPipelinesFiltersuniq—Report or Omit Repeated Lineswc—Print Line, Word, and Byte Countsgrep—Print Lines Matching a Patternhead/tail—Print First/Last Part of Filestee—Read from Stdin and Output to Stdout and FilesFinal Note
7. Seeing the World as the Shell Sees It
ExpansionPathname ExpansionTilde ExpansionArithmetic ExpansionBrace ExpansionParameter ExpansionCommand SubstitutionQuotingDouble QuotesSingle QuotesEscaping CharactersFinal Note
8. Advanced Keyboard Tricks
Command Line EditingCursor MovementModifying TextCutting and Pasting (Killing and Yanking) TextCompletionUsing HistorySearching HistoryHistory ExpansionFinal Note
9. Permissions
Owners, Group Members, and Everybody ElseReading, Writing, and Executingchmod—Change File ModeOctal RepresentationSymbolic RepresentationSetting File Mode with the GUIumask—Set Default PermissionsChanging Identitiessu—Run a Shell with Substitute User and Group IDssudo—Execute a Command as Another Userchown—Change File Owner and Groupchgrp—Change Group OwnershipExercising Your PrivilegesChanging Your Password
10. Processes
How a Process WorksViewing Processes with psViewing Processes Dynamically with topControlling ProcessesInterrupting a ProcessPutting a Process in the BackgroundReturning a Process to the ForegroundStopping (Pausing) a ProcessSignalsSending Signals to Processes with killSending Signals to Multiple Processes with killallMore Process-Related Commands
II. Configuration and the Environment
11. The Environment
What Is Stored in the Environment?Examining the EnvironmentSome Interesting VariablesHow Is the Environment Established?Login and Non-login ShellsWhat’s in a Startup File?Modifying the EnvironmentWhich Files Should We Modify?Text EditorsUsing a Text EditorActivating Our ChangesFinal Note
12. A Gentle Introduction to vi
Why We Should Learn viA Little BackgroundStarting and Stopping viEditing ModesEntering Insert ModeSaving Our WorkMoving the Cursor AroundBasic EditingAppending TextOpening a LineDeleting TextCutting, Copying, and Pasting TextJoining LinesSearch and ReplaceSearching Within a LineSearching the Entire FileGlobal Search and ReplaceEditing Multiple FilesSwitching Between FilesOpening Additional Files for EditingCopying Content from One File into AnotherInserting an Entire File into AnotherSaving Our Work
13. Customizing the Prompt
Anatomy of a PromptTrying Some Alternative Prompt DesignsAdding ColorMoving the CursorSaving the PromptFinal Note
III. Common Tasks and Essential Tools
14. Package Management
Packaging SystemsHow a Package System WorksPackage FilesRepositoriesDependenciesHigh- and Low-Level Package ToolsCommon Package Management TasksFinding a Package in a RepositoryInstalling a Package from a RepositoryInstalling a Package from a Package FileRemoving a PackageUpdating Packages from a RepositoryUpgrading a Package from a Package FileListing Installed PackagesDetermining Whether a Package Is InstalledDisplaying Information About an Installed PackageFinding Which Package Installed a FileFinal Note
15. Storage Media
Mounting and Unmounting Storage DevicesViewing a List of Mounted FilesystemsDetermining Device NamesCreating New FilesystemsManipulating Partitions with fdiskCreating a New Filesystem with mkfsTesting and Repairing FilesystemsFormatting Floppy DisksMoving Data Directly to and from DevicesCreating CD-ROM ImagesCreating an Image Copy of a CD-ROMCreating an Image from a Collection of FilesWriting CD-ROM ImagesMounting an ISO Image DirectlyBlanking a Rewritable CD-ROMWriting an ImageExtra Credit
16. Networking
Examining and Monitoring a Networkping—Send a Special Packet to a Network Hosttraceroute—Trace the Path of a Network Packetnetstat—Examine Network Settings and StatisticsTransporting Files over a Networkftp—Transfer Files with the File Transfer Protocollftp—A Better ftpwget—Non-interactive Network DownloaderSecure Communication with Remote Hostsssh—Securely Log in to Remote Computersscp and sftp—Securely Transfer Files
17. Searching for Files
locate—Find Files the Easy Wayfind—Find Files the Hard WayTestsOperatorsActionsPredefined ActionsUser-Defined ActionsImproving EfficiencyA Return to the PlaygroundOptions
18. Archiving and Backup
Compressing Filesgzip—Compress or Expand Filesbzip2—Higher Compression at the Cost of SpeedArchiving Filestar—Tape Archiving Utilityzip—Package and Compress FilesSynchronizing Files and Directoriesrsync—Remote File and Directory SynchronizationUsing rsync over a Network
19. Regular Expressions
What Are Regular Expressions?grep—Search Through TextMetacharacters and LiteralsThe Any CharacterAnchorsBracket Expressions and Character ClassesNegationTraditional Character RangesPOSIX Character ClassesPOSIX Basic vs. Extended Regular ExpressionsAlternationQuantifiers?—Match an Element Zero Times or One Time*—Match an Element Zero or More Times+—Match an Element One or More Times{ }—Match an Element a Specific Number of TimesPutting Regular Expressions to WorkValidating a Phone List with grepFinding Ugly Filenames with findSearching for Files with locateSearching for Text with less and vimFinal Note
20. Text Processing
Applications of TextDocumentsWeb PagesEmailPrinter OutputProgram Source CodeRevisiting Some Old Friendscat—Concatenate Files and Print on Standard Outputsort—Sort Lines of Text Filesuniq—Report or Omit Repeated LinesSlicing and Dicingcut—Remove Sections from Each Line of Filespaste—Merge Lines of Filesjoin—Join Lines of Two Files on a Common FieldComparing Textcomm—Compare Two Sorted Files Line by Linediff—Compare Files Line by Linepatch—Apply a diff to an OriginalEditing on the Flytr—Transliterate or Delete Characterssed—Stream Editor for Filtering and Transforming Textaspell—Interactive Spell CheckerFinal NoteExtra Credit
21. Formatting Output
Simple Formatting Toolsnl—Number Linesfold—Wrap Each Line to a Specified Lengthfmt—A Simple Text Formatterpr—Format Text for Printingprintf—Format and Print DataDocument Formatting SystemsThe roff Family and TEXgroff—A Document Formatting SystemFinal Note
22. Printing
A Brief History of PrintingPrinting in the Dim TimesCharacter-Based PrintersGraphical PrintersPrinting with LinuxPreparing Files for Printingpr—Convert Text Files for PrintingSending a Print Job to a Printerlpr—Print Files (Berkeley Style)lp—Print Files (System V Style)Another Option: a2psMonitoring and Controlling Print Jobslpstat—Display Print System Statuslpq—Display Printer Queue Statuslprm and cancel—Cancel Print Jobs
23. Compiling Programs
What Is Compiling?Are All Programs Compiled?Compiling a C ProgramObtaining the Source CodeExamining the Source TreeBuilding the ProgramInstalling the ProgramFinal Note
IV. Writing Shell Scripts
24. Writing Your First Script
What Are Shell Scripts?How to Write a Shell ScriptScript File FormatExecutable PermissionsScript File LocationGood Locations for ScriptsMore Formatting TricksLong Option NamesIndentation and Line ContinuationFinal Note
25. Starting a Project
First Stage: Minimal DocumentSecond Stage: Adding a Little DataVariables and ConstantsCreating Variables and ConstantsAssigning Values to Variables and ConstantsHere DocumentsFinal Note
26. Top-Down Design
Shell FunctionsLocal VariablesKeep Scripts RunningFinal Note
27. Flow Control: Branching with if
Using ifExit StatusUsing testFile ExpressionsString ExpressionsInteger ExpressionsA More Modern Version of test(( ))—Designed for IntegersCombining ExpressionsControl Operators: Another Way to BranchFinal Note
28. Reading Keyboard Input
read—Read Values from Standard InputOptionsSeparating Input Fields with IFSValidating InputMenusFinal NoteExtra Credit
29. Flow Control: Looping with while and until
LoopingwhileBreaking out of a LoopuntilReading Files with LoopsFinal Note
30. Troubleshooting
Syntactic ErrorsMissing QuotesMissing or Unexpected TokensUnanticipated ExpansionsLogical ErrorsDefensive ProgrammingVerifying InputTestingStubsTest CasesDebuggingFinding the Problem AreaTracingExamining Values During ExecutionFinal Note
31. Flow Control: Branching with case
casePatternsCombining Multiple PatternsFinal Note
32. Positional Parameters
Accessing the Command LineDetermining the Number of Argumentsshift—Getting Access to Many ArgumentsSimple ApplicationsUsing Positional Parameters with Shell FunctionsHandling Positional Parameters En MasseA More Complete ApplicationFinal Note
33. Flow Control: Looping with for
for: Traditional Shell Formfor: C Language FormFinal Note
34. Strings and Numbers
Parameter ExpansionBasic ParametersExpansions to Manage Empty VariablesExpansions That Return Variable NamesString OperationsArithmetic Evaluation and ExpansionNumber BasesUnary OperatorsSimple ArithmeticAssignmentBit OperationsLogicbc—An Arbitrary-Precision Calculator LanguageUsing bcAn Example ScriptFinal NoteExtra Credit
35. Arrays
What Are Arrays?Creating an ArrayAssigning Values to an ArrayAccessing Array ElementsArray OperationsOutputting the Entire Contents of an ArrayDetermining the Number of Array ElementsFinding the Subscripts Used by an ArrayAdding Elements to the End of an ArraySorting an ArrayDeleting an ArrayFinal Note
36. Exotica
Group Commands and SubshellsPerforming RedirectionsProcess SubstitutionTrapsAsynchronous ExecutionwaitNamed PipesSetting Up a Named PipeUsing Named PipesFinal Note
Index
Colophon
A. Updates
Copyright

Content preview from The Linux Command Line

Chapter 20. Text Processing

All Unix-like operating systems rely heavily on text files for several types of data storage. So it makes sense that there are many tools for manipulating text. In this chapter, we will look at programs that are used to “slice and dice” text. In the next chapter, we will look at more text processing, focusing on programs that are used to format text for printing and other kinds of human consumption.

This chapter will revisit some old friends and introduce us to some new ones:

cat—Concatenate files and print on the standard output.
sort—Sort lines of text files.
uniq—Report or omit repeated lines.
cut—Remove sections from each line of files.
paste—Merge lines of files.
join—Join lines of two files on a common field.
comm—Compare ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781593273897Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

The Linux Command Line

by William E. Shotts Jr.

Chapter 20. Text Processing

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.