book

The Art of 64-Bit Assembly, Volume 1

Name: The Art of 64-Bit Assembly, Volume 1
Author: Randall Hyde
ISBN: 9781718501089

by Randall Hyde

October 2021

Beginner

1032 pages

24h 43m

English

No Starch Press

Read now

Unlock full access

Title Page
Copyright
Dedication
About the Author
Foreword
Acknowledgments
Introduction
Part I: Machine Organization
Chapter 1: Hello, World of Assembly Language
1.1 What You’ll Need 1.2 Setting Up MASM on Your Machine 1.3 Setting Up a Text Editor on Your Machine 1.4 The Anatomy of a MASM Program 1.5 Running Your First MASM Program 1.6 Running Your First MASM/C++ Hybrid Program 1.8 The Memory Subsystem 1.9 Declaring Memory Variables in MASM1.9.1 Associating Memory Addresses with Variables1.9.2 Associating Data Types with Variables 1.10 Declaring (Named) Constants in MASM 1.11 Some Basic Machine Instructions1.11.1 The mov Instruction1.11.2 Type Checking on Instruction Operands1.11.3 The add and sub Instructions1.11.4 The lea Instruction1.11.5 The call and ret Instructions and MASM Procedures 1.12 Calling C/C++ Procedures 1.13 Hello, World! 1.14 Returning Function Results in Assembly Language 1.15 Automating the Build Process 1.16 Microsoft ABI Notes1.16.1 Variable Size1.16.2 Register Usage1.16.3 Stack Alignment 1.17 For More Information 1.18 Test Yourself
Chapter 2: Computer Data Representation and Operations
2.1 Numbering Systems2.1.1 A Review of the Decimal System2.1.2 The Binary Numbering System2.1.3 Binary Conventions 2.2 The Hexadecimal Numbering System 2.3 A Note About Numbers vs. Representation 2.4 Data Organization2.4.1 Bits2.4.2 Nibbles2.4.3 Bytes2.4.4 Words2.4.5 Double Words2.4.6 Quad Words and Octal Words 2.5 Logical Operations on Bits2.5.1 The AND Operation2.5.2 The OR Operation2.5.3 The XOR Operation2.5.4 The NOT Operation 2.6 Logical Operations on Binary Numbers and Bit Strings 2.7 Signed and Unsigned Numbers 2.8 Sign Extension and Zero Extension 2.9 Sign Contraction and Saturation2.10.1 The jmp Instruction2.10.2 The Conditional Jump Instructions2.10.3 The cmp Instruction and Corresponding Conditional Jumps2.10.4 Conditional Jump Synonyms 2.11 Shifts and Rotates 2.12 Bit Fields and Packed Data 2.13 IEEE Floating-Point Formats2.13.1 Single-Precision Format2.13.2 Double-Precision Format2.13.3 Extended-Precision Format2.13.4 Normalized Floating-Point Values2.13.5 Non-Numeric Values2.13.6 MASM Support for Floating-Point Values 2.14 Binary-Coded Decimal Representation 2.15 Characters2.15.1 The ASCII Character Encoding2.15.2 MASM Support for ASCII Characters 2.16 The Unicode Character Set2.16.1 Unicode Code Points2.16.2 Unicode Code Planes2.16.3 Unicode Encodings 2.17 MASM Support for Unicode 2.18 For More Information 2.19 Test Yourself

Chapter 3: Memory Access and Organization
3.1 Runtime Memory Organization3.1.1 The .code Section3.1.2 The .data Section3.1.3 The .const Section3.1.4 The .data? Section3.1.5 Organization of Declaration Sections Within Your Programs3.1.6 Memory Access and 4K Memory Management Unit Pages 3.2 How MASM Allocates Memory for Variables 3.3 The Label Declaration 3.4 Little-Endian and Big-Endian Data Organization 3.5 Memory Access 3.6 MASM Support for Data Alignment 3.7 The x86-64 Addressing Modes3.7.1 x86-64 Register Addressing Modes3.7.2 x86-64 64-Bit Memory Addressing Modes3.7.3 Large Address Unaware Applications 3.8 Address Expressions 3.9 The Stack Segment and the push and pop Instructions3.9.1 The Basic push Instruction3.9.2 The Basic pop Instruction3.9.3 Preserving Registers with the push and pop Instructions 3.10 The Stack Is a LIFO Data Structure 3.11 Other push and pop Instructions 3.12 Removing Data from the Stack Without Popping It 3.13 Accessing Data You’ve Pushed onto the Stack Without Popping It 3.14 Microsoft ABI Notes 3.15 For More Information 3.16 Test Yourself
Chapter 4: Constants, Variables, and Data Types
4.1 The imul Instruction 4.2 The inc and dec Instructions 4.3 MASM Constant Declarations4.3.1 Constant Expressions4.3.2 this and $ Operators4.3.3 Constant Expression Evaluation 4.4 The MASM typedef Statement 4.5 Type Coercion 4.6 Pointer Data Types4.6.1 Using Pointers in Assembly Language4.6.2 Declaring Pointers in MASM4.6.3 Pointer Constants and Pointer Constant Expressions4.6.4 Pointer Variables and Dynamic Memory Allocation4.6.5 Common Pointer Problems 4.7 Composite Data Types 4.8 Character Strings4.8.1 Zero-Terminated Strings4.8.2 Length-Prefixed Strings4.8.3 String Descriptors4.8.4 Pointers to Strings4.8.5 String Functions 4.9 Arrays4.9.1 Declaring Arrays in Your MASM Programs4.9.2 Accessing Elements of a Single-Dimensional Array4.9.3 Sorting an Array of Values 4.10 Multidimensional Arrays4.10.1 Row-Major Ordering4.10.2 Column-Major Ordering4.10.3 Allocating Storage for Multidimensional Arrays4.10.4 Accessing Multidimensional Array Elements in Assembly Language 4.11 Records/Structs4.11.1 MASM Struct Declarations4.11.2 Accessing Record/Struct Fields4.11.3 Nesting MASM Structs4.11.4 Initializing Struct Fields4.11.5 Arrays of Structs4.11.6 Aligning Fields Within a Record 4.12 Unions4.12.1 Anonymous Unions4.12.2 Variant Types 4.13 Microsoft ABI Notes 4.14 For More Information 4.15 Test Yourself
Part II: Assembly Language Programming
Chapter 5: Procedures
5.1 Implementing Procedures5.1.1 The call and ret Instructions5.1.2 Labels in a Procedure 5.2 Saving the State of the Machine 5.3 Procedures and the Stack5.3.1 Activation Records5.3.2 The Assembly Language Standard Entry Sequence5.3.3 The Assembly Language Standard Exit Sequence 5.4 Local (Automatic) Variables5.4.1 Low-Level Implementation of Automatic (Local) Variables5.4.2 The MASM Local Directive5.4.3 Automatic Allocation 5.5 Parameters5.5.1 Pass by Value5.5.2 Pass by Reference5.5.3 Low-Level Parameter Implementation5.5.4 Declaring Parameters with the proc Directive5.5.5 Accessing Reference Parameters on the Stack 5.6 Calling Conventions and the Microsoft ABI 5.7 The Microsoft ABI and Microsoft Calling Convention5.7.1 Data Types and the Microsoft ABI5.7.2 Parameter Locations5.7.3 Volatile and Nonvolatile Registers5.7.4 Stack Alignment5.7.5 Parameter Setup and Cleanup (or “What’s with These Magic Instructions?”) 5.8 Functions and Function Results 5.9 Recursion 5.10 Procedure Pointers 5.11 Procedural Parameters 5.12 Saving the State of the Machine, Part II 5.13 Microsoft ABI Notes 5.14 For More Information 5.15 Test Yourself
Chapter 6: Arithmetic
6.1 x86-64 Integer Arithmetic Instructions6.1.1 Sign- and Zero-Extension Instructions6.1.2 The mul and imul Instructions6.1.3 The div and idiv Instructions6.1.4 The cmp Instruction, Revisited6.1.5 The setcc Instructions6.1.6 The test Instruction 6.2 Arithmetic Expressions6.2.1 Simple Assignments6.2.2 Simple Expressions6.2.3 Complex Expressions6.2.4 Commutative Operators 6.3 Logical (Boolean) Expressions 6.4 Machine and Arithmetic Idioms6.4.1 Multiplying Without mul or imul6.4.2 Dividing Without div or idiv6.4.3 Implementing Modulo-N Counters with AND 6.5 Floating-Point Arithmetic6.5.1 Floating-Point on the x86-646.5.2 FPU Registers6.5.3 FPU Data Types6.5.4 The FPU Instruction Set6.5.5 FPU Data Movement Instructions6.5.6 Conversions6.5.7 Arithmetic Instructions6.5.8 Comparison Instructions6.5.9 Constant Instructions6.5.10 Transcendental Instructions6.5.11 Miscellaneous Instructions 6.6 Converting Floating-Point Expressions to Assembly Language6.6.1 Converting Arithmetic Expressions to Postfix Notation6.6.2 Converting Postfix Notation to Assembly Language 6.7 SSE Floating-Point Arithmetic6.7.1 SSE MXCSR Register6.7.2 SSE Floating-Point Move Instructions6.7.3 SSE Floating-Point Arithmetic Instructions6.7.4 SSE Floating-Point Comparisons6.7.5 SSE Floating-Point Conversions 6.8 For More Information 6.9 Test Yourself
Chapter 7: Low-Level Control Structures
7.1 Statement Labels7.1.1 Using Local Symbols in Procedures7.1.2 Initializing Arrays with Label Addresses 7.2 Unconditional Transfer of Control (jmp)7.2.1 Register-Indirect Jumps7.2.2 Memory-Indirect Jumps 7.3 Conditional Jump Instructions 7.4 Trampolines 7.5 Conditional Move Instructions 7.6 Implementing Common Control Structures in Assembly Language7.6.1 Decisions7.6.2 if/then/else Sequences7.6.3 Complex if Statements Using Complete Boolean Evaluation7.6.4 Short-Circuit Boolean Evaluation7.6.5 Short-Circuit vs. Complete Boolean Evaluation7.6.6 Efficient Implementation of if Statements in Assembly Language7.6.7 switch/case Statements 7.7 State Machines and Indirect Jumps 7.8 Loops7.8.1 while Loops7.8.2 repeat/until Loops7.8.3 forever/endfor Loops7.8.4 for Loops7.8.5 The break and continue Statements7.8.6 Register Usage and Loops 7.9 Loop Performance Improvements7.9.1 Moving the Termination Condition to the End of a Loop7.9.2 Executing the Loop Backward7.9.3 Using Loop-Invariant Computations7.9.4 Unraveling Loops7.9.5 Using Induction Variables 7.10 For More Information 7.11 Test Yourself
Chapter 8: Advanced Arithmetic
8.1 Extended-Precision Operations8.1.1 Extended-Precision Addition8.1.2 Extended-Precision Subtraction8.1.3 Extended-Precision Comparisons8.1.4 Extended-Precision Multiplication8.1.5 Extended-Precision Division8.1.6 Extended-Precision Negation Operations8.1.7 Extended-Precision AND Operations8.1.8 Extended-Precision OR Operations8.1.9 Extended-Precision XOR Operations8.1.10 Extended-Precision NOT Operations8.1.11 Extended-Precision Shift Operations8.1.12 Extended-Precision Rotate Operations 8.2 Operating on Different-Size Operands 8.3 Decimal Arithmetic8.3.1 Literal BCD Constants8.3.2 Packed Decimal Arithmetic Using the FPU 8.4 For More Information 8.5 Test Yourself
Chapter 9: Numeric Conversion
9.1 Converting Numeric Values to Strings9.1.1 Converting Numeric Values to Hexadecimal Strings9.1.2 Converting Extended-Precision Hexadecimal Values to Strings9.1.3 Converting Unsigned Decimal Values to Strings9.1.4 Converting Signed Integer Values to Strings9.1.5 Converting Extended-Precision Unsigned Integers to Strings9.1.6 Converting Extended-Precision Signed Decimal Values to Strings9.1.7 Formatted Conversions9.1.8 Converting Floating-Point Values to Strings 9.2 String-to-Numeric Conversion Routines9.2.1 Converting Decimal Strings to Integers9.2.2 Converting Hexadecimal Strings to Numeric Form9.2.3 Converting Unsigned Decimal Strings to Integers9.2.4 Conversion of Extended-Precision String to Unsigned Integer 9.2.5 Conversion of Extended-Precision Signed Decimal String to Integer9.2.6 Conversion of Real String to Floating-Point 9.3 For More Information 9.4 Test Yourself
Chapter 10: Table Lookups
10.1 Tables10.1.1 Function Computation via Table Lookup10.1.2 Generating Tables10.1.3 Table-Lookup Performance 10.2 For More Information 10.3 Test Yourself
Chapter 11: SIMD Instructions
11.1 The SSE/AVX Architectures 11.2 Streaming Data Types 11.3 Using cpuid to Differentiate Instruction Sets 11.4 Full-Segment Syntax and Segment Alignment 11.5 SSE, AVX, and AVX2 Memory Operand Alignment 11.6 SIMD Data Movement Instructions11.6.1 The (v)movd and (v)movq Instructions11.6.2 The (v)movaps, (v)movapd, and (v)movdqa Instructions11.6.3 The (v)movups, (v)movupd, and (v)movdqu Instructions11.6.4 Performance of Aligned and Unaligned Moves11.6.5 The (v)movlps and (v)movlpd Instructions11.6.6 The movhps and movhpd Instructions11.6.7 The vmovhps and vmovhpd Instructions11.6.8 The movlhps and vmovlhps Instructions11.6.9 The movhlps and vmovhlps Instructions11.6.10 The (v)movshdup and (v)movsldup Instructions11.6.11 The (v)movddup Instruction11.6.12 The (v)lddqu Instruction11.6.13 Performance Issues and the SIMD Move Instructions11.6.14 Some Final Comments on the SIMD Move Instructions 11.7 The Shuffle and Unpack Instructions11.7.1 The (v)pshufb Instructions11.7.2 The (v)pshufd Instructions11.7.3 The (v)pshuflw and (v)pshufhw Instructions11.7.4 The shufps and shufpd Instructions11.7.5 The vshufps and vshufpd Instructions11.7.6 The (v)unpcklps, (v)unpckhps, (v)unpcklpd, and (v)unpckhpd Instructions11.7.7 The Integer Unpack Instructions11.7.8 The (v)pextrb, (v)pextrw, (v)pextrd, and (v)pextrq Instructions11.7.9 The (v)pinsrb, (v)pinsrw, (v)pinsrd, and (v)pinsrq Instructions11.7.10 The (v)extractps and (v)insertps Instructions 11.8 SIMD Arithmetic and Logical Operations 11.9 The SIMD Logical (Bitwise) Instructions11.9.1 The (v)ptest Instructions11.9.2 The Byte Shift Instructions11.9.3 The Bit Shift Instructions 11.10 The SIMD Integer Arithmetic Instructions11.10.1 SIMD Integer Addition11.10.2 Horizontal Additions11.10.3 Double-Word–Sized Horizontal Additions11.10.4 SIMD Integer Subtraction11.10.5 SIMD Integer Multiplication11.10.6 SIMD Integer Averages11.10.7 SIMD Integer Minimum and Maximum11.10.8 SIMD Integer Absolute Value11.10.9 SIMD Integer Sign Adjustment Instructions11.10.10 SIMD Integer Comparison Instructions11.10.11 Integer Conversions 11.11 SIMD Floating-Point Arithmetic Operations 11.12 SIMD Floating-Point Comparison Instructions11.12.1 SSE and AVX Comparisons11.12.2 Unordered vs. Ordered Comparisons11.12.3 Signaling and Quiet Comparisons11.12.4 Instruction Synonyms11.12.5 AVX Extended Comparisons11.12.6 Using SIMD Comparison Instructions11.12.7 The (v)movmskps, (v)movmskpd Instructions 11.13 Floating-Point Conversion Instructions 11.14 Aligning SIMD Memory Accesses 11.15 Aligning Word, Dword, and Qword Object Addresses 11.16 Filling an XMM Register with Several Copies of the Same Value 11.17 Loading Some Common Constants Into XMM and YMM Registers 11.18 Setting, Clearing, Inverting, and Testing a Single Bit in an SSE Register 11.19 Processing Two Vectors by Using a Single Incremented Index 11.20 Aligning Two Addresses to a Boundary 11.21 Working with Blocks of Data Whose Length Is Not a Multiple of the SSE/AVX Register Size 11.22 Dynamically Testing for a CPU Feature 11.23 The MASM Include Directive 11.24 And a Whole Lot More 11.25 For More Information 11.26 Test Yourself
Chapter 12: Bit Manipulation
12.1 What Is Bit Data, Anyway? 12.2 Instructions That Manipulate Bits12.2.1 The and Instruction12.2.2 The or Instruction12.2.3 The xor Instruction12.2.4 Flag Modification by Logical Instructions12.2.5 The Bit Test Instructions12.2.6 Manipulating Bits with Shift and Rotate Instructions 12.3 The Carry Flag as a Bit Accumulator 12.4 Packing and Unpacking Bit Strings 12.5 BMI1 Instructions to Extract Bits and Create Bit Masks 12.6 Coalescing Bit Sets and Distributing Bit Strings 12.7 Coalescing and Distributing Bit Strings Using BMI2 Instructions 12.8 Packed Arrays of Bit Strings 12.9 Searching for a Bit 12.10 Counting Bits 12.11 Reversing a Bit String 12.12 Merging Bit Strings 12.13 Extracting Bit Strings 12.14 Searching for a Bit Pattern 12.15 For More Information 12.16 Test Yourself
Chapter 13: Macros and the MASM Compile-Time Language
13.2 The echo and .err Directives 13.3 Compile-Time Constants and Variables 13.4 Compile-Time Expressions and Operators13.4.1 The MASM Escape (!) Operator13.4.2 The MASM Evaluation (%) Operator13.4.3 The catstr Directive13.4.4 The instr Directive13.4.5 The sizestr Directive13.4.6 The substr Directive 13.5 Conditional Assembly (Compile-Time Decisions) 13.6 Repetitive Assembly (Compile-Time Loops) 13.7 Macros (Compile-Time Procedures) 13.8 Standard Macros 13.9 Macro Parameters13.9.1 Standard Macro Parameter Expansion13.9.2 Optional and Required Macro Parameters13.9.3 Default Macro Parameter Values13.9.4 Macros with a Variable Number of Parameters13.9.5 The Macro Expansion (&) Operator 13.10 Local Symbols in a Macro 13.11 The exitm Directive 13.12 MASM Macro Function Syntax 13.13 Macros as Compile-Time Procedures and Functions 13.14 Writing Compile-Time “Programs”13.14.1 Constructing Data Tables at Compile Time13.14.2 Unrolling Loops 13.15 Simulating HLL Procedure Calls13.15.1 HLL-Like Calls with No Parameters13.15.2 HLL-Like Calls with One Parameter13.15.3 Using opattr to Determine Argument Types13.15.4 HLL-Like Calls with a Fixed Number of Parameters13.15.5 HLL-Like Calls with a Varying Parameter List 13.16 The invoke Macro 13.17 Advanced Macro Parameter Parsing13.17.1 Checking for String Literal Constants13.17.2 Checking for Real Constants13.17.3 Checking for Registers13.17.4 Compile-Time Arrays 13.18 Using Macros to Write Macros 13.19 Compile-Time Program Performance 13.20 For More Information 13.21 Test Yourself
Chapter 14: The String Instructions
14.1 The x86-64 String Instructions14.1.1 The rep, repe, repz, and the repnz and repne Prefixes14.1.2 The Direction Flag14.1.3 The movs Instruction14.1.4 The cmps Instruction14.1.5 The scas Instruction14.1.6 The stos Instruction14.1.7 The lods Instruction14.1.8 Building Complex String Functions from lods and stos 14.2 Performance of the x86-64 String Instructions 14.3 SIMD String Instructions14.3.1 Packed Compare Operand Sizes14.3.2 Type of Comparison14.3.3 Result Polarity14.3.4 Output Processing14.3.5 Packed String Compare Lengths14.3.6 Packed String Comparison Results 14.4 Alignment and Memory Management Unit Pages 14.5 For More Information 14.6 Test Yourself
Chapter 15: Managing Complex Projects
15.1 The include Directive 15.2 Ignoring Duplicate Include Operations 15.3 Assembly Units and External Directives 15.4 Header Files in MASM 15.5 The externdef Directive 15.6 Separate Compilation15.7.1 Basic Makefile Syntax15.7.2 Make Dependencies15.7.3 Make Clean and Touch 15.8 The Microsoft Linker and Library Code 15.9 Object File and Library Impact on Program Size 15.10 For More Information 15.11 Test Yourself
Chapter 16: Stand-Alone Assembly Language Programs
16.1 Hello World, by Itself 16.2 Header Files and the Windows Interface 16.3 The Win32 API and the Windows ABI 16.4 Building a Stand-Alone Console Application 16.5 Building a Stand-Alone GUI Application 16.6 A Brief Look at the MessageBox Windows API Function 16.7 Windows File I/O 16.8 Windows Applications 16.9 For More Information 16.10 Test Yourself
Part III: Reference Material
Appendix A: ASCII Character Set
Appendix B: Glossary
Appendix C: Installing and Using Visual Studio
C.1 Installing Visual Studio Community C.2 Creating a Command Line Prompt for MASM C.3 Editing, Assembling, and Running a MASM Source File
Appendix D: The Windows Command Line Interpreter
D.1 Command Line Syntax D.2 Directory Names and Drive Letters D.3 Some Useful Built-in CommandsD.3.1 The cd and chdir CommandsD.3.2 The cls CommandD.3.3 The copy CommandD.3.4 The date CommandD.3.5 The del (erase) CommandD.3.6 The dir CommandD.3.7 The more CommandD.3.8 The move CommandD.3.9 The ren and rename CommandsD.3.10 The rd and rmdir CommandsD.3.11 The time Command D.4 For More Information
Appendix E: Answers to Questions
E.1 Answers to Questions in Chapter 1 E.2 Answers to Questions in Chapter 2 E.3 Answers to Questions in Chapter 3 E.4 Answers to Questions in Chapter 4 E.5 Answers to Questions in Chapter 5 E.6 Answers to Questions in Chapter 6 E.7 Answers to Questions in Chapter 7 E.8 Answers to Questions in Chapter 8 E.9 Answers to Questions in Chapter 9 E.10 Answers to Questions in Chapter 10 E.11 Answers to Questions in Chapter 11 E.12 Answers to Questions in Chapter 12 E.13 Answers to Questions in Chapter 13 E.14 Answers to Questions in Chapter 14 E.15 Answers to Questions in Chapter 15 E.16 Answers to Questions in Chapter 16
Index

Content preview from The Art of 64-Bit Assembly, Volume 1

4 Constants, Variables, and Data Types

Chapter 2 discussed the basic format for data in memory. Chapter 3 covered how a computer system physically organizes that data in memory. This chapter finishes the discussion by connecting the concept of data representation to its actual physical representation. As the title indicates, this chapter concerns itself with three main topics: constants, variables, and data structures. I do not assume that you’ve had a formal course in data structures, though such experience would be useful.

This chapter discusses how to declare and use constants, scalar variables, integers, data types, pointers, arrays, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Windows Internals, Part 1: System architecture, processes, threads, memory management, and more, Seventh Edition

Publisher Resources

ISBN: 9781098129798

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

The Art of 64-Bit Assembly, Volume 1

by Randall Hyde

4 Constants, Variables, and Data Types

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.