book

Memory Systems

by Bruce Jacob, David Wang, Spencer Ng

July 2010

Intermediate to advanced

900 pages

40h 1m

English

Morgan Kaufmann

Read now

Unlock full access

Cover
Title page
Table of Contents
In Praise of Memory Systems: Cache, DRAM, Disk
Copyright
Dedication
Inside Front Cover
Preface
OVERVIEW: On Memory Systems and Their Design
Ov.1 Memory SystemsOv.2 Four Anecdotes on Modular DesignOv.3 Cross-Cutting IssuesOv.4 An Example Holistic AnalysisOv.5 What to Expect
Part I: Cache

Chapter 1: An Overview of Cache Principles
1.1 Caches, ‘Caches,’ and “Caches”1.2 Locality Principles1.3 What to Cache, Where to Put It, and How to Maintain It1.4 Insights and Optimizations
Chapter 2: Logical Organization
2.1 Logical Organization: A Taxonomy2.2 Transparently Addressed Caches2.3 Non-Transparently Addressed Caches2.4 Virtual Addressing and Protection2.5 Distributed and Partitioned Caches2.6 Case Studies
Chapter 3: Management of Cache Contents
3.1 Case Studies: On-Line Heuristics3.2 Case Studies: Off-Line Heuristics
3.3 Case Studies: Combined Approaches
3.4 Discussions3.5 Building a Content-Management Solution
Chapter 4: Management of Cache Consistency
4.1 Consistency with Backing Store4.2 Consistency with Self4.3 Consistency with Other Clients
Chapter 5: Implementation Issues
5.1 Overview5.2 SRAM Implementation5.3 Advanced SRAM Topics5.4 Cache Implementation
Chapter 6: Cache Case Studies
6.1 Logical Organization6.2 Pipeline Interface6.3 Case Studies of Detailed Itanium-2 Circuits
Part II: DRAM
Chapter 7: Overview of DRAMs
7.1 DRAM Basics: Internals, Operation7.2 Evolution of the DRAM Architecture7.3 Modern-Day DRAM Standards7.4 Fully Buffered DIMM: A Compromise of Sorts7.5 Issues in DRAM Systems, Briefly
Chapter 8: DRAM Device Organization: Basic Circuits and Architecture
8.1 DRAM Device Organization8.2 DRAM Storage Cells8.3 RAM Array Structures8.4 Differential Sense Amplifier8.5 Decoders and Redundancy8.6 DRAM Device Control Logic8.7 DRAM Device Configuration8.8 Data I/O8.9 DRAM Device Packaging8.10 DRAM Process Technology and Process Scaling Considerations
Chapter 9: DRAM System Signaling and Timing
9.1 Signaling System9.2 Transmission Lines on PCBs9.3 Termination9.4 Signaling9.5 Timing Synchronization9.6 Selected DRAM Signaling and Timing Issues9.7 Summary
Chapter 10: DRAM Memory System Organization
10.1 Conventional Memory System10.2 Basic Nomenclature10.3 Memory Modules10.4 Memory System Topology10.5 Summary
Chapter 11: Basic DRAM Memory-Access Protocol
11.1 Basic DRAM Commands11.2 DRAM Command Interactions11.3 Additional Constraints11.4 Command Timing Summary11.5 Summary
Chapter 12: Evolutionary Developments of DRAM Device Architecture
12.1 DRAM Device Families12.2 Historical-Commodity DRAM Devices12.3 Modern-Commodity DRAM Devices12.4 High Bandwidth Path12.5 Low Latency12.6 Interesting Alternatives
Chapter 13: DRAM Memory Controller
13.1 DRAM Controller Architecture13.2 Row-Buffer-Management Policy13.3 Address Mapping (Translation)13.4 Performance Optimization13.5 Summary
Chapter 14: The Fully Buffered DIMM Memory System
14.1 Introduction14.2 Architecture14.3 Signaling and Timing14.4 Access Protocol14.5 The Advanced Memory Buffer14.6 Reliability, Availability, and Serviceability14.7 FB-DIMM Performance Characteristics14.8 Perspective
Chapter 15: Memory System Design Analysis
15.1 Overview15.2 Workload Characteristics15.3 The RAD Analytical Framework15.4 Simulation-Based Analysis15.5 A Latency-Oriented Study15.6 Concluding Remarks
Part III: Disk
Chapter 16: Overview of Disks
16.1 History of Disk Drives16.2 Principles of Hard Disk Drives16.3 Classifications of Disk Drives16.4 Disk Performance Overview16.5 Future Directions in Disks
Chapter 17: The Physical Layer
17.1 Magnetic Recording17.2 Mechanical and Magnetic Components17.3 Electronics
Chapter 18: The Data Layer
18.1 Disk Blocks and Sectors18.2 Tracks and Cylinders18.3 Address Mapping18.4 Zoned-Bit Recording18.5 Servo18.6 Sector ID and No-ID Formatting18.7 Capacity18.8 Data Rate18.9 Defect Management
Chapter 19: Performance Issues and Design Trade-Offs
19.1 Anatomy of an I/O19.2 Some Basic Principles19.3 BPI vs. TPI19.4 Effect of Drive Capacity19.5 Concentric Tracks vs. Spiral Track19.6 Average Seek
Chapter 20: Drive Interface
20.1 Overview of Interfaces20.2 ATA20.3 Serial ATA20.4 SCSI20.5 Serial SCSI20.6 Fibre Channel20.7 Cost, Performance, and Reliability
Chapter 21: Operational Performance Improvement
21.1 Latency Reduction Techniques21.2 Command Queueing and Scheduling21.3 Reorganizing Data on the Disk21.4 Handling Writes21.5 Data Compression
Chapter 22: The Cache Layer
22.1 Disk Cache22.2 Cache Organizations22.3 Caching Algorithms
Chapter 23: Performance Testing
23.1 Test and Measurement23.2 Basic Tests23.3 Benchmark Tests23.4 Drive Parameters Tests
Chapter 24: Storage Subsystems
24.1 Data Striping24.2 Data Mirroring24.3 RAID24.4 SAN24.5 NAS24.6 iSCSI
Chapter 25: Advanced Topics
25.1 Perpendicular Recording25.2 Patterned Media25.3 Thermally Assisted Recording25.4 Dual Stage Actuator25.5 Adaptive Formatting25.6 Hybrid Disk Drive25.7 Object-Based Storage
Chapter 26: Case Study
26.1 The Mechanical Components26.2 Electronics26.3 Data Layout26.4 Interface26.5 Cache26.6 Performance Testing
Part IV: Cross-Cutting Issues
Chapter 27: The Case for Holistic Design
27.1 Anecdotes, Revisited27.2 Perspective
Chapter 28: Analysis of Cost and Performance
28.1 Combining Cost and Performance28.2 Pareto Optimality28.3 Taking Sampled Averages Correctly28.4 Metrics for Computer Performance28.5 Analytical Modeling and the Miss-Rate Function
Chapter 29: Power and Leakage
29.1 Sources of Leakage in CMOS Devices29.2 A Closer Look at Subthreshold Leakage29.3 νCACTI and Energy/Power Breakdown of Pipelined Nanometer Caches
Chapter 30: Memory Errors and Error Correction
30.1 Types and Causes of Failures30.2 Soft Error Rates and Trends30.3 Error Detection and Correction30.4 Reliability of Non-DRAM Systems30.5 Space Shuttle Memory System
Chapter 31: Virtual Memory
31.1 A Virtual Memory Primer31.2 Implementing Virtual Memory
References
Index

Content preview from Memory Systems

CHAPTER 3

Management of Cache Contents

Now that we have seen a sampling of cache organizations (albeit weighted toward solid-state implementations), it makes sense to look at how the decision is made to put something into a cache. A cache’s content-management solution has several responsibilities. First, it must identify important instructions and data and decide where in the memory hierarchy they should be at any given point in time. Second, it must ensure, or at least increase the likelihood, that the envisioned state of affairs actually happens. These responsibilities are addressed by actions taken by three different components:

• Partitioning heuristics

• (Pre)fetching heuristics

• Locality optimizations

Partitioning heuristics determine ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9780123797513

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Memory Systems

by Bruce Jacob, David Wang, Spencer Ng

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.