Operating Systems: Concurrent and Distributed Software Design

5.2. The memory hierarchy

Figure 5.1 shows a typical computer system's memory hierarchy. There is a trade-off involved in using storage devices which involves size, speed and cost. The CPU registers are the fastest but smallest store. A large proportion of the machine's instructions will access data from CPU registers and compiler writers must organize their use to optimize program execution time. The detailed design of the processor and the hardware-controlled cache are not our concern here but as system designers we need a broad view of current and projected sizes and speeds. An excellent summary is given in Hennessy and Patterson (2003).

Figure 5.1. The memory hierarchy.

In outline, the cache is small and fast compared with main memory and ...