The parallel computing memory architecture

Based on the number of instructions and data that can be processed simultaneously, computer systems are classified into four categories:

  • Single instruction, single data (SISD)
  • Single instruction, multiple data (SIMD)
  • Multiple instruction, single data (MISD)
  • Multiple instruction, multiple data (MIMD)

This classification is known as Flynn's taxonomy.

The parallel computing memory architecture


The SISD computing system is a uniprocessor machine. It executes a single instruction that operates on a single data stream. In SISD, machine instructions are processed sequentially.

In a clock cycle, the CPU executes the following operations:

  • Fetch: The CPU fetches ...

Get Python Parallel Programming Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.