Parallel Computer Architecture

Contents

Foreword ix

Preface xxi

1 Introduction 1

1.1 Why Parallel Architecture 4

1.1.1 Application Trends 6

1.1.2 Technology Trends 12

1.1.3 Architectural Trends 14

1.1.4 Supercomputers 21

1.1.5 Summary 23

1.2 Convergence of Parallel Architectures 25

1.2.1 Communication Architecture 25

1.2.2 Shared Address Space 28

1.2.3 Message Passing 37

1.2.4 Convergence 42

1.2.5 Data Parallel Processing 44

1.2.6 Other Parallel Architectures 47

1.2.7 A Generic Parallel Architecture 50

1.3 Fundamental Design Issues 52

1.3.1 Communication Abstraction 53

1.3.2 Programming Model Requirements 53

1.3.3 Communication and Replication 58

1.3.4 Performance 59

1.3. ...