Implementing InfiniBand on IBM System p

© Copyright IBM Corp. 2007. All rights reserved. 303

Index

Symbols

/csminstall 174

/etc/init.d 211

/etc/sysconfig/network/ifcfg-ib0 181

/etc/sysconfig/network/ifcfg-ib1 181

/etc/sysctl.conf 180

/usr/local/lib/infiniband/libehca.so 226

/usr/local/libehca/etc/libehca.conf 227

/var/ct/cfg/ct_has.thl 78

/var/ct/cfg/ctrmc.acls 78

/var/log/messages 206

Numerics

64-bit open source applications 32

A

ACL 137

adapter sharing 27–28

Adapter Stanza 164

adapter, 12x 167

Address Handle 87

AIX xi–xiii, 4, 30, 32, 36, 39, 71, 73–76, 156, 158,

160, 169, 206–208, 231, 233–234, 237, 243, 274,

279–282

API 21, 26, 80, 87, 143, 159, 163

ARP 88, 91, 123, 126, 208, 221, 252

ASM 207

ASMI 207, 275

authentication 78

authenticationFailure 271

authorization 78

B

Bandwidth Out of the Box 14

Base Transport Header 20

BOS 114

BPC 59

BTH 20

Bulk Power Controller 59

bus 12

C

cables 16, 53

octopus 55

cables 12x 56

cables feature codes 53

cables, supported 54

CEC 14, 40, 58, 109, 117, 207

CFM 112–113, 117, 121, 193

channel adapter 23

channel based architecture 7

channel multiplexing 20

Chipkill™ memory 32

Cluster Ready Hardware Server 273

Cluster Systems Manager 75

Clustering techniques 11

compilers 188

Configuration File Manager 112

Configuration resource manager 76

connector 12x 55

connectors 16

considerations 30

controlled Q_Keys 270

copycds 177

CPU 14

CQ verbs 87

CQE 26

CRC 19, 22

Credit based flow control 19

CRHS 37, 39, 59–60, 100, 156–157, 166, 168, 171,

273–275

CSM 32, 39, 57–58, 75–77, 79, 144, 154–156, 166,

230–236, 254, 274–275, 280

Management server 57, 59

CSM Management server 95

csm2nimgrps 236

csm2nimnodes 113

csmconfig 100, 174

csmsetupnim 113

csmsetupyast 177

csmstat 122, 178

ctcasd 79

cthags 79

cthats 79

CUoD 40

304 Implementing InfiniBand on IBM System p

D

DAPL 26

Data Integrity 19

Data packets 18

DB2 4

DDR 9, 15–16, 245

Dedicated HCA 27

default partition 270

definenode 105, 176

DGID 123

DHCP 37, 39, 58–59, 95, 166, 168, 170–171,

274–275, 291

DHCP server 168

Direct Access Programming Language (DAPL) 26

Direct Access Programming Library 26

DLID 123

DLPAR 37

DMA 15

DMAPI 138

dmesg 209–211

DNS 231, 281

DVD 67–68, 206

DWDM 11

dynamic adapter configuration 163

Dynamic logical partitioning 32

E

eHCA device driver 150, 211

eHCA user space library 154

Error data block 217

Ethernet 11

F

fabric 12

FC 40, 42–43, 45, 132, 135, 157

Fibre Channel 11

FibreChannel zones 270

First Failure Data Capture 32

flow control 15, 17, 19

four wire serial differential connection 16

Frame 59

Frames 165

FRU 52

FSP 38, 58–59, 207, 275

FTP 205, 207

G

General Parallel File System 84, 157

General Services Interface 26

getadapters 82, 110, 118, 121

GFW 35

GID 65, 88, 90, 123, 167–168, 171, 182, 204, 208,

223, 229, 256, 266

Global firmware 35

Global ID 65

Global ID prefix 65

global identifier 90

Globally Unique IDentifier 23

GPFS 4, 84–85, 131, 144, 154–155, 157, 190

disk descriptor file 186

node descriptor file 185

GPFS portability layer 184

GPL 184, 212, 214

GRH 19

GS 159

GSI 26, 88, 93, 215

GUI 36, 47–48, 66, 178, 206–207, 275

GUID 19, 23, 27, 41–42, 47–48, 125, 127–128,

142, 167, 182, 208, 225, 251, 255

GUID index 42

GX adapter 4, 26

GX adapters 40

GX bus 40

H

HACMP xiii, 76, 82, 280

hardware control 58

Hardware Management Console 37, 59, 94

hardware server daemon 274

hardware server discovery agent 274

HCA 8–10, 22, 40–42, 46–47, 86–88, 92, 142–144,

149, 206, 208, 222, 242, 256–257, 259, 270–271,

292

HCA installation 46

HCA usage modes 47

HCAD 92, 250, 253

hdwr_svr 274

High Availability Cluster Multi-Processing 76

High Performance Computing 8

High Performance Switch 274

High utilization 27

HMC 27, 35–37, 94–96, 104, 142, 156–157, 166,

206–208, 232, 244, 274–275

HMC BIOS 35

Index 305

Host Channel Adapter 167

host channel adapters 41

Host Channel Adapters (HCA) 23

HPC xi, xiii, 1, 4, 7–8, 10, 21, 28, 31, 65, 132,

154–155, 157–158, 206, 225, 264, 266, 287

HPC cluster 155

HPS 159, 274

hscroot 207

HSDA 274

I

IB 8, 15, 18, 21, 30, 40, 42, 71, 74, 82–83, 86,

141–144, 203–204, 208–209, 246–248, 251–252,

257, 259, 270, 275, 289

IB communication stack 89

IB drivers 146

IBA 86, 89

IBM xi–xiv, 1, 3–5, 9, 14, 16, 18, 30, 32, 36, 71,

73–74, 76, 141–142, 144–145, 203–206, 243–246,

253, 262, 271, 274–275, 279, 285

IBM GX adapter 10

IBM Network Manager 36, 166

IBM.ConfigRM 79

IBM.CSMAgentRM 77

IBM.DMSRM 77

IBM.ManagedNode 98

IBNM 64, 68

ibstat 94, 124

IBTA 9, 23, 26, 28, 143

ibv_devices 182

ibv_devinfo 182

ICM 89

ICRC 19

ifconfig 122

InfiniBand 7, 14, 74

InfiniBand Connection Manager 89

InfiniBand device driver

Linux installation 179

InfiniBand device driver, Linux 156

InfiniBand gateway 5

InfiniBand Host Card Adapter (HCA 10

InfiniBand Layers 16

install server 75

installms 174

installnodes 178

instfix 81

Invariant CRC 19

IP xi, 5, 8, 10, 15, 20, 37, 39, 58, 75, 80, 85–86,

143, 147, 149, 158, 221, 223, 231, 237, 242, 252,

258, 271, 275, 283, 290–292

IP over InifiniBand 180

IPoIB xi, 75, 85–86, 89–90, 132–133, 158, 170,

180, 221, 237, 271, 287, 289, 291

ITSO xi, xiii

J

job preemption 160

K

kernel ring buffer 211

L

L_Keys 271

LAN 5, 10–11, 32, 38, 84

LAPI 4, 154, 157–160

libsysfs 144

LID 18–19, 24, 65, 90, 125, 229, 251, 258, 260

LID assignments 25

limitations 30

link layer 17

Linux 4, 30, 32, 85

LL 17, 144, 164, 193–194

llctl 196

llextRPD 194, 230

llstatus 157, 164, 196

llsummary 157

LMC 65, 171

LMC value 167

LoadL_admin file 196

LoadLeveler 158, 162, 229

LoadLeveler configuration 193

LoadLeveler installation 193

LoadLever 30

LoadLever admin file 229

Local Area Networks (LAN) 11

local identifier 90

location code 46

location codes 47

Logical HCA 167

Logical Host Channel Adapter 63

Logical IDentifier 24

Logical Switch 63

low latency 8

Low utilization 27

low-level application programming interface 158