Joint Cognitive Systems

Automation Surprises 123

knowledge require ments for people in the system as their role changes increasingly

to that of a manager and anomaly hand ler ( e.g., S arter et a l., 1997).

Despite deficiencies in the design of the automation as a team player , relatively

few bad consequences occurred because of human exper tise and adaptation (Woods

et al., 1994, chapter 5). However, the list of accidents due to coordination

breakdowns between people and autom ated systems appears to be growing.

Besides the Global Hawk accident, there have been a series of mishaps (for

summaries of the aviation cases s ee Abbott, 1996; Billings, 1997):

• Where the auto mation was driving the proces s under control (other salient

examp les are the Airbus A330 Test Flight, ...