
the speaker’s unfolding utterance. This requires a natural language
system that can incrementally understand the human speaker ’s
utterance. Conversely, the virtual human as it is speaking should
be aware of a human listener’s behavior, responding to nonverbal
signals such as confusion. Together such dynamic interaction suggests
capabilities such as interruption of behavior as well as incremental
understanding and generation of verbal and nonverbal behavior.
3.1 An approach to nonverbal behavior generation
A range of systems have tackled various aspects of these challenges
(refs). Here we discuss o ...