
274 Coverbal Synchrony in Human-Machine Interaction
determining which emotional state could be associated with the
performed gesture. Those Bayesian classifiers are used before and
after performing data fusion between modalities. In the first case, the
classifiers are applied separately to speech, face, and gesture features.
Separate results are then combined via a voting algorithm. In the
second case, there is a single classifier that receives all the features
coming from different modalities as input.
Sanghvi et al. (2011) evalute children’s emotional reaction while
playing chess with a robot by analyzing their upper body movements
and posture. ...