
340 Coverbal Synchrony in Human-Machine Interaction
These processes are implemented by using FSMs and common HRG
structures (right-hand side in Figure 4). Each word within the HRG
structure is stored in a Word relation layer. The deque processes POS-
tagged word sequences, and matched them against semiotic grammar’s
rules and relations stored in the off-line constructed gestural dictionary.
Several FSMs are used in order to identify the meaning, and to select
the physical representation of the meaning. Furthermore, FSMs also
predict how the propagation of meaning could be performed over the
specific text sequence (particularly ...