Verbal Communication

John A. Bateman

16The integration of multimodal resources in documents: Issues, approaches and methods

Abstract: Nowadays, documents that do not combine text and and rich varieties of images, ranging from pictures to graphs to infographics, all arranged within visual layouts that themselves contribute considerable flexibility in meaning, have become rare. Answering the question of how such diverse carriers of information manage to combine so as to give rise to coherent messages represents a considerable scientific challenge with substantial practical consequences. Methods and theories addressing the issue of integration constitute the main focus of the field of multimodality. Within multimodality, approaches for explaining how integration occurs ...