Book description
This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.
Table of contents
- Cover
- Title
- Copyright
- Contents
- How to use this book
- Part I: Working your way into ‘multimodality’
-
Part II: Methods and analysis
-
5 The scope and diversity of empirical research methods for multimodality
- 5.1 What are methods? What methods are there?
- 5.2 Getting data?
- 5.3 Corpus-based methods to multimodality
- 5.4 Eye-tracking methods for multimodality
- 5.5 Computational methods in multimodality research
- 5.6 Summary and conclusions: selecting tools for the job
- 5.7 A word on good scientific practice: quoting multimodal artefacts
-
6 Are your results saying anything? Some basics
- 6.1 Why statistics?—and how does it work?
- 6.2 What is normal?
- 6.3 Assessing differences
- 6.4 Assessing similarities
- 6.5 How much is enough?
- 6.6 Refinements and restrictions
- 6.7 Inter-coder consistency and reliability
- 6.8 What affects what? Looking for dependencies
- 6.9 Summary: many types of tests and possibilities
- 7 Multimodal navigator: how to plan your multimodal research
-
5 The scope and diversity of empirical research methods for multimodality
-
Part III: Use cases
- Use case area 1: temporal, unscripted
- Use case area 2: temporal, scripted
- Use case area 3: spatial, static
- Use case area 4: spatial, dynamic
- Use case area 5: spatiotemporal, interactive
- Bibliography
- Index
Product information
- Title: Multimodality
- Author(s):
- Release date: April 2017
- Publisher(s): De Gruyter Mouton
- ISBN: 9783110480047
You might also like
article
Have ChatGPT Ask You Questions
ChatGPT Shortcuts shows future prompt engineers how to harness the full potential of the state-of-the-art AI …
book
Make: Paper Inventions
Paper is amazing stuff. It's cheap, easy to use, and easy to recycle. It's lightweight and …
book
The Polymath
Every human is born with multifarious potential. Why, then, do parents, schools and employers insist that …
book
Multi-Modal Signal Processing
Presents state-of-art methods for multimodal signal processing, analysis, and modeling Contains numerous examples of systems with …