Multi-Modal Signal Processing

Chapter 14

Interactive Representations

of Multimodal Dat abases

Stéphane Marchand-Maillet, Donn Morrison,

Enikö Szekely, and Eric Bruno

University of Geneva, Switzerland

14.1. Introduction 279

14.2. Multimodal Data Representation 280

14.3. Multimodal Data Access 283

14.3.1. Browsing as Extension of the Query

Formulation Mechanism 283

14.3.2. Browsing for the Exploration of the

Content Space 287

14.3.3. Alternative Representations 292

14.3.4. Evaluation 292

14.3.5. Commercial Impact 293

14.4. Gaining Semantic from User Interaction 294

14.4.1. Multimodal Interactive Retrieval 294

14.4.2. Crowdsourcing 295

14.5. Conclusion and Discussion 298

References 299

14.1 INTRODUCTION

Several attempts to develop large-scale multimedia search engines

have been described recently. Images and videos are mainly consid-

ered from their (audio)visual content viewpoints [1], and consensus

Multimodal Signal Processing, ISBN: 9780123748256

Copyright

© 2010 Elsevier Ltd. All rights reserved. 279