Mathematical Methods in Interdisciplinary Sciences

5Multimodal Data Representation and Processing Based on Algebraic System of Aggregates

Yevgeniya Sulema¹and Etienne Kerre²

¹Department of Computer Systems Software, Faculty of Applied Mathematics, Igor Sikorsky Kyiv Polytechnic Institute, Kyiv, 03056, Ukraine

²Department of Applied Mathematics, Computer Science and Statistics, Ghent University, Ghent, B9000, Belgium

5.1 Introduction

In many cases, we can face with a task of collecting data of different nature obtained (registered, recorded, and measured) in different time slots from sources of different types. For example, long‐life medical observation of a patient is such a case: data about a patient's health status can be obtained from a wide range of medical equipment and tools that can be both digital (e.g. a magnetic imaging system) and nondigital (e.g. a mercury thermometer), as well as these datasets can be registered both in paper notes such as the so‐called “patient's medical card” and by using electronic medical documenting systems. The next task after data collection is data synchronization. This task is a part of a wider task of data analysis of all collected multimodal datasets in order to get a whole picture on the object (subject, process, and event) status, behavior, further states, etc.

One of the possible ways toward solving the task of multimodal data analysis is presenting data sets describing the same object as a complex data structure called an aggregate introduced in the Algebraic System of Aggregates ...