Autonomous Systems in the Internet of Vehicles
by Balamurugan Balusamy, Sandeep Kumar Mathivanan, Prabhu Jayagopal, S. K. B. Sangeetha, Ali Kashif Bashir
13Edge-Driven Multimodal Fusion Framework for Real-Time Emotion-Aware Vehicular Networks
Manjula Sanjay Koti1*, S. Satheesh Kumar2, Janani S.3, Arun A.4 and Mahmoud Ahmad Al-Khasawneh5,6
1Dayananda Sagar Academy of Technology and Management, Bengaluru, Karnataka, India
2School of Information Science, Presidency University, Bangalore, Karnataka, India
3Department of CSE, K. H. Kabbur Institute of Engineering, JSS Campus, Vidyagiri, Dharwad, Karnataka, India
4Department of Networking and Communications, School of Computing, Faculty of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, Chengalpattu, Tamil Nadu, India
5School of Computing, Horizon University College, Ajman, UAE
6Applied Science Research Center, Applied Science Private University, Amman, Jordan
Abstract
To incorporate driver emotional state recognition into smart vehicular decision-making, in this study, an Emotion-Aware Multimodal Fusion Framework (EAMFF) for the Internet of Vehicles (IoV) is presented. The methodology used involves a distributed edge-cloud architecture and incorporates vocal stress analysis, facial expressions, and in-vehicle biosignals (heart rate, electroencephalogram). This method classifies driver stress, fatigue, or hostility in real time using a dynamic multisource emotional cues weighing and fusion through deep spatiotemporal attention. The resulting fused emotional information is combined with environmental and vehicle sensor information such as LiDAR, ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access