Advanced Methods and Deep Learning in Computer Vision

Chapter 12: Self-supervised temporal event segmentation inspired by cognitive theories

Ramy Mounir^a; Sathyanarayanan Aakur^b; Sudeep Sarkar^a    aComputer Science and Engineering, University of South Florida, Tampa, FL, United States^bComputer Science, Oklahoma State University, Stillwater, OK, United States

Abstract

We consider the event segmentation problem, i.e., how to mark the event's temporal boundaries and spatially locate them in the image. We draw heavily from cognitive science research to define the problem of event segmentation and to design highly effective computer vision algorithms for spatio-temporal segmentation of events in videos. These approaches do not require any annotated data. They can process streaming video data while learning ...