The appearance of richer forms of video content has opened the door to the need for new, also richer, visual rendering to present this content and interfaces to interact with it. Traditionally, video production is designed to support a particular script that the director is following, which is targeted to a specific video format and display system (e.g., HD video on widescreen TVs). Currently, viewers expect to enjoy video content on a variety of displays, such as high-resolution cinema screens, TVs, tablet, laptops and smart-phones. Furthermore, they are increasingly expecting to be able to control their audio-visual experience by themselves, moving away from a fixed script and selecting one of several scripts suggested or even by freely exploring the audio-visual scene.
Conventional production has limited support for such functionality. One fundamental approach to overcome the limitations is to adapt the video production step for a format-agnostic approach. This leads to the concept of a layered format-agnostic representation, as developed in Chapter 2, Section 2.8.4, where several cameras with different spatial resolutions and fields-of-view can be used to represent the view of the scene from a given viewpoint. The views from ...