Digital Representations of the Real World

17

Image- and Video-Based

Rendering

Christian Lipski, Anna Hilsmann, Carsten

Dachsbacher, and Martin Eisemann

17.1 Introduction

The purpose of image- and video-based rendering (IVBR) is to be able

to synthesize photo-realistic new, virtual views of real-world scenes and

events from no more than a set of conventional photographs or videos

of the scene. Purely image-based, or plenoptic, approaches densely sam-

ple scene appearance using a large number of images (Sections 17.2 and

5.3). New views are generated by simply re-sampling the captured image

data. In contrast, geometry-assisted methods require much less input im-

ages. Here, 3D scene geometry is either a priori known, reconstructed from

the captured imagery, or acquired separately by some other