Academic Press Library in Signal Processing

Chapter 17

Image-Based Rendering

Yao-Jen Chang* and Tsuhan Chen^†,    ^*Siemens Corporation, Corporate Technology, Princeton, NJ, USA,    ^†224 Phillips Hall, Cornell University, Ithaca, NY, USA,    [e-mail], [e-mail]

Abstract

Image-based rendering (IBR) is a process of synthesizing images at novel viewpoints based on a set of existing images. Although it is primarily a task in computer graphics for novel view synthesis, it can be treated as a signal processing problem: How do we perform sampling, representation, and reconstruction for a high-dimensional function? These three basic operations correspond to light field sampling, scene representation, and rendering in IBR. Depending on the density or sparsity of the camera arrangement ...