Mastering Computer Vision with TensorFlow 2.x

Overview of 3D reconstruction and tracking

The 3D face reconstruction involves estimating the coordinates of the 3D face from the corresponding 2D image by regressing the depth by constructing a CNN. The following image illustrates this graphically:

Some of the popular algorithms for real-time 3D surface mappings are described as follows:

• Kinect Fusion: Real-time 3D construction using a Kinect depth sensor. Kinect is a commodity sensor platform that incorporates a structured time-of-flight-based depth sensor at 30 Hz.
• Dynamic Fusion: Dynamic scene reconstruction system using volumetric TSDF (truncated signed distance fusion) technique using ...