Computing the fundamental matrix of an image pair
The introductory section of this chapter presented the projective equation, describing how a scene point projects onto the image plane of a single camera. In this recipe, we will explore the projective relationship that exists between two images that display the same scene. These two images could have been obtained by moving a camera to two different locations to take pictures from two viewpoints, or by using two cameras, each of them taking a different picture of the scene. When those two cameras are separated by a rigid baseline, we use the term stereovision.
Let's now consider two pinhole cameras observing a given scene point, as shown in the following figure:
We learned that we ...