Camera calibration aims to find two sets of intrinsic parameters: the camera matrix and distortion coefficients. The camera matrix determines how coordinates of 3D points are mapped onto dimensionless pixels coordinates in the image, but actual image lenses also distort an image so straight lines are transformed into curves. Distortion coefficients allow you to eliminate such warps.
The whole camera calibration process can be divided into three stages:
- Gathering a decent amount of data such as, images and detected chessboard patterns
- Refining chessboard corners coordinates
- Optimizing camera parameters to match them with observed distortions and projections
To gather data for camera calibration, you need to detect a chessboard ...