Recording Good Calibration Videos
Intrinsics Calibration
The first step to get your camera calibration files is to record one calibration video for each camera. This video will be used to compute its focal length, principal point offset and distortion parameters. Or in simpler terms: all the camera specific parameters that we need for 3D reconstruction.
There are a few rules you have to follow to get the best intrinsics calibration possible:
- Move the checkerboard along all axis (especially rotation!)
Make sure you do not only record frames with the checkerboard parallel to the camera (as shown in the picture on the left). Not rotating it enough makes it impossible for the calibration tool to estimate the focal length correctly.
- Fill as much of the field of view with the checkerboard as possible
Make sure to be close enough to the camera to take advantage of the full resolution of your camera to cover at least 2/3 of the cameras field of view. Obvioulsy it's just as important to not get so close the camera looses focus, a bigger checkerboard will help in those cases.
Extrinsics Calibration
The second step is to select a primary camera. This camera defines your reference frame when doing 3D reconstruction. To calibrate the extrinsic parameters you will have to record videos for all possible camera pairs that contain the primary camera. Those videos will be used to calculate the position of all secondary cameras relative to the primary camera.
The main thing to watch out for during extrinsics recordings is that both cameras have a good and unoccluded view of the checkerboard. As long as that's the case it is as simple as just waving the board around as much as you can.\ Side note: While it is strongly recommended to record seperate videos for intrinsics and extrinsics it is possibly to use your extrinsic recordings for intrinsics calibration. If you do so make sure to still follow the intrinsic calibration rules during your recordings.
The main thing to watch out for during extrinsics recordings is that both cameras have a good and unoccluded view of the checkerboard. As long as that's the case it is as simple as just waving the board around as much as you can.\