I have two images : a picture, and a depth map image computed using a set of two IR sensors distinct from the first camera. But the two are not aligned:
The image and its corresponding depth map
I also have the intrisic and extrinsic matrices of the cameras :
instrinsic and extrinsic matrices
Is there a proper way to use those matrices and the depth in order to align the two images by considering them undistorted? I have not managed to find a helpfull python library. Any help would be appreciated. Thanks a lot.
A somewhat similar question was posted here, but it seems to me that it does not contain the desired answer.