so I am performing a mapping of depth frame into the color space using rotation and translation values I obtained during calibration
So below are the results:
In this image the mapping is gud; however, a couple of frames down the video, here is the result; using the same parameters:
As you can see, the wall depth pixels are getting mixed with the head pixels by quite a significant amount.
Does anyone know why is that? Parallax error maybe?