Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synchronization between camera images and camera pose #1309

Closed
Amigoshan opened this issue Aug 5, 2018 · 0 comments
Closed

Synchronization between camera images and camera pose #1309

Amigoshan opened this issue Aug 5, 2018 · 0 comments
Labels

Comments

@Amigoshan
Copy link

Amigoshan commented Aug 5, 2018

I encountered the synchronization issue similar to this post.

What I want to get from the simulation is synchronized RGB and depth image, along with the camera pose. But I found they are not well synchronized.

I'm using python API simGetImages. According to issue 275, this should return two images that perfectly synchronized. I also get the camera pose from response.camera_position/orientation. I print out the timestamp, this is what it looks like:

image

From the above, the time stamp of those three images are slightly different. However the camera poses returned by simGetImages for those three images are exactly the same.

I'm trying to do image warping. Between each two consecutive frames (RGB1, Depth1, Pose1), (RGB2, Depth2, Pose2). I use RGB1, Depth1, Pose1 and Pose2, calculate RGB2_warp. If all of those inputs are well synchronized, my output RGB2_warp should be well aligned with RGB2. But there's a big error when the drone is changing it's speed. My observation is that the camera pose is a little bit behind the images.

image

I also tried the record mode, from the airsim_rec.txt, the timestamp differs even more: (according to the 'Timestamp' column and timestamp in ImageName)

image

In summary, I wonder how to get images and camera pose that are perfectly synchronized?

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants