Camera pose correction

• US 8,749,642 B2
• Filed: 04/08/2011
• Issued: 06/10/2014
• Est. Priority Date: 04/12/2010
• Status: Active Grant

• Current Assignee: Vitec Group PLC
• Original Assignee: Vitec Group PLC
• Inventors: Lindsay, Richard Arthur, Dalgoutte, Philip Christopher
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): LE, TUAN H
• Application Number:
  US13/082,873
• Publication Number:
  US 20110249152A1
• Time in Patent Office: 1,159 Days
• Field of Search: 348169-172, 3482071-20799, 348/215.1, 348/216.1, 348/217.1, 348/218.1, 348/219.1, 348/220.1, 348/241
• US Class Current: 348/207.1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

The invention concerns correcting an error in an estimated pose of a moveable camera. The camera is at least a part of a camera system that generates an output image on the basis of the camera pose. Incremental pose measurements for the camera are taken over time and a pose of the camera using the incremental pose measurements is estimated, the estimated camera pose having an error. A pose correction is determined on the basis of the difference between an absolute pose measurement for the camera and the estimated camera pose. A rate of change in the camera image caused by a change in the camera is monitored. A parameter of the camera system is periodically adjusted based on the incremental pose measurements. The adjustment is further set in order to effect the pose correction so as to correct for the estimated camera pose error and the pose correction is effected at a rate based on the monitored rate of change in the camera image.

Claims

1. A method for correcting an error in an estimated pose of a moveable camera, the camera being at least a part of a camera system that generates an output image on the basis of the camera pose, the method comprising:

taking incremental pose measurements for the camera over time and estimating a pose of the camera using the incremental pose measurements, the estimated camera pose having an error;

determining a pose correction on the basis of the difference between an absolute pose measurement for the camera and the estimated camera pose;

monitoring a rate of change in the camera image caused by a change in the camera; and

periodically adjusting a parameter of the camera system based on the incremental pose measurements, the adjustment further being set in order to effect the pose correction so as to correct for the estimated camera pose error, the pose correction being effected at a rate based on the monitored rate of change in the camera image.

2. The method of claim 1, wherein the incremental pose measurements comprise at least one of position measurements and orientation measurements, the estimated camera pose comprises at least one of an estimated camera position and an estimated camera orientation, and the absolute pose measurement comprises at least one of an absolute camera position and an absolute camera orientation.

3. The method of claim 1, wherein the step of monitoring a rate of change in the camera image comprises at least one of:

monitoring a rate of translation in the camera image caused by a change in the camera system; and

monitoring a rate of rotation of the camera image caused by a change in the camera system.

4. The method of claim 1, wherein the step of periodically adjusting a parameter of the camera system comprises controlling at least one of:

the camera system position; and

an orientation of the camera system, to a desired setting.

5. The method of claim 1, further comprising:

generating the output images for the camera system on the basis of the estimated camera pose, using images generated by the camera; and

wherein the step of periodically adjusting a parameter of the camera system comprises adjusting the generation of output images.

6. The method of claim 1, wherein setting the adjustment in order to effect the pose correction comprises setting the adjustment on the basis of the incremental pose measurements and a proportion of the pose correction, the proportion of the pose correction being based on the monitored rate of change in camera image.

7. The method of claim 6, wherein the proportion of the pose correction is directly proportional to the monitored rate of change in camera image.

8. The method of claim 1, wherein the step of monitoring a rate of change in the camera image comprises determining a rate of change in the estimated camera pose.

9. The method of claim 8, wherein the camera system comprises the camera coupled to a mounting, and wherein the step of determining a rate of change in the estimated camera pose comprises determining a rate of change in the mounting pose.

10. The method of claim 9, wherein the mounting comprises at least one of:

a pan and tilt head;

a pedestal;

a cable camera suspension system; and

a portable camera mount.

11. The method of claim 1, wherein the step of monitoring a rate of change in the camera image caused by a change in the camera system comprises determining a rate of change in at least one of:

a position for the camera;

an orientation for the camera;

a zoom parameter for the camera; and

a focus parameter for the camera.

12. The method of claim 1, wherein the step of monitoring a rate of change in the camera image caused by a change in the camera comprises analysis of the image generated by the camera.

13. A camera control system comprising:

a camera system comprising a camera, the camera system being arranged to generate an output image on the basis of the camera pose;

a first pose measurement device, arranged to take incremental pose measurements for the camera over time and to estimate a pose of the camera using the incremental pose measurements, the estimated camera pose having an error;

an absolute pose measurement device, arranged to take an absolute pose measurement for the camera;

a monitoring device, arranged to monitor a rate of change in the camera image caused by a change in the camera; and

a controller arranged to determine a pose correction on the basis of the difference between the absolute pose measurement and the estimated camera pose and to periodically adjust a parameter of the camera system based on the incremental pose measurements, the adjustment further being set in order to effect the pose correction so as to correct for the estimated camera pose error, the pose correction being effected at a rate based on the monitored rate of change in camera image.