System and method for real time registration of images

• US 9,210,384 B2
• Filed: 08/20/2013
• Issued: 12/08/2015
• Est. Priority Date: 09/20/2012
• Status: Active Grant

• Current Assignee: BAE Systems Information and Electronic Systems Integration Incorporated (BAE Systems Plc)
• Original Assignee: NAE Systems Information and Electronic Systems Integration Incorporated
• Inventors: Zemany, Paul D.
• Primary Examiner(s): Wong, Allen
• Application Number:
  US13/971,021
• Publication Number:
  US 20140078294A1
• Time in Patent Office: 840 Days
• Field of Search: 348/159
• US Class Current: 1/1
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system and method for real time registration of images is disclosed. The system measures the angle rate of change and approximates attitude difference between the two cameras to provide an estimate of the relative rate of change between the two cameras. Approximating attitude difference between the two cameras reduce the time needed for initial image registration. Real time registration of images reduces the processing load and improves tracking.

Claims

1. A method for real time registration of two video images from two cameras, comprising the steps of:

measuring an angle rate of change and attitude change of the two cameras;

providing an estimate of relative change between the two cameras based on measured attitude change, wherein the estimate of relative change is utilized in initial image registration process to reduce processing load needed to keep two image frames registered;

providing an estimate of relative change between the two cameras based on measured angle rate of change; and

registering two video images based on the estimated relative change between two cameras based on measured angle rate of change.

2. The method of claim 1 wherein the estimate of relative change between the two cameras based on measured angle rate of change comprises a relative shift in horizontal and vertical pixels and roll angle change between the two video images.

3. The method of claim 1 wherein search space that must be covered in an image processing method is reduced, thereby reducing chance for a false registration.

4. The method of claim 1 wherein at least one accelerometer and at least one magnetic sensor are utilized to measure the attitude change of the two cameras and at least one gyro is utilized to measure the angle rate of change of the two cameras.

5. The method of claim wherein the searching is prevented in an image processing method when the field of view of the cameras does not overlap by utilizing the accelerometer and the magnetic sensor.

6. A method for real time registration of two video images from two cameras, comprising the steps of:

measuring an angle rate of change and attitude change of the two cameras;

providing an estimate of relative change between the two cameras based on measured attitude change, wherein the estimate of relative change is utilized in initial image registration process to reduce processing load needed to keep two image frames registered;

providing an estimate of relative change between the two cameras based on measured angle rate of change; and

registering two video images based on the estimated relative change between two cameras based on measured angle rate of change, wherein the estimate of relative change between the two cameras based on measured angle rate of change comprises a relative shift in horizontal and vertical pixels and roll angle change between the two video images, and processing load needed to keep two image frames registered is reduced.

7. The method of claim 6 wherein search space that must be covered in an image processing method is reduced, thereby reducing chance for a false registration.

8. The method of claim 6 wherein at least one accelerometer and at least one magnetic sensor are utilized to measure the attitude change of the two cameras and at least one gyro is utilized to measure the angle rate of change of the two cameras.

9. The method of claim 6 wherein the searching is prevented in an image processing method when the field of view of the cameras does not overlap by utilizing the accelerometer and the magnetic sensor.

10. A system for real time registration of video images, comprising

at least one accelerometer and at least one magnetic sensor utilized to measure attitude change of the two cameras;

at least one gyro utilized to measure angle rate of change of the two cameras;

at least one processor for providing an estimate of relative change between the two cameras based on measured attitude change, wherein the estimate of relative change is utilized in initial image registration process to reduce processing load needed to keep two image frames registered, providing an estimate of relative change between the two cameras based on measured angle rate of change and registering two video images based on the estimated relative change between two cameras based on measured angle rate of change.

11. The system of claim 10 wherein estimate of relative change between two cameras comprises relative shift in horizontal and vertical pixels and roll angle change between two video images.

12. The system of claim 11 reduces processing load needed to keep two image frames registered.

13. The system of claim 11 reduces search space that an image processing method must cover thereby reducing chance for a false registration.

14. The system of claim 11 wherein at least one inertial sensor comprising at least one accelerometer and at least one magnetic sensor is utilized to measure said angle rate of change.

15. The system of claim 11 wherein the searching is prevented in an image processing method when the field of view of the cameras does not overlap by utilizing said inertial sensor.