Real-Time Composite Image Comparator

• US 20110188762A1
• Filed: 04/13/2011
• Published: 08/04/2011
• Est. Priority Date: 08/04/2004
• Status: Active Grant

• Current Assignee: Hexagon Technology Center GmbH (Hexagon AB)
• Original Assignee: Hexagon Technology Center GmbH (Hexagon AB)
• Inventors: Whitaker, Sheila G., Grindstaff, Gene A.
• Granted Patent: US 8,228,378 B2
• Time in Patent Office: Days
• US Class Current: 382/218
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/04 Interpretation of pictures

Abstract

An apparatus and method for preparing a composite image from a video data stream and for identifying changed features in two composite images. Frames from the video data stream are transformed to a projected 2D image, aligned with adjacent frames and overlapping areas are averaged to provide a higher apparent resolution. The composite image can be stored in real-time. As a second composite image is prepared of the same location at a later time, portions of the second image can be compared to corresponding portions of the stored image after the intensities of the images are equalized. Image areas whose absolute difference exceeds a threshold are again intensity equalized. Areas that are again above threshold can be flagged for further scrutiny, either by a human or by a machine that performs object recognition. In this way, composite video images of a scene can be prepared and compared in real-time.

Claims

1. A computerized method for comparing a first image of a scene and a second image of the scene comprising:

a. providing the first image of the scene and the second image of the scene;

b. using a computer, adjusting a given area of the first image to approximately equal the average intensity of a given area of the second image, the given area of the first image and the given area of the second image corresponding to the same location in the scene;

c. using the computer, calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image and identifying a selected portion of the given area of the first image where the absolute difference is above a threshold; and

d. using the computer, adjusting the average intensity of the selected portion of the given area of the first image to approximately equal the average intensity of the corresponding portion of the given area of the second image and marking the selected portion where the absolute difference between the selected portion and the corresponding area in the second image is above the threshold.

2. The method according to claim 1 wherein providing the first image includes capturing a video sequence with a video camera.

3. The method according to claim 1 wherein the scene is a terrain scene.

4. The method according to claim 1 wherein providing the first image includes transforming a first series of images using the computer.

5. The method according to claim 4 wherein transforming the first series of images includes projecting the first series of images onto a two-dimensional surface.

6. The method according to claim 1 wherein adjusting a given area of the first image begins executing before providing the second image of the scene completes.

7. The method according to claim 1 wherein edges are removed from the first image and from the second image before calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image.

8. A computer program product for use on a computer system for comparing a first image of a scene and a second image of the scene, the computer program product comprising a non-transitory computer readable medium encoded with computer readable program code, the computer readable program code including:

a. program code for adjusting a given area of the first image to approximately equal the average intensity of a given area of the second image, the given area of the first image and the given area of the second image corresponding to the same location in the first scene;

b. program code for calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image and identifying a selected portion of the given area of the first image where the absolute difference is above a threshold; and

c. program code for adjusting the average intensity of the selected portion of the given area of the first image to approximately equal the average intensity of the corresponding portion of the given area of the second image and marking the selected portion where the absolute difference between the selected portion and the corresponding area in the second image is above the threshold.

9. The computer program product according to claim 8, wherein the scene is a terrain scene.

10. The computer program product according to claim 8 wherein the program code is configured so that edges are removed from the first image and from the second image before calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image.

11. A system comprising one or more processors operable to perform operations comparing a first image of a scene and a second image of the scene, the operations including:

a. adjusting a given area of the first image to approximately equal the average intensity of a given area of the second image, the given area of the first image and the given area of the second image corresponding to the same location in the scene;

b. calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image and identifying a selected portion of the given area of the first image where the absolute difference is above a threshold; and

c. adjusting the average intensity of the selected portion of the given area of the first image to approximately equal the average intensity of the corresponding portion of the given area of the second image and marking the selected portion where the absolute difference between the selected portion and the corresponding area in the second image is above the threshold.

12. The system according to claim 11, wherein the scene is a terrain scene.

13. The system according to claim 11 wherein the one or more processors is configured so that edges are removed from the first image and from the second image before calculating the absolute difference in intensity between the given area of the first image after adjustment and the given area of the second image.