SYSTEMS AND METHODS FOR TRANSFORMING 2D IMAGE DOMAIN DATA INTO A 3D DENSE RANGE MAP

• US 20060233461A1
• Filed: 04/19/2005
• Published: 10/19/2006
• Est. Priority Date: 04/19/2005
• Status: Abandoned Application

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Bazakos, Michael E., Ma, Yunqian, Au, KwongWing
• Application Number:
  US10/907,877
• Publication Number:
  US 20060233461A1
• Time in Patent Office: Days
• US Class Current: 382/285
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects

Abstract

Systems and methods for transforming two-dimensional image data into a 3D dense range map are disclosed. An illustrative method may include the steps of acquiring at least one image frame from an image sensor, selecting at least one region of interest within the image frame, determining the geo-location of three or more reference points within each selected region of interest, and transforming 2D image domain data from each selected region of interest into a 3D dense range map containing physical features of one or more objects within the image frame. The 3D dense range map can be used to calculate physical feature vectors of objects disposed within each defined region of interest. An illustrative video surveillance system may include an image sensor adapted to acquire images from at least one region of interest, a graphical user interface for displaying images acquired from the image sensor within an image frame, and a processor for determining the geo-location of one ore more objects within the image frame. The processor can be configured to run an algorithm or routine adapted to transform two-dimensional data received from the image sensor into a 3D range map containing physical features of one or more objects within the image frame.

Claims

1. A method of transforming two-dimensional image domain data into a 3D dense range map, the method comprising the steps of:

acquiring an image frame from an image sensor;

selecting at least one region of interest within the image frame;

determining the geo-location of three or more reference points within each selected region of interest; and

transforming 2D image domain data from each selected region of interest into a 3D dense range map containing physical features of one or more objects within the image frame.

2. The method of claim 1, wherein said image sensor comprises a single video camera.

3. The method of claim 1, wherein said step of selecting at least one region of interest within the image frame includes the step of manually segmenting the image frame and defining a polygonal zone therein using a graphical user interface.

4. The method of claim 3, wherein said step of determining the geo-location of three or more reference points within each selected region of interest includes the steps of:

measuring the distance from the image sensor to a first and second reference point defining the polygonal zone; and

measuring the distance between said first and second reference points.

5. The method of claim 3, wherein said step of determining the geo-location of three or more reference points within each selected region of interest includes the steps of:

measuring the distance to first and second reference points of a planar triangle defined by the polygonal zone; and

measuring the included angle between the lines forming the two distances.

6. The method of claim 3, further comprising the step of determining the geo-location of one or more objects within the polygonal zone.

7. The method of claim 1, further comprising the steps of:

calculating a feature vector including one or more physical features from each region of interest defined in the image frame; and

outputting a response to a user and/or other algorithm.

8. The method of claim 1, further comprising the steps of:

analyzing a number of successive image frames from the image sensor; and

dynamically updating the 3D dense range map with physical features from each successive image frame.

9. The method of claim 1, wherein said 3D dense range map comprises a 3D look-up table including the coordinates, a region name parameter, and a region type parameter for each region of interest selected.

10. The method of claim 9, wherein the 3D look-up table includes parameters from multiple regions of interest.

11. The method of claim 9, wherein the 3D look-up table includes parameters from multiple image sensors.

12. A method of transforming two-dimensional image domain data into a 3D dense range map, the method comprising the steps of:

acquiring an image frame from an image sensor;

establishing a 3D coordinate system for the image sensor;

manually segmenting at least one region of interest within the image frame and defining a polygonal zone therein using a graphical user interface;

determining the geo-location of three or more reference points within each segmented region of interest;

transforming 2D image domain data from each selected region of interest into a 3D dense range map containing physical features of one or more objects within the image frame;

calculating a feature vector including one or more physical features from each region of interest defined in the image frame;

analyzing a number of successive image frames from the image sensor and determining the geo-location of one or more objects within each successive image frame; and

dynamically updating the 3D dense range map with the one or more physical features from each successive image frame.

13. A video surveillance system, comprising:

an image sensor adapted to acquire images containing at least one region of interest;

display means for displaying images acquired from the image sensor within an image frame; and

processing means for determining the geo-location of one or more objects within the image frame, said processing means configured to run an algorithm or routine adapted to transform two-dimensional image data received from the image sensor into a 3D dense range map containing physical features of one or more objects within the image frame.

14. The video surveillance system of claim 13, wherein said image sensor comprises a single video camera.

15. The video surveillance system of claim 13, wherein said display means is a graphical user interface.

16. The video surveillance system of claim 15, wherein the graphical user interface includes a means for defining a 3D camera coordinate system for the image sensor.

17. The video surveillance system of claim 15, wherein the graphical user interface includes a means for selecting at least one region of interest within the image frame.

18. The video surveillance system of claim 15, wherein the graphical user interface includes a means for manually segmenting a polygonal zone within the image frame.

19. The video surveillance system of claim 13, wherein said processor means is a microprocessor or CPU.

20. The video surveillance system of claim 13, wherein said algorithm or routine is adapted to:

determine the geo-location of one or more objects within each selected region of interest;

calculate a feature vector including one or more physical features from each object within the image frame; and

output a response to a user containing one or more parameters of the feature vector.