Apparatus and method for disparity map generation

• US 8,798,358 B2
• Filed: 10/09/2013
• Issued: 08/05/2014
• Est. Priority Date: 09/02/2010
• Status: Active Grant

• Current Assignee: Golden Edge Holding Corporation
• Original Assignee: Edge Technologies, Inc
• Inventors: El Dokor, Tarek, Cluster, Jordan, King, Joshua, Holmes, James Edward
• Primary Examiner(s): Rush, Eric
• Application Number:
  US14/050,308
• Publication Number:
  US 20140037192A1
• Time in Patent Office: 300 Days
• Field of Search: 382/100, 382/103, 382/154, 382/282, 382/293, 382/294, 345/419, 348/42
• US Class Current: 382/154
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85

Abstract

A method and system for generating a disparity map. The method comprises the steps of generating a first disparity map based upon a first image and a second image acquired at a first time, acquiring at least a third image and a fourth image at a second time, and determining one or more portions comprising a difference between one of the first and second images and a corresponding one of the third and fourth images. A disparity map update is generated for the one or more determined portions, and a disparity map is generated based upon the third image and the fourth image by combining the disparity map update and the first disparity map.

Claims

1. A method for generating a disparity map, comprising the steps of:

generating a first disparity map for images acquired at a first time;

determining one or more objects or portions of objects that change position between the images acquired at the first time and images acquired at a second time;

generating disparity map update segments corresponding to the objects or portions of objects, wherein a determination of disparity between the images acquired at the second time is performed only on portions thereof that have changed from one or more of the images acquired at the first time; and

combining the first disparity map and the disparity map update segments.

2. The method of claim 1, wherein the step of combining the first disparity map and the disparity map update segments further comprises the steps of:

determining the position of the objects or portions of objects in the images acquired at the second time; and

replacing these positions in the first disparity map with the corresponding disparity map update segments.

3. The method of claim 2, wherein the objects or portions of objects comprise portions of an image that have changed.

4. A system for generating a disparity map, comprising the steps of:

a stereo camera for acquiring a first image and a second image at a first time and a third image and a fourth image at a second time;

a processor for generating a first disparity map based upon the first image and the second image acquired at the first time, determining one or more portions comprising a difference between one of the first and second images and a corresponding one of the third and fourth images, generating a disparity map update for the one or more determined portions, wherein a determination of disparity between the third image and the fourth image acquired at the second time is performed only on portions thereof that have changed from the first and second images acquired at the first time, and generating a disparity map by combining the disparity map update and the first disparity map.

5. The system of claim 4, wherein the processor, when combining the disparity map update and the first disparity map, is further adapted to:

identify one or more locations in the first disparity map corresponding to the determined one or more portions; and

substitute for each identified location in the first disparity map a corresponding portion of the disparity map update.

6. The system of claim 4, wherein the processor is a graphical processing unit (GPU).

7. The system of claim 4, wherein the processor is an arithmetic logic unit (ALU).

8. The system of claim 4, wherein the processor is a multi-core computer processing unit (CPU).

9. The system of claim 4, wherein the processor is a multi-core embedded processing unit.

10. A computer program stored on a non-transient storage medium, the computer program, when implemented in accordance with a processor, causes the processor to perform the steps of:

generating a first disparity map based upon a first image and a second image acquired at a first time;

acquiring at least a third image and a fourth image at a second time;

determining one or more portions comprising a difference between one of the first and second images and a corresponding one of the third and fourth images;

generating a disparity map update for the one or more determined portions, wherein a determination of disparity between the third and fourth images acquired at the second time is performed only on portions thereof that have changed from the first and second images acquired at the first time; and

generating a disparity map based upon the third image and the fourth image by combining the disparity map update and the first disparity map.

11. The computer program of claim 10, wherein combining the disparity map update and the first disparity map further comprises the steps of:

identifying one or more locations in the first disparity map corresponding to the determined one or more portions; and

substituting for each identified location in the first disparity map a corresponding portion of the disparity map update.

12. A computer program stored on a non-transient storage medium, the computer program, when implemented in accordance with a processor, causes the processor to perform the steps of:

generating a first disparity map for images acquired at a first time;

determining one or more objects that change position between the images acquired at the first time and images acquired at a second time;

generating disparity map update segments corresponding to the determined one or more objects, wherein a determination of disparity between the images acquired at the second time is performed only on portions thereof that have changed from the images acquired at the first time; and

combining the first disparity map and the disparity map update segments.

13. The computer program of claim 12, wherein the step of combining the first disparity map and the disparity map update segments further comprises the steps of:

determining the position of the objects in the images acquired at the second time; and

replacing these positions in the first disparity map with the corresponding disparity map update segments.

14. The computer program of claim 12, wherein the objects comprise portions of an image that have changed.