IMAGE PROCESSING METHOD FOR DETERMINING DEPTH INFORMATION FROM AT LEAST TWO INPUT IMAGES RECORDED WITH THE AID OF A STEREO CAMERA SYSTEM

• US 20120127275A1
• Filed: 05/07/2010
• Published: 05/24/2012
• Est. Priority Date: 05/14/2009
• Status: Abandoned Application

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Von Zitzewitz, Henning, Niehsen, Wolfgang, Wendt, Axel
• Application Number:
  US13/320,236
• Publication Number:
  US 20120127275A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

An image processing method is described for determining depth information from at least two input images recorded by a stereo camera system, the depth information being determined from a disparity map taking into account geometric properties of the stereo camera system, characterized by the following method steps for ascertaining the disparity map: transforming the input images into signature images with the aid of a predefined operator, calculating costs based on the signature images with the aid of a parameter-free statistical rank correlation measure for ascertaining a cost range for predefined disparity levels in relation to at least one of the at least two input images, performing a correspondence analysis for each point of the cost range for the predefined disparity levels, the disparity to be determined corresponding to the lowest costs, and ascertaining the disparity map from the previously determined disparities.

Claims

1-10. -10. (canceled)

11. An image processing method for determining depth information from at least two input images recorded by a stereo camera system, the method comprising:

determining the depth information being determined from a disparity map taking into account geometric properties of the stereo camera system; and

determining the disparity map by performing the following;

transforming the input images into signature images with the aid of a predefined operator;

calculating costs based on the signature images with the aid of a parameter-free statistical rank correlation measure for ascertaining a cost range for predefined disparity levels in relation to at least one of the at least two input images;

performing a correspondence analysis for each point of the cost range for the predefined disparity levels, the disparity to be determined corresponding with the lowest costs; and

ascertaining the disparity map from the previously determined disparities.

12. The image processing method of claim 11, wherein one of the Kendall'"'"'s-Tau rank correlation coefficient and its variant is used as the non-parametric statistical rank correlation measure.

13. The image processing method of claim 11, wherein a sign operator is used as the predefined operator.

14. The image processing method of claim 13, wherein, with the aid of the sign operator, the signs of the differences of image data, in particular grayscale values, of different image points of the particular input images are determined in a randomly selectable sub-area of the input images and stored in the signature images.

15. The image processing method of claim 14, wherein a considered image data pair is compatible with or corresponds with first image data of a first image point at corresponding positions of a first input image and a second input image and second image data of a second image point at corresponding positions of the first input image and the second input image in the randomly selectable sub-area of the first and second input images when the sign of the difference between the image data of the first image point in the first input image and the image data of the second image point in the first input image coincides with the sign of the difference between the image data of the first image point in the second input image and the image data of the second image point in the second input image, or the signs at the corresponding positions of the first and second image points in the signature images of the first and second input images coincide.

16. The image processing method of claim 15, wherein the Kendall'"'"'s-Tau rank correlation coefficient is given by

17. The image processing method of claim 11, wherein the stereo camera system is designed as a stereo video system and the input images as input video images.

18. A computer readable medium having a computer program, which is executable by a processor, comprising:

a program code arrangement having program code for performing an image processing task for determining depth information from at least two input images recorded by a stereo camera system, by performing the following;

determining the depth information being determined from a disparity map taking into account geometric properties of the stereo camera system; and

determining the disparity map by performing the following;

transforming the input images into signature images with the aid of a predefined operator;

calculating costs based on the signature images with the aid of a parameter-free statistical rank correlation measure for ascertaining a cost range for predefined disparity levels in relation to at least one of the at least two input images;

performing a correspondence analysis for each point of the cost range for the predefined disparity levels, the disparity to be determined corresponding with the lowest costs; and

ascertaining the disparity map from the previously determined disparities;

wherein the computer program is executed on an image processing device of a stereo camera system, which is on one of a microprocessor of a microcomputer, a field programmable gate array, an application-specific integrated circuit, and a digital signal processor.

19. The computer readable medium of claim 18, wherein one of the Kendall'"'"'s-Tau rank correlation coefficient and its variant is used as the non-parametric statistical rank correlation measure.

20. A driver information system of a motor vehicle, comprising:

at least one stereo camera system having an image processing device, provided with the at least one stereo camera system; and

a computer readable medium having a computer program, which is executable by a processor, including;

a program code arrangement having program code for performing an image processing task for determining depth information from at least two input images recorded by a stereo camera system, by performing the following;

determining the depth information being determined from a disparity map taking into account geometric properties of the stereo camera system; and

determining the disparity map by performing the following;

transforming the input images into signature images with the aid of a predefined operator;

calculating costs based on the signature images with the aid of a parameter-free statistical rank correlation measure for ascertaining a cost range for predefined disparity levels in relation to at least one of the at least two input images;

performing a correspondence analysis for each point of the cost range for the predefined disparity levels, the disparity to be determined corresponding with the lowest costs; and

ascertaining the disparity map from the previously determined disparities;

wherein the computer program is executed on an image processing device of a stereo camera system, which is on one of a microprocessor of a microcomputer, a field programmable gate array, an application-specific integrated circuit, and a digital signal processor.