APPARATUS AND METHOD FOR RECONSTRUCTING THREE-DIMENSIONAL INFORMATION

• US 20140210951A1
• Filed: 08/06/2013
• Published: 07/31/2014
• Est. Priority Date: 01/25/2013
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: CHO, Seong-Ik
• Application Number:
  US13/960,525
• Publication Number:
  US 20140210951A1
• Time in Patent Office: Days
• US Class Current: 348/49
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

Disclosed herein is an apparatus and method for reconstructing 3D information. The present invention calculates a normalized cross correlation value using luminance information included in two or more stereo images, calculates a normalized edge correlation value using local edge information, and extracts disparity surface information from a composite disparity image generated based on two types of matching costs.

Claims

1. An apparatus for reconstructing three-dimensional (3D) information, comprising:

a stereo image acquisition unit configured to acquire stereo images having a parallax therebetween from an object;

an edge information generation unit configured to generate edge information that is feature information about each of the stereo images, using an edge operator;

a normalized edge correlation calculation unit configured to calculate a normalized edge correlation coefficient for corresponding pixels in the stereo images by using the edge information;

an edge disparity space image generation unit configured to generate a 3D edge disparity space image based on the normalized edge correlation coefficient; and

a disparity information extraction unit configured to extract disparity surface information using the edge disparity space image.

2. The apparatus of claim 1, wherein the edge information generation unit calculates edge vectors for the corresponding pixels in the stereo images, and then generates the edge information.

3. The apparatus of claim 2, wherein the normalized edge correlation calculation unit calculates the normalized edge correlation coefficient using geometric characteristics between the edge vectors calculated for the corresponding pixels in the stereo images.

4. The apparatus of claim 3, wherein the geometric characteristics between the edge vectors include an angle between the edge vectors.

5. The apparatus of claim 4, further comprising a normalized cross correlation calculation unit configured to calculate a normalized cross correlation coefficient for the corresponding pixels in the stereo images using luminance information of a center pixel and neighboring pixels around the center pixel in each of the stereo images.

6. The apparatus of claim 5, further comprising a luminance disparity space image generation unit configured to generate a 3D luminance disparity space image based on the normalized cross correlation coefficient.

7. The apparatus of claim 6, further comprising a disparity space image combination unit configured to combine the edge disparity space image generated by the edge disparity space image generation unit and the luminance disparity space image generated by the luminance disparity space image generation unit into a single composite 3D space image.

8. The apparatus of claim 7, wherein the disparity information extraction unit extracts the disparity surface information from the composite 3D space image into which the edge disparity space image and the luminance disparity space image are combined.

9. A method of reconstructing three-dimensional (3D) information, comprising:

acquiring, by a stereo image acquisition unit, stereo images having a parallax therebetween from an object;

generating, by an edge information generation unit, edge information that is feature information about each of the stereo images, using an edge operator;

calculating, by a normalized edge correlation calculation unit, a normalized edge correlation coefficient for corresponding pixels in the stereo images by using the edge information;

generating, by an edge disparity space image generation unit, a 3D edge disparity space image based on the normalized edge correlation coefficient; and

extracting, by a disparity information extraction unit, disparity surface information from the edge disparity space image.

10. The method of claim 9, wherein generating the edge information that is the feature information about each of the stereo images comprises calculating edge vectors for the corresponding pixels in the stereo images and then generating the edge information.

11. The method of claim 10, wherein calculating the normalized edge correlation coefficient for the corresponding pixels in the stereo images comprises calculating the normalized edge correlation coefficient using geometric characteristics between the edge vectors calculated for the corresponding pixels in the stereo images.

12. The method of claim 11, wherein the geometric characteristics between the edge vectors include an angle between the edge vectors.

13. A method of reconstructing three-dimensional (3D) information, comprising:

acquiring, by a stereo image acquisition unit, stereo images having a parallax therebetween from an object;

calculating, by a normalized cross correlation calculation unit, a normalized cross correlation coefficient for the corresponding pixels in the stereo images using luminance information of a center pixel and neighboring pixels around the center pixel in each of the stereo images;

generating, by a luminance disparity space image generation unit, a 3D luminance disparity space image based on the normalized cross correlation coefficient calculated for the corresponding pixels in the stereo images;

generating, by an edge information generation unit, edge information that is feature information about each of the stereo images, using an edge operator;

calculating, by a normalized edge correlation calculation unit, a normalized edge correlation coefficient for the corresponding pixels in the stereo images by using the edge information generated for each of the stereo images;

generating, by an edge disparity space image generation unit, a 3D edge disparity space image based on the normalized edge correlation coefficient calculated for the corresponding pixels in the stereo images;

combining, by a disparity space image combination unit, the luminance disparity space image generated by the luminance disparity space image generation unit and the edge disparity space image generated by the edge disparity space image generation unit into a single composite 3D space image; and

extracting disparity surface information from the composite 3D space image into which the edge disparity space image and the luminance disparity space image are combined.

14. The method of claim 13, wherein generating the edge information that is the feature information about each of the stereo images comprises calculating edge vectors for the corresponding pixels in the stereo images and then generating the edge information.

15. The method of claim 14, wherein calculating the normalized edge correlation coefficient for the corresponding pixels in the stereo images comprises calculating the normalized edge correlation coefficient using geometric characteristics between the edge vectors calculated for the corresponding pixels in the stereo images.

16. The method of claim 15, wherein the geometric characteristics between the edge vectors calculated for the corresponding pixels in the stereo images include an angle between the edge vectors calculated for the corresponding pixels in the stereo images.