3D IMAGE SIGNAL PROCESSING METHOD FOR REMOVING PIXEL NOISE FROM DEPTH INFORMATION AND 3D IMAGE SIGNAL PROCESSOR THEREFOR

• US 20120182394A1
• Filed: 01/19/2012
• Published: 07/19/2012
• Est. Priority Date: 01/19/2011
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: BAE, KWANG HYUK, KIM, TAE CHAN, KYUNG, KYU-MIN
• Application Number:
  US13/353,407
• Publication Number:
  US 20120182394A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/207 using a single 2D image sensor
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

A three-dimensional (3D) image signal processing method increases signal-to-noise ratio by performing pixel binning on depth information obtained by a 3D image sensor, without changing a filter array detecting the depth information. The processing method may be used in a 3D image signal processor, and a 3D image processing system including the 3D image signal processor.

Claims

1. A three-dimensional (3D) image signal processing method comprising:

generating a first image based on color information and depth information obtained by a 3D image sensor;

obtaining a binning value by performing binning using a particular pixel among pixels for the depth information of the first image and pixels for the depth information that are adjacent the particular pixel; and

updating the depth information with the binning value and generating a second image by matching updated depth information with the color information.

2. The 3D image signal processing method of claim 1, wherein said generating the first image comprises separating the pixels for the depth information from pixels for the color information, and storing the pixels for the depth information.

3. The 3D image signal processing method of claim 2, wherein said obtaining the binning value comprises:

selecting the particular pixel from the pixels for the depth information of the first image and obtaining an average value using pixel values of the particular pixel and the adjacent pixels,

said updating the depth information including updating the pixel value of the particular pixel with the average value, and updating the depth information with respect to an entirety of the first image.

4. The 3D image signal processing method of claim 3, wherein said selecting the particular pixel and obtaining the average value comprises:

selecting the particular pixel from the pixels for the depth information of the first image;

deciding a weight for each of the particular pixel and the adjacent pixels; and

obtaining a weighted average using pixel values of the weighted pixels.

5. The 3D image signal processing method of claim 1, wherein said obtaining the binning value further comprises controlling the binning based on a value of the depth information of the first image.

6. The 3D image signal processing method of claim 2, wherein said obtaining the binning value further comprises controlling the binning based on a value of the depth information of the first image.

7. The 3D image signal processing method of claim 3, wherein said obtaining the binning value further comprises controlling the binning based on a value of the depth information of the first image.

8. The 3D image signal processing method of claim 4, wherein said obtaining the binning value further comprises controlling the binning based on a value of the depth information of the first image.

9. A non-transitory computer readable recording medium for storing a program for executing the 3D image signal processing method of claim 1.

10. A three-dimensional (3D) image signal processor comprising:

a first image generator configured to generate a first image based on color information and depth information obtained by a 3D image sensor; and

a pixel binning unit configured to perform binning using a particular pixel among pixels for the depth information of the first image and pixels for the depth information that are adjacent the particular pixel.

11. The 3D image signal processor of claim 10, further comprising a depth buffer configured to separate the pixels for the depth information from pixels for the color information and store the pixels for the depth information.

12. The 3D image signal processor of claim 11, wherein the pixel binning unit comprises:

a calculator configured to select the particular pixel of the first image from the depth buffer and calculate an average value using pixel values of the particular pixel and the adjacent pixels;

an updating block configured to update the pixel value of the particular pixel with the average value and update the depth information with respect to an entirety of the first image; and

a matching block configured to generate a second image by matching updated depth information with the color information.

13. The 3D image signal processor of claim 12, wherein the calculator decides a weight for each of the particular pixel and the adjacent pixels, applies the weight to each of the pixels, and calculates a weighted average.

14. The 3D image signal processor of claim 10, further comprising a controller configured to generate a control signal based on a value of the depth information of the first image to control an operation of the pixel binning unit.

15. A three-dimensional (3D) image processing system comprising the 3D image signal processor of claim 10.

16. A three-dimensional (3D) image processing system comprising:

an image sensor configured to generate color information and depth information of an object;

a first image generator configured to generate a first image based on the color information and the depth information; and

an image signal processor configured to separate from the first image pixels for depth information and pixels for color information, select a particular pixel in the first image from among the pixels for depth information, obtain an average pixel value of the particular pixel and pixels for the depth information in the first image that are adjacent the particular pixel, update the depth information of the particular pixel using the average pixel value, and generate and output a second image by matching the updated depth information with the color information.

17. The 3D image processing system of claim 16, wherein the image signal processor is further configured to determine a weight for each of the particular pixel and the adjacent pixels, and obtain a weighted average using pixel values of the weighted pixels for use as the average pixel value.