IMAGING DEVICE, IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, PROGRAM FOR IMAGE PROCESSING METHOD, AND RECORDING MEDIUM HAVING PROGRAM FOR IMAGE PROCESSING METHOD RECORDED THEREON

• US 20090052797A1
• Filed: 09/20/2007
• Published: 02/26/2009
• Est. Priority Date: 12/15/2006
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamada, Mikiko, Matsushita, Nobuyuki, Nakajima, Ken
• Granted Patent: US 8,295,595 B2
• Time in Patent Office: Days
• US Class Current: 382/260
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2209/046 Colour interpolation to calculate the missing colour values
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements

Abstract

A method and apparatus to remove color noise included in raw data while effectively preventing image quality degradation. For Interest pixels serially set onto a mosaic image formed of raw data, conversion is executed into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in each interest pixel, noise is removed from the pixel value for noise removal, and the pixel value for noise removal with noise removed is converted into the source pixel value, whereby only color noise can be removed without affecting a luminance signal.

Claims

1. :

An image capture apparatus, comprising;

an image capture section that outputs raw data;

a converting section that serially sets each interest pixel onto a mosaic image formed of the raw data and that converts a pixel value of the interest pixel into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in each interest pixel;

a noise removing section that removes noise from the pixel value for noise removal;

a reversely converting section that converts the pixel value for noise removal with noise removed in the noise removing section into a source pixel value by executing an inverse process relative to the process performed in the converting section; and

a demosaicing section that generates full color image data by executing a demosaicing process of a mosaic image formed from the image values processed in the reversely converting section.

2. :

An image capture apparatus as claimed in claim 1, wherein;

the pixel of the mosaic image formed of the raw data is red, green, and blue pixels;

the processing reference pixel value is a pixel value of a green pixel in a spatial position of the red, and blue pixels; and

the pixel value for noise removal is a differential value between the processing reference pixel value and any one of the pixel values of the red and blue pixels.

3. :

An image capture apparatus as claimed in claim 2, wherein the noise removing section further removes noise either from the pixel value of the green pixel of the mosaic image or from the pixel value of the green pixel of the mosaic image and the pixel values of the green pixels in the spatial positions of the red and blue pixels.

4. :

An image capture apparatus as claimed in claim 2, wherein the processing reference pixel value is a median value of the pixel values of the green pixels in a neighborhood of the red and blue pixels.

5. :

An image capture apparatus as claimed in claim 2, wherein;

the mosaic image formed of the raw data is formed of iterative blocks each having an identical pixel arrangement; and

the processing reference pixel value is generated on an assumption that spatial positions of red and blue pixels in one block are identical.

6. :

An image capture apparatus as claimed in claim 1, wherein;

the mosaic image formed of the raw data is formed of red, green, and blue pixels;

the processing reference pixel value is a pixel value of a green pixel in a spatial position of the red and blue pixels; and

the pixel value for noise removal is the pixel value represented by a ratio of the processing reference pixel value to the pixel value of the red or blue pixel.

7. :

An image capture apparatus as claimed in claim 1, wherein;

the pixels of the mosaic image formed of the raw data are red, green, and blue pixels;

the processing reference pixel value is a luminance value in a spatial position of each pixel; and

the pixel value for noise removal is a color difference pixel value.

8. :

An image processing apparatus that suppresses noise of raw data serially acquired in a pixel array of an imaging device, the apparatus comprising;

a converting section that serially sets each interest pixel onto a mosaic image formed of the raw data and that converts a pixel value of the interest pixel into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in each interest pixel;

a noise removing section that removes noise from the pixel value for noise removal; and

a reversely converting section that converts the pixel value for noise removal with noise removed in the noise removing section into the source pixel value by executing an inverse process relative to the process performed in the converting section.

9. :

An image processing method that suppresses noise of raw data serially acquired in a pixel array of an imaging device, the method comprising;

a converting that serially sets each interest pixel onto a mosaic image formed of the raw data and that converts a pixel value of the interest pixel into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in the interest pixel;

a noise removing that removes noise from the pixel value for noise removal; and

a reversely converting that converts the pixel value for noise removal with noise removed in the noise removing into the respective source pixel value by executing an inverse process relative to the process performed in the converting.

10. :

A program for an image processing method that suppresses noise of raw data serially acquired in a pixel array of an imaging device, the program comprising;

a converting that serially sets each interest pixel onto a mosaic image formed of the raw data and that converts a pixel value of the interest pixel into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in each interest pixel;

a noise removing that removes noise from the pixel value for noise removal; and

a reversely converting that converts the pixel value for noise removal with noise removed in the noise removing into the source pixel value by executing an inverse process relative to the process performed in the converting.

11. A recording medium recording thereon a program for executing an image processing method that suppresses noise of raw data serially acquired in a pixel array of an imaging device, the program comprising:

a converting that serially sets each interest pixel onto a mosaic image formed of the raw data and that converts a pixel value of the interest pixel into a pixel value for noise removal based on a processing reference pixel value having a unified color signal component in each interest pixel;

a noise removing that removes noise from the pixel value for noise removal; and

a reversely converting that converts the pixel value for noise removal with noise removed in the noise removing into the source pixel value by executing an inverse process relative to the process performed in the converting.

12. :

An image capturing apparatus comprising;

an image capture section that outputs raw data including a first pixel having a first color component and a second pixel having a second color component;

a first conversion section that converts said second pixel into a pixel for noise removal based on a processing reference pixel generated based on the first pixel, a spatial position of said processing reference pixel corresponding to said second pixel;

a noise removing section that removes noise from the noise removal pixel;

a second conversion section that converts the noise removal pixel from said noise removing section into a pixel having said second color component; and

a full color image generating section that generates full color image data based on the pixel from the full color image generating section and the first pixel.

13. :

The image capturing apparatus according to claim 12,

wherein the noise removal pixel is a pixel representing a color difference.

14. :

The image capturing apparatus according to claim 12,

wherein the first color component is green and the second color component is one of red or blue.

15. :

An image processing apparatus for reducing noise from raw data including a first pixel having a first color component and a second pixel having a second color component, comprising;

a first conversion section that converts said second pixel into a pixel for noise removal based on a processing reference pixel generated based on the first pixel, a spatial position of said processing reference pixel corresponding to said second pixel;

a noise removing section that removes noise from the noise removal pixel;

a second conversion section that converts the noise removal pixel from said noise removing section into a pixel having said second color component; and

a full color image generating section that generates full color image data based on the pixel from the full color image generating section and the first pixel.

16. :

The image processing apparatus according to claim 15,

wherein the noise removal pixel is a pixel representing a color difference.

17. :

The image processing apparatus according to claim 15,

wherein the first color component is green and the second color component is one of red or blue.