Imaging apparatus, imaging element, and image processing method

• US 20070257998A1
• Filed: 06/13/2007
• Published: 11/08/2007
• Est. Priority Date: 12/16/2004
• Status: Active Grant

• Current Assignee: Socionext Inc.
• Original Assignee: Fujitsu Limited
• Inventors: Inoue, Tadao
• Granted Patent: US 7,773,137 B2
• Time in Patent Office: Days
• US Class Current: 348/272
• CPC Class Codes: H04N 2209/047 using multispectral pick-up elements
• CPC Class Codes: H04N 23/84 for processing colour signals
• CPC Class Codes: H04N 25/133 including elements passing panchromatic light, e.g. filters passing white light
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements

Abstract

An imaging element includes a pixel group that has pixels arranged two dimensionally therein, each including a photoelectric converting unit. The pixel arrangement of the pixel group is m rows by n columns. In the pixel group, a pixel area of an arbitrary two rows by two columns respectively includes a red pixel, a green pixel, a blue pixel and a non-color pixel. A red color signal for a given red pixel is a signal value obtained from the pixel. A green signal for the red pixel is obtained by averaging the signal values of two green pixels adjacently on the right and the left of the pixel. A blue signal for the red pixel is obtained by averaging the signal values of four blue pixels adjacently on the upper-right, the upper-left, the lower-right, and the lower-left of the pixel.

Claims

1. An imaging apparatus comprising:

an imaging element having a pixel group that is two-dimensionally-arranged, wherein the pixel group includes color pixels each having a color separating filter that transmits a specific color and non-color pixels that do not have the color separating filter; and

a first brightness information producing unit that produces a first brightness information of a pixel in the pixel group, wherein

the first brightness information producing unit produces the first brightness information based on an electric signal converted by a photoelectric converting unit of the pixel when the pixel is the non-color pixel, and produces the first brightness information based on the electric signal converted by the photoelectric converting unit of the pixel and an electric signal converted by photoelectric converting units of the non-color pixels surrounding the pixel when the pixel is the color pixel.

2. The imaging apparatus according to claim 1, further comprising:

a color signal calculating unit that calculates a color signal of the pixel; and

a color information calculating unit that calculates a color information of the pixel based on the color signal, wherein

the color signal calculating unit calculates the color signal based on the electric signal converted by the photoelectric converting units of the pixel and the color pixels surrounding the pixel when the pixel is the color pixel, and calculates the color signal of the pixel based on an electric signal converted by the photoelectric converting units of the color pixels surrounding the pixel when the pixel is the non-color pixel.

3. The imaging apparatus according to claim 2, further comprising:

a second brightness information producing unit that produces a second brightness information of the pixel based on the color signal; and

a selecting unit that selects any one of the first brightness information and the second brightness information as a selected brightness information, wherein

the imaging apparatus outputs the selected brightness information.

4. The imaging apparatus according to claim 3, further comprising:

a selection control unit that controls the selecting unit to select any one of the first brightness information and the second brightness information as a selected brightness information based on an exposure information that is obtained when the imaging apparatus captures a subject.

5. The imaging apparatus according to claim 2, further comprising:

a second brightness information producing unit that produces a second brightness information of the pixel based on the color signal; and

a selecting unit that selects any one of the first brightness information producing unit and the second brightness information producing unit as a selected brightness information producing unit, wherein

the imaging apparatus outputs the brightness information produced by the selected brightness information producing unit.

6. The imaging apparatus according to claim 5, further comprising:

a selection control unit that controls the selecting unit to select any one of the first brightness information producing unit and the second brightness information producing unit as a selected brightness information producing unit based on an exposure information that is obtained when the imaging apparatus captures a subject.

7. The imaging apparatus according to claim 2, further comprising:

a second brightness information producing unit that produces a second brightness information of the pixel based on the color signal;

a parameter setting unit that sets parameters concerning an amount of light relative to a subject based on an exposure information that is obtained when the imaging apparatus captures the subject; and

a third brightness information producing unit that produces a third brightness information of the pixel based on the first brightness information, the second brightness information, and the parameters.

8. The imaging apparatus according to claim 7, further comprising:

a color information producing unit that produces color information of the pixel based on the color information and the parameters.

9. The imaging apparatus according to claim 1, wherein

the color separating filters include red filters, blue filters, and green filters, and

among the color pixels of the imaging element, green pixels each equipped with the green filter and the non-color pixels of the imaging element are arranged diagonally from each other in the pixel group.

10. The imaging apparatus according to claim 1, wherein the photoelectric converting units of at least the non-color pixels employ an overflow drain structure.

11. The imaging apparatus according to claim 1, wherein

the color separating filters include red filters, blue filters, and green filters,

in the imaging element, among the color pixels, red pixels each equipped with the red filter and blue color pixels each equipped with the blue filter are arranged in an output direction of the electric signals converted by the photoelectric converting units of the red pixels and the blue pixels.

12. The imaging apparatus according to claim 1, wherein the non-color pixels each have any one of a transparent filter and a transparent insulating layer.

13. An imaging apparatus comprising:

an imaging element having a pixel group that is two-dimensionally-arranged and includes color pixels each having a color separating filter that transmits a specific color; and

non-color pixels that do not have the color separating filter;

a color signal calculating unit that calculates a color signal of a pixel in the pixel group; and

a brightness information producing unit that produces a brightness information of the pixel based on the color signal, wherein

the color signal calculating unit calculates the color signal of the pixel based on electric signals converted by photoelectric converting units of the pixel and the color pixels surrounding the pixel when the pixel is the color pixel, and calculates the color signal of the pixel based on the electric signals converted by the photoelectric converting units of the color pixels surrounding the pixel when the pixel is the non-color pixel.

14. The imaging apparatus according to claim 13, further comprising:

a color information calculating unit that calculates a color information of the pixel based on the color signal.

15. The imaging apparatus according to claim 13, wherein

the color separating filters include red filters, blue filters, and green filters,

among the color pixels are red pixels each respectively equipped with the red filter and having a red pixel size, and blue pixels each respectively equipped with the blue filter and having a blue pixel size, and

a size of the non-color pixel is larger than the red pixel size and the blue pixel size.

16. The imaging apparatus according to claim 15, wherein

among the color pixels are green pixels each respectively equipped with the green filter and having a green pixel size, and

the green pixel size is larger than the red pixel size and the blue pixel size.

17. The imaging apparatus according to claim 16, wherein the size of the non-color pixel is larger than the green pixel size.

18. The imaging apparatus according to claim 13, wherein

the color separating filters include red filters, blue filters, and green filters,

in the imaging element, among the color pixels, green pixels each equipped with the green filter are arranged with the non-color pixels in an output direction, and

in a pixel area of two rows by two columns in the pixel group, a first size corresponding to a size of the non-color pixel in the pixel area and a size of the green pixel in the pixel area is the same as a second size corresponding to a size of a red pixel in the pixel area and a size of a blue pixel in the pixel area, the red pixel and the blue pixel also among the color pixels and respectively equipped with the red filter and the blue filter.

19. The imaging apparatus according to claim 13, wherein

the color separating filters include red filters, blue filters, and green filters,

in the imaging element, among the color pixels, green pixels each equipped with the green filter are arranged with the non-color pixels in an output direction, and

in a pixel area of two rows by two columns in the pixel group, a first size corresponding to a size of the non-color pixel in the pixel area and a size of the green pixel in the pixel area differs from a second size corresponding to a size of a red pixel in the pixel area and a size of a blue pixel in the pixel area, the red pixel and the blue pixel also among the color pixels and respectively equipped with the red filter and the blue filter.

20. The imaging apparatus according to claim 19, wherein the first size is smaller than the second size.