IMAGE-CAPTURING DEVICE AND IMAGE SENSOR

• US 20150222833A1
• Filed: 03/29/2013
• Published: 08/06/2015
• Est. Priority Date: 03/30/2012
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Murata, Hironobu
• Granted Patent: US 9,826,183 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 7/34 using different areas in a pupil plane
• CPC Class Codes: H01L 27/14607 Geometry of the photosensitive area
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H01L 27/14645 Colour imagers
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements
• CPC Class Codes: H04N 25/702 SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array

Abstract

An image-capturing device includes an image sensor. The image sensor includes an upper layer pixel group and a lower layer pixel group that receives the light fluxes from the subject that have passed through each pixel in the upper layer pixel group. The lower layer pixel group includes fourth, fifth and sixth pixels having fourth, fifth and sixth spectral sensitivities, respectively, that are complementary to first, second, and third spectral sensitivities, respectively, of the upper layer pixel group, being arranged in a two-dimensional pattern. Positions of first, second and third pixels in the upper layer pixel group and positions of the fourth, fifth and sixth pixels in the lower layer pixel group are determined such that the fourth, fifth and sixth pixels receive light fluxes that pass through the first, second and third pixels, respectively.

Claims

1. An image-capturing device comprising:

an image sensor that captures an image of a subject with light fluxes from the subject that have passed through an imaging optical system;

an image generation unit that generates an image signal based upon an output signal from the image sensor; and

a focus detection unit that detects a focusing condition of the imaging optical system according to a phase detection method based upon an output signal from the image sensor, wherein

the image sensor includes

an upper layer pixel group and a lower layer pixel group that receives the light fluxes from the subject that have passed through each pixel in the upper layer pixel group, and

a microlens group arranged so as to guide the light fluxes from the subject to the upper layer pixel group, wherein

the upper layer pixel group includes first, second and third pixels having first, second and third spectral sensitivities, respectively, differing from each other, and being arranged in a two-dimensional pattern, with one of the first pixels, one of the second pixels and two of the third pixels being arranged in a two-by-two matrix behind each of microlenses in the microlens group, and the four pixels receive four light fluxes, respectively, that pass through four pupil areas, respectively, of an exit pupil of the imaging optical system,

the lower layer pixel group includes fourth, fifth and sixth pixels having fourth, fifth and sixth spectral sensitivities, respectively, that are complementary to the first, second, and third spectral sensitivities, respectively, of the upper layer pixel group, being arranged in a two-dimensional pattern, and

positions of the first, second and third pixels in the upper layer pixel group and positions of the fourth, fifth and sixth pixels in the lower layer pixel group are determined such that the fourth, fifth and sixth pixels receive light fluxes that pass through the first, second and third pixels, respectively,

the image generation unit generates the image signal based upon an output signal from one of the upper layer pixel group and the lower layer pixel group, and

the focus detection unit detects the focusing condition based upon an output signal from other of the upper layer pixel group and the lower layer pixel group.

2. An image-capturing device according to claim 1, wherein

in the upper layer pixel group, the first, second, and third pixels are arranged such that pixels having substantially same spectral sensitivities are adjacently arranged in a two-by-two matrix, and four pixels adjacent to the two-by-two matrix are arranged behind four different microlenses in the microlens group, respectively, and at different positions with respect to the microlenses.

3. An image-capturing device according to claim 2, wherein

in the upper layer pixel group, the first, second and third pixels provide output signals relating to cyan, yellow, and magenta, respectively, and

in the lower layer pixel group, the fourth, fifth and sixth pixels provide output signals relating to colors complementary to the cyan, yellow and magenta, respectively.

4. An image-capturing device according to claim 3, wherein

the upper layer pixel group and the lower layer pixel group each include an array of a plurality of sets of pixels arranged in a two-dimensional pattern, each of the plurality of sets of pixels having four pixels arranged in a two-by-two matrix behind any particular one of the microlenses and the sets include first through fourth sets having different arrangements of pixels, and wherein

the upper layer pixel group is configured such that

in the first set, the first pixel and the third pixel are adjacently arranged in a predetermined array direction and the third pixel and the second pixel are arranged adjacent to the first pixel and the third pixel, respectively, in a direction perpendicular to the predetermined array direction,

in the second set, the third pixel and the first pixel are adjacently arranged in the predetermined array direction and the second pixel and the third pixel are arranged adjacent to the third pixel and the first pixel, respectively, in the direction perpendicular to the predetermined array direction,

in the third set, the third pixel and the second pixel are adjacently arranged in the predetermined array direction and the first pixel and the third pixel are arranged adjacent to the third pixel and the second pixel, respectively, in the direction perpendicular to the predetermined array direction,

in the fourth set, the second pixel and the third pixel are adjacently arranged in the predetermined array direction and the third pixel and the first pixel are arranged adjacent to the second pixel and the third pixel, respectively, in the direction perpendicular to the predetermined array direction, and

the first set and the second set are adjacent to each other in the predetermined array direction and alternately arranged in a repeated manner in the predetermined array direction, the third set and the fourth set are adjacent to each other in the predetermined array direction and alternately arranged in a repeated manner in the predetermined array direction, and a first row formed by the first set and the second set and a second row formed by the third set and the fourth set are adjacent to each other in the direction perpendicular to the predetermined array direction and alternately arranged in a repeated manner in the direction perpendicular to the predetermined array direction.

5. An image-capturing device according to claim 2, wherein

the image generation unit adds output signals from four of the fourth pixels that are adjacent to each other in a form of a two-by-two matrix, adds output signals from four of the fifth pixels that are adjacent to each other in a form of a two-by-two matrix, and adds output signals from four of the sixth pixels that are adjacent to each other in a form of a two-by-two matrix to generate an image signal of a Bayer arrangement.

6. An image-capturing device according to claim 1, wherein

the image generation unit obtains three color signals at a position corresponding to each microlens based upon output signals from the fourth, fifth and sixth pixels positioned behind each microlens.

7. An image-capturing device according to claim 1, wherein

the image generation unit executes, at respective positions of the fourth through sixth pixels, color interpolation processing for generating signals of other two spectral components to obtain three color signals and generates a luminance signal and color difference signals based upon the three color signals thus obtained.

8. An image-capturing device according to claim 1, wherein

the focus detection unit detects the focusing condition of the imaging optical system based upon output signals from a pair of pixels having substantially the same spectral sensitivities and located at positions differing from each other with respect to the microlens, out of the upper layer pixel group or the lower layer pixel group.

9. An image-capturing device according to claim 4, wherein

the focus detection unit detects the focusing condition of the imaging optical system in the predetermined array direction based upon output signals from at least one plurality of the third pixels of a plurality of the third pixels included in the first set and the second set, respectively, and a plurality of the third pixels included in the third set and the fourth set, respectively, in the upper layer pixel group.

10. An image-capturing device according to claim 4, wherein

the focus detection unit detects the focusing condition of the imaging optical system in the direction perpendicular to the predetermined array direction based upon output signals from at least one plurality of the third pixels of a plurality of the third pixels included in the first set and the third set, respectively, and a plurality of the third pixels included in the second set and the fourth set, respectively, in the upper layer pixel group.

11. An image-capturing device according to claim 4, wherein

the focus detection unit detects the focusing condition of the imaging optical system in a direction oblique to the predetermined array direction based upon output signals from at least one plurality of the third pixels of a plurality of the third pixels included in the first set and the fourth set, respectively, and a plurality of the third pixels included in the second set and the third set, respectively, in the upper layer pixel group.

12. An image sensor comprising:

a first image-capturing unit that includes

a plurality of microlenses arranged in a two-dimensional pattern and

a plurality of light reception units that are provided in correspondence to each of the microlenses, respectively, and that receive light having a predetermined wavelength and transmit lights having wavelengths different from the predetermined wavelength; and

a second image-capturing unit that receives the lights that are transmitted through the first image-capturing units.

13. An image sensor according to claim 12, wherein

the first imaging unit includes light reception units that are arranged adjacent to each other so as to be provided in correspondence to adjacent two of the microlenses and that absorb light having same wavelength corresponding to the predetermined wavelength.