Imaging apparatus and imaging method including first and second imaging devices

• US 9,979,951 B2
• Filed: 02/06/2017
• Issued: 05/22/2018
• Est. Priority Date: 05/24/2013
• Status: Expired due to Fees

• Current Assignee: Sony Semiconductor Solutions Corporation (Sony Group Corp.)
• Original Assignee: Sony Semiconductor Solutions Corporation (Sony Group Corp.)
• Inventors: Yamazaki, Akihisa, Mitsunaga, Tomoo, Kaizu, Shun, Yoshimura, Shin
• Primary Examiner(s): Elahi, Shan E
• Application Number:
  US15/425,520
• Publication Number:
  US 20170150125A1
• Time in Patent Office: 470 Days
• Field of Search: 348 47, 348 48, 348 46
• CPC Class Codes: G06K 7/00 Methods or arrangements for sensing record carriers, e.g. for reading patterns methods or arrangements for marking the record carrier in digital fashion G06K1/00; pattern recognition G06F18/00; arrangements for image or video recognition or understanding G06V10/00; character recognition, recognising digital ink or document-oriented image-based pattern recognition G06V30/00
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/257 Colour aspects
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details

Abstract

An imaging apparatus includes: a first imaging device configured to perform photoelectric conversion on subject light input through a first filter to output a first image signal, the first filter preventing light in a predetermined wavelength band of wavelengths longer than that of visible light from being transmitted; a second imaging device arranged at a different position from the first imaging device and configured to perform photoelectric conversion on subject light containing a wavelength component of the light in the predetermined wavelength band to output a second image signal; a correlation detection unit configured to detect a correlation between the first and second image signals; a luminance signal generation unit configured to generate a luminance signal; a color signal generation unit configured to generate a color signal; and a three-dimensional image generation unit configured to generate a three-dimensional image by the correlation, the luminance signal, and the color signal.

Claims

1. An imaging apparatus, comprising:

a first imaging device including a first filter, the first imaging device is configured to perform photoelectric conversion on subject light that is input through the first filter to output a first image signal,

a second imaging device provided at a position different from the first imaging device, the second imaging device is configured to perform photoelectric conversion on subject light having a wavelength in a predetermined wavelength band to output a second image signal;

a correlation detection device configured to generate correlation information from the first image signal and the second image signal;

a luminance signal generation device configured to generate a luminance signal from the second image signal; and

a color signal generation device configured to generate a color signal from at least one of the first image signal and the second image signal,

wherein the correlation detection device is configured to generate the correlation information between the first image signal and the second image signal using a normalized correlation method.

2. The imaging apparatus according to claim 1, wherein the first filter is configured to prevent transmission of light in a wavelength band of infrared rays.

3. The imaging apparatus according to claim 1, further comprising a three-dimensional image generation device, and wherein the three-dimensional image generation device is configured to generate a three-dimensional image based on the correlation information, the luminance signal, and the color signal, and to transmit the generated three-dimensional image to a display device.

4. The imaging apparatus according to claim 1, wherein the first filter includes an infrared cut filter.

5. The imaging apparatus according to claim 4, wherein the second imaging device includes a second filter, and wherein the second imaging device is configured to generate the second image signal from subject light that is input through the second filter.

6. The imaging apparatus according to claim 5, wherein

the second imaging device is configured to perform photoelectric conversion on the subject light that is input through the second filter, and is configured to exclude light in a wavelength band in which bottoms of wavelengths of R, G, and B on a high frequency side overlap with one another, to generate the second image signal.

7. An imaging method, comprising:

performing, by a first imaging device including a first filter, photoelectric conversion on subject light that is input through the first filter to output a first image signal;

performing, by a second imaging device provided at a position different from the first imaging device, photoelectric conversion on subject light containing a wavelength component of the light in a predetermined wavelength band to output a second image signal;

generating correlation information, by a correlation detection device, from the first image signal and the second image signal;

generating a luminance signal from the second image signal; and

generating a color signal from at least one of the first image signal and the second image signal,

wherein the correlation detection device is configured to generate the correlation information between the first image signal and the second image signal by using a normalized correlation method.

8. The imaging method according to claim 7, wherein the first filter is configured to prevent transmission of light in a wavelength band of infrared rays.

9. The imaging method according to claim 7, further comprising

generating a three-dimensional image based on the correlation information, the luminance signal, and the color signal;

and

transmitting the generated three-dimensional image to a display device.

10. The imaging method according to claim 7, wherein the first filter includes an infrared cut filter.

11. The imaging method according to claim 10, wherein the second imaging device includes a second filter, and the second imaging device is configured to generate the second image signal from subject light that is input through the second filter, the second filter blocking light in a wavelength band of near-infrared rays.

12. The imaging method according to claim 11, wherein the second imaging device is configured to perform photoelectric conversion on the subject light that is input through the second filter, and is configured to exclude light in a wavelength band in which bottoms of wavelengths of R, G, and B on a high frequency side overlap with one another, to generate the second image signal.