Apparatus for multiple camera devices and method of operating same

• US 7,199,348 B2
• Filed: 11/02/2005
• Issued: 04/03/2007
• Est. Priority Date: 08/25/2004
• Status: Active Grant

• Current Assignee: Intellectual Ventures II LLC (Intellectual Ventures LLC)
• Original Assignee: Newport Imaging Corporation
• Inventors: Sun, Feng-Qing, Sato, Darryl L., Olsen, Richard Ian, Gates, James, Oten, Remzi, Moller, Borden, Vitomirov, Olivera, Brady, Jeffrey A., Gunawan, Ferry
• Primary Examiner(s): Allen; Stephone B.
• Application Number:
  US11/265,669
• Publication Number:
  US 20060054787A1
• Time in Patent Office: 517 Days
• Field of Search: 250/208.1, 250/208.2, 348/216.1, 348/218.1, 348/296, 348/299, 348/303, 348/311, 348/312, 348/314, 348/316, 348/322, 348/220.1
• US Class Current: 250/208.1
• CPC Class Codes: G02B 13/0035 having three lenses
• CPC Class Codes: G02B 3/0031 Replication or moulding, e.g. hot embossing, UV-casting, injection moulding
• CPC Class Codes: G02B 3/0043 Inhomogeneous or irregular arrays, e.g. varying shape, size, height
• CPC Class Codes: G02B 3/0062 Stacked lens arrays, i.e. refractive surfaces arranged in at least two planes, without structurally separate optical elements in-between
• CPC Class Codes: G02B 3/0075 characterized by non-optical structures, e.g. having integrated holding or alignment means
• CPC Class Codes: G02B 7/04 with mechanism for focusing or varying magnification
• CPC Class Codes: G02B 9/12 having three components only
• CPC Class Codes: G03B 13/18 Focusing aids
• CPC Class Codes: H01L 27/14618 Containers
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14625 Optical elements or arrangements associated with the device
• CPC Class Codes: H01L 27/14634 Assemblies, i.e. Hybrid structures
• CPC Class Codes: H01L 27/14645 Colour imagers
• CPC Class Codes: H01L 27/1469 Assemblies, i.e. hybrid integration
• CPC Class Codes: H01L 2924/00 Indexing scheme for arrangements or methods for connecting or disconnecting semiconductor or solid-state bodies as covered by H01L24/00
• CPC Class Codes: H01L 2924/0002 Not covered by any one of groups H01L24/00, H01L24/00 and H01L2224/00
• CPC Class Codes: H01L 31/0232 Optical elements or arrangements associated with the device H01L31/0236 takes precedence; for photovoltaic cells H01L31/054; for photovoltaic modules H02S40/20
• CPC Class Codes: H01L 31/02325 the optical elements not being integrated nor being directly associated with the device
• CPC Class Codes: H04N 13/214 using spectral multiplexing
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 2209/049 : having three pick-up sensors
• CPC Class Codes: H04N 23/11 : for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/13 : with multiple sensors
• CPC Class Codes: H04N 23/16 : Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
• CPC Class Codes: H04N 23/40 : Circuit details for pick-up tubes
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/57 : Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/73 : by influencing the exposure time
• CPC Class Codes: H04N 23/84 : for processing colour signals
• CPC Class Codes: H04N 25/00 : Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/134 : based on three different wavelength filter elements
• CPC Class Codes: H04N 25/41 : Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 25/531 : by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 25/76 : Addressed sensors, e.g. MOS or CMOS sensors
• CPC Class Codes: H04N 5/265 : Mixing

Abstract

There are many, many inventions described herein. In one aspect, what is disclosed is a digital camera including a plurality of arrays of photo detectors, including a first array of photo detectors to sample an intensity of light of a first wavelength and a second array of photo detectors to sample an intensity of light of a second wavelength. The digital camera further may also include a first lens disposed in an optical path of the first array of photo detectors, wherein the first lens includes a predetermined optical response to the light of the first wavelength, and a second lens disposed in with an optical path of the second array of photo detectors wherein the second lens includes a predetermined optical response to the light of the second wavelength. In addition, the digital camera may include signal processing circuitry, coupled to the first and second arrays of photo detectors, to generate a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

Claims

1. A digital camera comprising:

a plurality of arrays of photodetectors, including;

a first array of photodetectors to sample an intensity of light for a first integration time;

a second array of photodetectors to sample an intensity of light for a second integration time; and

a third array of photodetectors to sample an intensity of light for a third integration time;

signal processing circuitry, coupled to the first, second and third arrays of photodetectors, to generate a composite image using (i) data which is representative of the intensity of light sampled by the first array of photodetectors for the first integration time, (ii) data which is representative of the intensity of light sampled by the second array of photodetectors for the second integration time, and (ii) data which is representative of the intensity of light sampled by the third array of photodetectors for the third integration time; and

wherein the first integration time is different than the second integration time.

2. The digital camera of claim 1 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time; and

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time, and wherein the first band of wavelengths is different from the second band of wavelengths.

3. The digital camera of claim 2 further comprising:

means, disposed in an optical path of the first array of photodetectors, for filtering the light of the second band of wavelengths; and

means, disposed in an optical path of the second array of photodetectors, for filtering the light of the first band of wavelengths.

4. The digital camera of claim 2 wherein:

the first array of photodetectors has a higher sensitivity to the light of the first band of wavelengths than to the light of the second band of wavelengths; and

the second array of photodetectors has a higher sensitivity to the light of the second band of wavelengths than to the light of the first band of wavelengths.

5. The digital camera of claim 2 wherein the first band of wavelengths is associated with a first color and the second band of wavelengths is associated with a second color, and wherein the first color is different from the second color.

6. The digital camera of claim 1 wherein the first array of photodetectors and the second array of photodetectors are disposed in the same image plane.

7. The digital camera of claim 1 wherein the first array of photodetectors and the second array of photodetectors are disposed on the same semiconductor substrate.

8. The digital camera of claim 1 wherein the first array of photodetectors and the second array of photodetectors are integrated on or in the same semiconductor substrate.

9. The digital camera of claim 1 wherein the third integration time is different than the first integration time.

10. The digital camera of claim 1 wherein the third integration time is different than the first integration time and the second integration time.

11. The digital camera of claim 10 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time; and

the third array of photodetectors sample an intensity of light of a third band of wavelengths for the third integration time; and

wherein the first band of wavelengths is different from the second and third bands of wavelengths and the second band of wavelengths is different from the third band of wavelengths.

12. The digital camera of claim 11 wherein the first band of wavelengths is associated with a first color, the second band of wavelengths is associated with a second color and the third band of wavelengths is associated with a third color and wherein the first, second and third colors are different from one another.

13. The digital camera of claim 12 wherein the first, second and third arrays of photodetectors are relatively arranged in a triangular configuration.

14. The digital camera of claim 12 wherein the first, second and third arrays of photodetectors are relatively arranged in an isosceles, obtuse, acute or a right triangular configuration.

15. The digital camera of claim 11 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are disposed on the same semiconductor substrate.

16. The digital camera of claim 11 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are integrated on or in the same semiconductor substrate.

17. The digital camera of claim 1 further comprising:

a first optics portion associated with the first array of photodetectors; and

a second optics portion associated with the second array of photodetectors.

18. The digital camera of claim 17 wherein:

the first optics portion produces a first image area at an image plane; and

the second optics portion produces a second image area at the image plane.

19. The digital camera of claim 17 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time; and

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time, and wherein the first band of wavelengths is different from the second band of wavelengths.

20. The digital camera of claim 19 wherein:

the first optics portion filters light of the second band of wavelengths; and

the second optics portion filters light of the first band of wavelengths.

21. The digital camera of claim 20 wherein the first array of photodetectors and the second array of photodetectors are disposed on the same semiconductor substrate.

22. The digital camera of claim 20 wherein the first array of photodetectors and the second array of photodetectors are integrated on or in the same semiconductor substrate.

23. The digital camera of claim 20 wherein:

the third array of photodetectors sample an intensity of light of a third band of wavelengths for a third integration time that is different than the first integration time and/or the second integration time, wherein the third band of wavelengths is different from the first and second bands of wavelengths; and

the digital camera further includes a third optics portion associated with the third array of photodetectors.

24. The digital camera of claim 1 further comprising:

a first lens disposed in an optical path of the first array of photodetectors; and

a second lens disposed in an optical path of the second array of photodetectors.

25. The digital camera of claim 24 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time, wherein the second band of wavelengths is different from the first band of wavelengths;

the first lens includes a predetermined optical response to the light of the first band of wavelengths; and

the second lens includes a predetermined optical response to the light of the second band of wavelengths.

26. The digital camera of claim 25 wherein:

the first lens passes light of the first band of wavelengths onto an image plane of the photodetectors of the first array; and

the second lens passes light of the second band of wavelengths onto an image plane of the photodetectors of the second array.

27. The digital camera of claim 26 wherein:

the first lens filters light of the second band of wavelengths; and

the second lens filters light of the first band of wavelengths.

28. The digital camera of claim 27 wherein the first band of wavelengths is associated with a first color and the second band of wavelengths is associated with a second color, and wherein the first color is different from the second color.

29. The digital camera of claim 27 wherein:

the third array of photodetectors sample an intensity of light of a third band of wavelengths for a third integration time that is different from the first integration time and/or the second integration time, wherein the third band of wavelengths is different from the first and second bands of wavelengths; and

the digital camera further includes a third lens disposed in an optical path of the third array of photodetectors wherein the third lens includes a predetermined optical response to the light of the third band of wavelengths.

30. The digital camera of claim 29 wherein:

the third lens passes light of the third band of wavelengths onto an image plane of the photodetectors of the third array.

31. The digital camera of claim 30 wherein:

the first lens filters light of the second band of wavelengths and the third band of wavelengths;

the second lens filters light of the first band of wavelengths and the third band of wavelengths; and

the third lens filters light of the first band of wavelengths and the second band of wavelengths.

32. The digital camera of claim 31 wherein the first band of wavelengths is associated with a first color, the second band of wavelengths is associated with a second color and the third band of wavelengths is associated with a third color, and wherein the first, second and third colors are different from one another.

33. The digital camera of claim 32 wherein the first, second and third arrays of photodetectors are relatively arranged in a triangular configuration.

34. The digital camera of claim 31 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are disposed on the same semiconductor substrate.

35. The digital camera of claim 31 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are integrated on or in the same semiconductor substrate.

36. The digital camera of claim 25 further including a housing, wherein the first and second lenses, first and second arrays of photodetectors, and the signal processing circuitry are attached to the housing, and wherein the first and second lenses are independently positionable relative to the associated array of photodetectors.

37. A method for use in a digital camera, the method comprising:

sampling an intensity of light for a first integration time using a first array of photodetectors;

sampling an intensity of light for a second integration time using a second array of photodetectors;

sampling an intensity of light for a third integration time using a third array of photodetectors;

generating a composite image using (i) data representative of the intensity of light sampled by the first array of photodetectors for the first integration time, (ii) data representative of the intensity of light sampled by the second array of photodetectors for the second integration time, and (iii) data representative of the intensity of light sampled by the third array of photodetectors for the third integration time; and

wherein the first integration time is different than the second integration time.

38. The method of claim 37 wherein:

sampling an intensity of light for a first integration time comprises sampling an intensity of light of a first band of wavelengths for the first integration time; and

sampling an intensity of light for a second integration time comprises sampling an intensity of light of a second band of wavelengths for the second integration time; and

wherein the first band of wavelengths is different from the second band of wavelengths.

39. The method of claim 38 further comprising:

passing light of the first band of wavelengths onto an image plane of the photodetectors of the first array; and

passing light of the second band of wavelengths onto an image plane of the photodetectors of the second array.

40. The method of claim 39 further comprising:

filtering light of the second band of wavelengths from the optical path of the first array of photodetectors; and

filtering light of the first band of wavelengths from the optical path of the second array of photodetectors.

41. The method of claim 40 wherein the first array of photodetectors and the second array of photodetectors are disposed on the same semiconductor substrate.

42. The method of claim 40 wherein the first array of photodetectors and the second array of photodetectors are integrated on or in the same semiconductor substrate.

43. The method of claim 40 wherein the first band of wavelengths is associated with a first color and the second band of wavelengths is associated with a second color, and wherein the first color is different from the second color.

44. The method of claim 39 wherein:

the first array of photodetectors has a higher sensitivity to the light of the first band of wavelengths than to the light of the second band of wavelengths; and

the second array of photodetectors has a higher sensitivity to the light of the second band of wavelengths than to the light of the first band of wavelengths.

45. A digital camera comprising:

a plurality of arrays of photodetectors, including;

a first array of photodetectors to sample an intensity of light for a first integration time;

a second array of photodetectors to sample an intensity of light for a second integration time; and

a third array of photodetectors to sample an intensity of light for a third integration time;

processor means for generating a composite image using (i) data representative of the intensity of light sampled by the first array of photodetectors for the first integration time, (ii) data representative of the intensity of light sampled by the second array of photodetectors for the second integration time, and (ii) data representative of the intensity of light sampled by the third array of photodetectors for the third integration time; and

wherein the first integration time is different than the second integration time.

46. The digital camera of claim 45 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time; and

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time, wherein the first band of wavelengths is different from the second band of wavelengths.

47. The digital camera of claim 46 further comprising:

means, disposed in an optical path of the first array of photodetectors, for filtering the light of the second band of wavelengths; and

means, disposed in an optical path of the second array of photodetectors, for filtering the light of the first band of wavelengths.

48. The digital camera of claim 46 wherein:

the first array of photodetectors has a higher sensitivity to the light of the first band of wavelengths than to the light of the second band of wavelengths; and

the second array of photodetectors has a higher sensitivity to the light of the second band of wavelengths than to the light of the first band of wavelengths.

49. The digital camera of claim 45 wherein the first array of photodetectors and the second array of photodetectors are disposed on the same semiconductor substrate.

50. The digital camera of claim 45 wherein the first array of photodetectors and the second array of photodetectors are integrated on or in the same semiconductor substrate.

51. The digital camera of claim 45 further comprising:

a first optics portion associated with the first array of photodetectors; and

a second optics portion associated with the second array of photodetectors.

52. The digital camera of claim 51 wherein:

the first optics portion produces a first image area at an image plane; and

the second optics portion produces a second image area at the image plane.

53. The digital camera of claim 51 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time, and wherein the first band of wavelengths is different from the second band of wavelengths;

the first optics portion filters light of the second band of wavelengths; and

the second optics portion filters light of the first band of wavelengths.

54. The digital camera of claim 53 wherein the first array of photodetectors and the second array of photodetectors are disposed on the same semiconductor substrate.

55. The digital camera of claim 53 wherein the first array of photodetectors and the second array of photodetectors are integrated on or in the same semiconductor substrate.

56. The digital camera of claim 45 wherein the third integration time is different from the first integration time and the second integration time.

57. The digital camera of claim 56 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time; and

the third array of photodetectors sample an intensity of light of a third band of wavelengths for the third integration time, wherein the first band of wavelengths is different from the second and the third bands of wavelengths and the second band of wavelengths is different from the third band of wavelengths.

58. The digital camera of claim 57 wherein the first band of wavelengths is associated with a first color, the second band of wavelengths is associated with a second color and the third band of wavelengths is associated with a third color, and wherein the first, second and third colors are different from one another.

59. The digital camera of claim 58 wherein the first, second and third arrays of photodetectors are relatively arranged in a triangular configuration.

60. The digital camera of claim 58 wherein the first, second and third arrays of photodetectors are relatively arranged in an isosceles, obtuse, acute or a right triangular configuration.

61. The digital camera of claim 57 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are disposed on the same semiconductor substrate.

62. The digital camera of claim 57 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are integrated on or in the same semiconductor substrate.

63. The digital camera of claim 45 further comprising:

a first optics portion associated with the first array of photodetectors;

a second optics portion associated with the second array of photodetectors; and

a third optics portion associated with the third array of photodetectors.

64. The digital camera of claim 63 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time;

the third array of photodetectors sample an intensity of light of a third band of wavelengths for the third integration time, wherein the first band of wavelengths is different from the second and the third bands of wavelengths and the second band of wavelengths is different from the third band of wavelengths;

the first optics portion filters light of the second band of wavelengths;

the second optics portion filters light of the first band of wavelengths; and

the third optics portion filters light of the first and/or second bands of wavelengths.

65. The digital camera of claim 64 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are disposed on the same semiconductor substrate.

66. The digital camera of claim 64 wherein the first array of photodetectors, the second array of photodetectors and the third array of photodetectors are integrated on or in the same semiconductor substrate.

67. The digital camera of claim 45 wherein:

the first array of photodetectors sample an intensity of light of a first band of wavelengths for the first integration time;

the second array of photodetectors sample an intensity of light of a second band of wavelengths for the second integration time; and

the third array of photodetectors sample an intensity of light of a third band of wavelengths for the third integration time, wherein the first band of wavelengths is different from the second and the third bands of wavelengths and the second band of wavelengths is different from the third band of wavelengths.

68. The digital camera of claim 67 wherein the third integration time is different from the first integration time and the second integration time.

69. The digital camera of claim 45 wherein the first, second and third arrays of photodetectors are relatively arranged in a triangular configuration.

70. The digital camera of claim 68 wherein the first, second and third arrays of photodetectors are relatively arranged in an isosceles, obtuse, acute or a right triangular configuration.