Apparatus for multiple camera devices and method of operating same

• US 20060054782A1
• Filed: 08/25/2005
• Published: 03/16/2006
• Est. Priority Date: 08/25/2004
• Status: Abandoned Application

• Current Assignee: Newport Imaging Corporation
• Original Assignee: Newport Imaging Corporation
• Inventors: Sun, Feng-Qing, Sato, Darryl L., Olsen, Richard Ian, Gates, James, Oten, Remzi, Moller, Borden, Vitomirov, Olivera, Brady, Jeffrey A., Gunawan, Ferry
• Application Number:
  US11/212,803
• Publication Number:
  US 20060054782A1
• Time in Patent Office: Days
• US Class Current: 250/208.100
• CPC Class Codes: G02B 13/0035 having three lenses
• CPC Class Codes: G02B 3/0031 Replication or moulding, e.g. hot embossing, UV-casting, injection moulding
• CPC Class Codes: G02B 3/0043 Inhomogeneous or irregular arrays, e.g. varying shape, size, height
• CPC Class Codes: G02B 3/0062 Stacked lens arrays, i.e. refractive surfaces arranged in at least two planes, without structurally separate optical elements in-between
• CPC Class Codes: G02B 3/0075 characterized by non-optical structures, e.g. having integrated holding or alignment means
• CPC Class Codes: G02B 7/04 with mechanism for focusing or varying magnification
• CPC Class Codes: G02B 9/12 having three components only
• CPC Class Codes: G03B 13/18 Focusing aids
• CPC Class Codes: H01L 27/14618 Containers
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14625 Optical elements or arrangements associated with the device
• CPC Class Codes: H01L 27/14634 Assemblies, i.e. Hybrid structures
• CPC Class Codes: H01L 27/14645 Colour imagers
• CPC Class Codes: H01L 27/1469 Assemblies, i.e. hybrid integration
• CPC Class Codes: H01L 2924/00 Indexing scheme for arrangements or methods for connecting or disconnecting semiconductor or solid-state bodies as covered by H01L24/00
• CPC Class Codes: H01L 2924/0002 Not covered by any one of groups H01L24/00, H01L24/00 and H01L2224/00
• CPC Class Codes: H01L 31/0232 Optical elements or arrangements associated with the device H01L31/0236 takes precedence; for photovoltaic cells H01L31/054; for photovoltaic modules H02S40/20
• CPC Class Codes: H01L 31/02325 the optical elements not being integrated nor being directly associated with the device
• CPC Class Codes: H04N 13/214 using spectral multiplexing
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 2209/049 : having three pick-up sensors
• CPC Class Codes: H04N 23/11 : for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/13 : with multiple sensors
• CPC Class Codes: H04N 23/16 : Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
• CPC Class Codes: H04N 23/40 : Circuit details for pick-up tubes
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/57 : Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/73 : by influencing the exposure time
• CPC Class Codes: H04N 23/84 : for processing colour signals
• CPC Class Codes: H04N 25/00 : Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/134 : based on three different wavelength filter elements
• CPC Class Codes: H04N 25/41 : Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 25/531 : by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 5/265 : Mixing

Abstract

There are many, many inventions described herein. In one aspect, what is disclosed is a digital camera including a plurality of arrays of photo detectors, including a first array of photo detectors to sample an intensity of light of a first wavelength and a second array of photo detectors to sample an intensity of light of a second wavelength. The digital camera further may also include a first lens disposed in an optical path of the first array of photo detectors, wherein the first lens includes a predetermined optical response to the light of the first wavelength, and a second lens disposed in with an optical path of the second array of photo detectors wherein the second lens includes a predetermined optical response to the light of the second wavelength. In addition, the digital camera may include signal processing circuitry, coupled to the first and second arrays of photo detectors, to generate a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

Claims

1. A digital camera comprising:

a plurality of arrays of photo detectors, including;

a first array of photo detectors to sample an intensity of light; and

a second array of photo detectors to sample an intensity of light;

signal processing circuitry, coupled to the first and second arrays of photo detectors, to generate a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; and

wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

2. The digital camera of claim 1 wherein:

the first array of photo detectors sample an intensity of light of a first wavelength; and

the second array of photo detectors sample an intensity of light of a second wavelength.

3. The digital camera of claim 2 further including a third array of photo detectors to sample the intensity of light of a third wavelength, and wherein the signal processing circuitry is coupled to the third array of photo detectors and generates a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, (ii) data which is representative of the intensity of light sampled by the second array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the third array of photo detectors.

4. The digital camera of claim 3 wherein the first, second and third arrays of photo detectors are relatively arranged in a triangular configuration.

5. The digital camera of claim 4 wherein the first array of photo detectors, the second array of photo detectors, the third array of photo detectors, and the signal processing circuitry are integrated on the same semiconductor substrate.

6. The digital camera of claim 5 wherein the first wavelength is associated with a first color, the second wavelength is associated with a second color and the third wavelength is associated with a third color.

7. The digital camera of claim 3 wherein:

the first array of photo detectors sample the intensity of light of the first wavelength for a first integration time;

the second array of photo detectors sample the intensity of light of the second wavelength for a second integration time; and

the third array of photo detectors sample the intensity of light of the third wavelength for a third integration time.

8. The digital camera of claim 3 wherein the first, second and third arrays of photo detectors are relatively arranged in an isosceles, obtuse, acute or a right triangular configuration.

9. The digital camera of claim 2 wherein the first wavelength is associated with a first color and the second wavelength is associated with a second color.

10. The digital camera of claim 1 wherein:

the first array of photo detectors sample the intensity of light for a first integration time; and

the second array of photo detectors sample the intensity of light for a second integration time.

11. The digital camera of claim 1 wherein:

each photo detector of the first array includes a semiconductor portion at which the intensity of light is sampled; and

each photo detector of the second array includes a semiconductor portion at which the intensity of light is sampled and wherein the semiconductor portion of each photo detector of the first array is located at a different depth, relative to a surface of each of the photo detectors, from than semiconductor portion of each photo detector of the second array.

12. The digital camera of claim 1 wherein the first array of photo detectors and the second array of photo detectors are disposed in the same image plane.

13. The digital camera of claim 1 further including a first lens disposed in and associated with an optical path of the first array of photo detectors and a second lens disposed in and associated with an optical path of the second array of photo detectors.

14. The digital camera of claim 13 further including a substantially uniform color filter sheet disposed in the optical path of the first array of photo detectors.

15. The digital camera of claim 1 further including a first colored lens disposed in and associated with an optical path of the first array of photo detectors.

16. The digital camera of claim 1 further including a first lens disposed in and associated with an optical path of the first array of photo detectors, wherein:

the first lens passes light of a first wavelength and filters light of a second wavelength;

the first array of photo detectors sample an intensity of light of a first wavelength; and

the second array of photo detectors sample an intensity of light of a second wavelength.

17. The digital camera of claim 1 wherein:

the first array of photo detectors sample an intensity of light of a first wavelength and an intensity of light of a second wavelength;

the second array of photo detectors sample an intensity of light of a third wavelength; and

the first wavelength is associated with a first color, the second wavelength is associated with a second color and the third wavelength is associated with a third color.

18. The digital camera of claim 17 wherein:

each photo detector of the first array includes a first semiconductor portion at which the intensity of light of the first wavelength is sampled and a second semiconductor portion at which the intensity of light of the second wavelength is sampled;

each photo detector of the second array includes a semiconductor portion at which the intensity of light of the third wavelength is sampled; and

the first and second semiconductor portions of each photo detector of the first array are located at a different depth, relative to each other and to a surface of each of the photo detectors from the semiconductor portion of each photo detector of the second array.

19. The digital camera of claim 17 further including a first lens disposed in and associated with an optical path of the first array of photo detectors and a second lens disposed in and associated with an optical path of the second array of photo detectors wherein the first lens passes light of the first and second wavelengths and filters light of the third wavelength.

20. The digital camera of claim 17 further including an optical filter disposed in and associated with an optical path of the first array of photo detectors wherein the optical filter passes light of the first and second wavelengths and filters light of the third wavelength.

21. The digital camera of claim 17 wherein:

the first array of photo detectors sample the intensity of light of the first wavelength for a first integration time;

the first array of photo detectors sample the intensity of light of the second wavelength for a second integration time; and

the second array of photo detectors sample the intensity of light of the third wavelength for a third integration time.

22. The digital camera of claim 1 wherein the signal processing circuitry generates:

a first image using data which is representative of the intensity of light sampled by the first array of photo detectors, and

a second image using data which is representative of the intensity of light sampled by the second array of photo detectors.

23. The digital camera of claim 22 wherein the signal processing circuitry generates the composite image using the first image and the second image.

24. The digital camera of claim 1 further including a memory to store (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors.

25. The digital camera of claim 24 wherein the memory, the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

26. The digital camera of claim 25 further including timing and control logic that to provide timing and control information to the signal processing circuitry, the first array of photo detectors and/or the second array of photo detectors.

27. The digital camera of claim 24 further including communication circuitry to output data which is representative of the composite image.

28. The digital camera of claim 27 wherein the communication circuitry includes at least one of wireless, wired or optical communication circuitry.

29. The digital camera of claim 24 wherein the communication circuitry, the memory, the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

30. The digital camera of claim 1 wherein the first array of photo detectors includes a first surface area and the second array of photo detectors includes a second surface area wherein the first surface area is different from the second surface area.

31. The digital camera of claim 30 wherein the photo detectors of the first array include a first active surface area and the photo detectors of the second array include a second active surface area wherein the first active surface area is different from the second active surface area.

32. The digital camera of claim 1 wherein the first array of photo detectors includes a first surface area and the second array of photo detectors includes a second surface area wherein the first surface area is substantially the same as the second surface area.

33. The digital camera of claim 32 wherein the photo detectors of the first array include a first active surface area and the photo detectors of the second array include a second active surface area wherein the first active surface area is different from the second active surface area.

34. A digital camera comprising:

a plurality of arrays of photo detectors, including;

a first array of photo detectors to sample an intensity of light of a first wavelength; and

a second array of photo detectors to sample an intensity of light of a second wavelength;

a first lens disposed in an optical path of the first array of photo detectors wherein the first lens includes a predetermined optical response to the light of the first wavelength;

a second lens disposed in with an optical path of the second array of photo detectors wherein the second lens includes a predetermined optical response to the light of the second wavelength;

signal processing circuitry, coupled to the first and second arrays of photo detectors, to generate a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; and

wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

35. The digital camera of claim 34 wherein:

the first lens passes light of the first wavelength onto an image plane of the photo detectors of the first array; and

the second lens passes light of the second wavelength onto an image plane of the photo detectors of the second array.

36. The digital camera of claim 35 wherein:

the first lens filters light of the second wavelength; and

the second lens filters light of the first wavelength.

37. The digital camera of claim 34 further including:

a third array of photo detectors to sample the intensity of light of a third wavelength;

a third lens disposed in with an optical path of the third array of photo detectors wherein the third lens includes a predetermined optical response to the light of the third wavelength; and

and wherein the signal processing circuitry is coupled to the third array of photo detectors and generates a composite image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, (ii) data which is representative of the intensity of light sampled by the second array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the third array of photo detectors.

38. The digital camera of claim 37 wherein:

the first lens filters light of the second and third wavelengths;

the second lens filters light of the first and third wavelengths; and

the third lens filters light of the first and second wavelengths.

39. The digital camera of claim 37 wherein the first, second and third arrays of photo detectors are relatively arranged in a triangular configuration.

40. The digital camera of claim 39 wherein the first array of photo detectors, the second array of photo detectors, the third array of photo detectors, and the signal processing circuitry are integrated on the same semiconductor substrate.

41. The digital camera of claim 40 wherein the first wavelength is associated with a first color, the second wavelength is associated with a second color and the third wavelength is associated with a third color.

42. The digital camera of claim 37 wherein:

the first array of photo detectors sample the intensity of light of the first wavelength for a first integration time;

the second array of photo detectors sample the intensity of light of the second wavelength for a second integration time; and

the third array of photo detectors sample the intensity of light of the third wavelength for a third integration time.

43. The digital camera of claim 34 wherein the first wavelength is associated with a first color and the second wavelength is associated with a second color.

44. The digital camera of claim 43 wherein:

the first array of photo detectors sample the intensity of light for a first integration time; and

the second array of photo detectors sample the intensity of light for a second integration time.

45. The digital camera of claim 34 further including a housing, wherein the first and second lenses, first and second arrays of photo detectors, and the signal processing circuitry are attached to the housing, and wherein the first and second lenses are independently positionable relative to the associated array of photo detectors.

46. The digital camera of claim 34 wherein:

the first array of photo detectors sample an intensity of light of the first wavelength and an intensity of light of a third wavelength;

the second array of photo detectors sample an intensity of light of a second wavelength; and

the first wavelength is associated with a first color, the second wavelength is associated with a second color and the third wavelength is associated with a third color.

47. The digital camera of claim 46 wherein:

each photo detector of the first array includes a first semiconductor portion at which the intensity of light of the first wavelength is sampled and a second semiconductor portion at which the intensity of light of the third wavelength is sampled;

each photo detector of the second array includes a semiconductor portion at which the intensity of light of the second wavelength is sampled; and

the first and second semiconductor portions of each photo detector of the first array are located at a different depth, relative to each other and to a surface of each of the photo detectors from the semiconductor portion of each photo detector of the second array.

48. The digital camera of claim 46 wherein the first lens passes light of the first and third wavelengths and filters light of a second wavelength.

49. The digital camera of claim 46 further including an optical filter disposed in and associated with an optical path of the first array of photo detectors wherein the optical filter passes light of the first and third wavelengths and filters light of the second wavelength.

50. The digital camera of claim 46 wherein:

the first array of photo detectors sample the intensity of light of the first wavelength for a first integration time;

the second array of photo detectors sample the intensity of light of the third wavelength for a second integration time; and

the first array of photo detectors sample the intensity of light of the third wavelength for a third integration time.

51. The digital camera of claim 34 wherein the signal processing circuitry generates:

a first image using data which is representative of the intensity of light sampled by the first array of photo detectors, and

a second image using data which is representative of the intensity of light sampled by the second array of photo detectors.

52. The digital camera of claim 51 wherein the signal processing circuitry generates the composite image using the first image and the second image.

53. The digital camera of claim 34 further including a memory to store (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors.

54. The digital camera of claim 53 wherein the memory, the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

55. The digital camera of claim 53 further including communication circuitry to output data which is representative of the composite image.

56. The digital camera of claim 55 wherein the communication circuitry includes at least one of wireless, wired or optical communication circuitry.

57. The digital camera of claim 53 wherein the communication circuitry, the memory, the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

58. The digital camera of claim 34 wherein the signal processing circuitry includes first signal processing circuitry and second signal processing circuitry wherein the first signal processing circuitry is coupled to and associated with the first array of photo detectors and second signal processing circuitry is coupled to and associated with the second array of photo detectors.

59. The digital camera of claim 34 wherein the signal processing circuitry includes first analog signal logic and second analog signal logic wherein the first analog signal logic is coupled to and associated with the first array of photo detectors and second analog signal logic is coupled to and associated with the second array of photo detectors.

60. The digital camera of claim 34 wherein the signal processing circuitry includes first black level logic and second black level logic wherein the first black level logic is coupled to and associated with the first array of photo detectors and second black level logic is coupled to and associated with the second array of photo detectors.

61. The digital camera of claim 34 wherein the signal processing circuitry includes first exposure control circuitry and second exposure control circuitry wherein the first exposure control circuitry is coupled to and associated with the first array of photo detectors and second exposure control circuitry is coupled to and associated with the second array of photo detectors.

62. The digital camera of claim 34 further including a frame, wherein the first and second arrays of photo detectors, the signal processing circuitry, and the first and second lenses are fixed to the frame.

63. The digital camera of claim 34 further including timing and control logic that to provide timing and control information to the signal processing circuitry, the first array of photo detectors and/or the second array of photo detectors.

64. The digital camera of claim 34 wherein the first array of photo detectors includes a first surface area and the second array of photo detectors includes a second surface area wherein the first surface area is different from the second surface area.

65. The digital camera of claim 64 wherein the photo detectors of the first array include a first active surface area and the photo detectors of the second array include a second active surface area wherein the first active surface area is different from the second active surface area.

66. The digital camera of claim 34 wherein the first array of photo detectors includes a first surface area and the second array of photo detectors includes a second surface area wherein the first surface area is substantially the same as the second surface area.

67. The digital camera of claim 66 wherein the photo detectors of the first array include a first active surface area and the photo detectors of the second array include a second active surface area wherein the first active surface area is different from the second active surface area.