Method and apparatus for use in camera and systems employing same

• US 20070002159A1
• Filed: 06/29/2006
• Published: 01/04/2007
• Est. Priority Date: 07/01/2005
• Status: Active Grant

• Current Assignee: Intellectual Ventures II LLC (Intellectual Ventures LLC)
• Original Assignee: Protarius Filo AG LLC (Intellectual Ventures LLC)
• Inventors: Sun, Feng-Qing, Gates, James, Brady, Jeffrey, Oten, Remzi, Moller, Borden, Vitomirov, Olivera, Gunawan, Ferry, Olsen, Richard, Sato, Darryl
• Granted Patent: US 7,772,532 B2
• Time in Patent Office: Days
• US Class Current: 348/335
• CPC Class Codes: G02B 13/0035 having three lenses
• CPC Class Codes: G02B 13/009 having zoom function
• CPC Class Codes: G02B 7/04 with mechanism for focusing or varying magnification
• CPC Class Codes: G02B 7/102 controlled by a microcomputer cameras with interchangeable lenses G03B17/14
• CPC Class Codes: G03B 13/18 Focusing aids
• CPC Class Codes: G03B 2205/0007 Movement of one or more optical elements for control of motion blur
• CPC Class Codes: G03B 3/00 Focusing arrangements of general interest for cameras, projectors or printers
• CPC Class Codes: G03B 33/04 by four or more separation records
• CPC Class Codes: G03B 33/16 using colour-pattern screens integral with film G03C
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: G03B 35/18 by simultaneous viewing
• CPC Class Codes: G03B 5/00 Adjustment of optical system relative to image or object surface other than for focusing
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: H01L 27/14618 Containers
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14625 Optical elements or arrangements associated with the device
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H01L 27/14634 Assemblies, i.e. Hybrid structures
• CPC Class Codes: H01L 27/1469 Assemblies, i.e. hybrid integration
• CPC Class Codes: H01L 2924/00 Indexing scheme for arrangements or methods for connecting or disconnecting semiconductor or solid-state bodies as covered by H01L24/00
• CPC Class Codes: H01L 2924/0002 : Not covered by any one of groups H01L24/00, H01L24/00 and H01L2224/00
• CPC Class Codes: H01L 31/02325 : the optical elements not being integrated nor being directly associated with the device
• CPC Class Codes: H04N 19/00 : Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 23/11 : for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/16 : Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
• CPC Class Codes: H04N 23/54 : Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 : Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/57 : Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/673 : based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/68 : for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/687 : by shifting the lens or sensor position
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/843 : Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/41 : Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors

Abstract

There are many inventions described herein. Some aspects are directed to methods and/or apparatus to provide relative movement between optics, or portion(s) thereof, and sensors, or portion(s) thereof, in a digital camera. The relative movement may be in any of various directions. In some aspects, relative movement between an optics portion, or portion(s) thereof, and a sensor portion, or portion(s) thereof, are used in providing any of various features and/or in the various applications disclosed herein, including, for example, but not limited to, increasing resolution, optical and electronic zoom, image stabilization, channel alignment, channel-channel alignment, image alignment, lens alignment, masking, image discrimination, range finding, 3D imaging, auto focus, mechanical shutter, mechanical iris, multi and hyperspectral imaging, and/or combinations thereof. In some aspects, movement is provided by actuators, for example, but not limited to MEMS actuators, and by applying appropriate control signal thereto.

Claims

32. A digital camera comprising:

a plurality of arrays of photo detectors, including;

a first array of photo detectors to sample an intensity of light; and

a second array of photo detectors to sample an intensity of light;

a first lens disposed in an optical path of the first array of photo detectors;

a second lens disposed in an optical path of the second array of photo detectors;

signal processing circuitry, coupled to the first and second arrays of photo detectors, to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and/or (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; and

at least one actuator to provide relative movement between the first array of photo detectors and the first lens and to provide relative movement between the second array of photo detectors and the second lens.

1. A digital camera comprising:

a first array of photo detectors to sample an intensity of light; and

a second array of photo detectors to sample an intensity of light;

a first optics portion disposed in an optical path of the first array of photo detectors;

a second optics portion disposed in an optical path of the second array of photo detectors;

a processor, coupled to the first and second arrays of photo detectors, to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and/or (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; and

at least one actuator to provide relative movement between at least one portion of the first array of photo detectors and at least one portion of the first optics portion and to provide relative movement between at least one portion of the second array of photo detectors and at least one portion of the second optics portion.

2. The digital camera of claim 1 wherein the at least one actuator includes:

at least one actuator to provide relative movement between at least one portion of the first array of photo detectors and at least one portion of the first optics portion; and

at least one actuator to provide relative movement between at least one portion of the second array of photo detectors and at least one portion of the second optics portion.

3. The digital camera of claim 1 wherein the at least one actuator includes:

a plurality of actuators to provide relative movement between at least one portion of the first array of photo detectors and at least one portion of the first optics portion; and

at least one actuator to provide relative movement between at least one portion of the second array of photo detectors and at least one portion of the second optics portion.

4. The digital camera of claim 1 wherein the first array of photo detectors define an image plane and the second array of photo detectors define an image plane.

5. The digital camera of claim 4 wherein the at least one actuator includes:

at least one actuator to provide movement of at least one portion of the first optics portion in a direction parallel to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of at least one portion of the second optics portion in a direction parallel to the image plane defined by the second array of photo detectors.

6. The digital camera of claim 4 wherein the at least one actuator includes:

at least one actuator to provide movement of at least one portion of the first optics portion in a direction perpendicular to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of at least one portion of the second optics portion in a direction perpendicular to the image plane defined by the second array of photo detectors.

7. The digital camera of claim 4 wherein the at least one actuator includes:

at least one actuator to provide movement of at least one portion of the first optics portion in a direction oblique to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of at least one portion of the second optics portion in a direction oblique to the image plane defined by the second array of photo detectors.

8. The digital camera of claim 1 wherein the at least one actuator includes:

at least one actuator to provide angular movement between the first array of photo detectors and at least one portion of the first optics portion; and

at least one actuator to provide angular movement between the second array of photo detectors and at least one portion of the second optics portion.

9. The digital camera of claim 1 wherein the first array of photo detectors, the second array of photo detectors, and the processor are integrated on or in the same semiconductor substrate.

10. The digital camera of claim 1 wherein the first array of photo detectors, the second array of photo detectors, and the processor are disposed on or in the same semiconductor substrate.

11. The digital camera of claim 1 wherein the processor comprises a processor to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors with a first relative positioning of the first optics portion and the first array of photo detectors and (ii) data which is representative of the intensity of light sampled by the first array of photo detectors with a second relative positioning of the first optics portion and the first array of photo detectors.

12. The digital camera of claim 1 wherein the processor comprises a processor to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors with a first relative positioning of the first optics portion and the first array of photo detectors, (ii) data which is representative of the intensity of light sampled by the first array of photo detectors with a second relative positioning of the first optics portion and the first array of photo detectors, (iii) data which is representative of the intensity of light sampled by the second array of photo detectors with a first relative positioning of the second optics portion and the second array of photo detectors and (ii) data which is representative of the intensity of light sampled by the second array of photo detectors with a second relative positioning of the second optics portion and the second array of photo detectors.

13. The digital camera of claim 1 wherein the at least one portion of the first optics portion comprises a lens.

14. The digital camera of claim 1 wherein the at least one portion of the first optics portion comprises a filter.

15. The digital camera of claim 1 wherein the at least one portion of the first optics portion comprises a mask and/or polarizer.

16. The digital camera of claim 1 wherein the processor is configured to receive at least one input signal indicative of a desired operating mode and to provide, in response at least thereto, at least one actuator control signal.

17. The digital camera of claim 16 wherein the at least one actuator includes at least one actuator to receive the at least one actuator control signal from the processor and in response at least thereto, to provide relative movement between the first array of photo detectors and the at least one portion of the first optics portion.

18. The digital camera of claim 1 wherein the at least one actuator includes:

at least one actuator to receive at least one actuator control signal and in response thereto, to provide relative movement between the first array of photo detectors and the at least one portion of the first optics portion; and

at least one actuator to receive at least one actuator control signal and in response thereto, to provide relative movement between the second array of photo detectors and the at least one portion of the second optics portion.

19. The digital camera of claim 1 wherein:

the first array of photo detectors sample an intensity of light of a first wavelength; and

the second array of photo detectors sample an intensity of light of a second wavelength different than the first wavelength.

20. The digital camera of claim 1 wherein:

the first optics portion passes light of the first wavelength onto an image plane of the photo detectors of the first array of photo detectors; and

the second optics portion passes light of the second wavelength onto an image plane of the photo detectors of the second array of photo detectors.

21. The digital camera of claim 20 wherein:

the first optics portion filters light of the second wavelength; and

the second optics portion filters light of the first wavelength.

22. The digital camera of claim 1 further comprising a positioner including:

a first portion that defines a seat for at least one portion of the first optics portion; and

a second portion that defines a seat for at least one portion of the second lens.

23. The digital camera of claim 22 wherein:

the first portion of the positioner blocks light from the second optics portion and defines a path to transmit light from the first optics portion, and

the second portion of the positioner blocks light from the first optics portion and defines a path to transmit light from the second optics portion.

24. The digital camera of claim 23 wherein the at least one actuator includes:

at least one actuator coupled between the first portion of the positioner and a third portion of the positioner to provide movement of the at least one portion of the first optics portion; and

at least one actuator coupled between the second portion of the positioner and a fourth portion of the positioner to provide movement of the at least one portion of the second optics portion.

25. The digital camera of claim 22 further including an integrated circuit die that includes the first array of photo detectors and the second array of photo detectors.

26. The digital camera of claim 25 wherein the positioner is disposed superjacent the integrated circuit die.

27. The digital camera of claim 26 wherein the positioner is bonded to the integrated circuit die.

28. The digital camera of claim 26 further comprising a spacer disposed between the positioner and the integrated circuit die, wherein the spacer is bonded to the integrated circuit die and the positioner is bonded to the spacer.

29. The digital camera of claim 1 wherein the at least one actuator includes at least one actuator that moves the at least one portion of the first optics portion along a first axis.

30. The digital camera of claim 31 wherein the at least one actuator further includes at least one actuator that moves the at least one portion of the first optics portion along a second axis different than the first axis.

31. The digital camera of claim 1 the at least one actuator includes at least one MEMS actuator.

33. The digital camera of claim 32 wherein the at least one actuator includes:

at least one actuator to provide relative movement between the first array of photo detectors and the first lens; and

at least one actuator to provide relative movement between the second array of photo detectors and the second lens.

34. The digital camera of claim 32 wherein the at least one actuator includes:

a plurality of actuators to provide relative movement between the first array of photo detectors and the first lens; and

a plurality of actuators to provide relative movement between the second array of photo detectors and the second lens.

35. The digital camera of claim 32 wherein the first array of photo detectors define an image plane and the second array of photo detectors define an image plane.

36. The digital camera of claim 35 wherein the at least one actuator includes:

at least one actuator to provide movement of the first lens in a direction parallel to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of the second lens in a direction parallel to the image plane defined by the second array of photo detectors.

37. The digital camera of claim 35 wherein the at least one actuator includes:

at least one actuator to provide movement of the first lens in a direction perpendicular to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of the second lens in a direction parallel to the image plane defined by the second array of photo detectors.

38. The digital camera of claim 35 wherein the at least one actuator includes:

at least one actuator to provide movement of the first lens in a direction oblique to the image plane defined by the first array of photo detectors; and

at least one actuator to provide movement of the second lens in a direction oblique to the image plane defined by the second array of photo detectors.

39. The digital camera of claim 35 wherein the at least one actuator includes:

at least one actuator to provide angular movement between the first array of photo detectors and the first lens; and

at least one actuator to provide angular movement between the second array of photo detectors and the second lens.

40. The digital camera of claim 32 wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are integrated on or in the same semiconductor substrate.

41. The digital camera of claim 32 wherein the first array of photo detectors, the second array of photo detectors, and the signal processing circuitry are disposed on or in the same semiconductor substrate.

42. The digital camera of claim 32 wherein the signal processing circuitry comprises a processor to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors with a first relative positioning of the first lens and the first array of photo detectors and (ii) data which is representative of the intensity of light sampled by the first array of photo detectors with a second relative positioning of the first lens and the first array of photo detectors.

43. The digital camera of claim 32 wherein the signal processing circuitry comprises signal processing circuitry to generate an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors with the first lens and the first array of photo detectors in a first relative positioning, (ii) data which is representative of the intensity of light sampled by the second array of photo detectors with the second lens and the second array of photo detectors in a second relative positioning, (iii) data which is representative of the intensity of light sampled by the first array of photo detectors with the first lens and the first array of photo detectors in a second relative positioning and (iv) data which is representative of the intensity of light sampled by the second array of photo detectors with the second lens and the second array of photo detectors in a second relative positioning.

44. The digital camera of claim 32 wherein the at least one actuator includes at least one actuator to receive at least one actuator control signal and in response thereto, to provide relative movement between the first array of photo detectors and the first lens and to provide relative movement between the second array of photo detectors and the second lens.

45. The digital camera of claim 32 wherein the signal processing circuitry is configured to receive at least one input signal indicative of a desired operating mode and to provide, in response at least thereto, at least one actuator control signal.

46. The digital camera of claim 45 wherein the at least one actuator includes at least one actuator to receive the at least one actuator control signal from the signal processing circuitry and in response at least thereto, to provide relative movement between the first array of photo detector and the first lens.

47. The digital camera of claim 32 wherein:

the first array of photo detectors sample an intensity of light of a first wavelength; and

the second array of photo detectors sample an intensity of light of a second wavelength different than the first wavelength.

48. The digital camera of claim 47 wherein:

the first lens passes light of the first wavelength onto an image plane of the photo detectors of the first array of photo detectors; and

the second lens passes light of the second wavelength onto an image plane of the photo detectors of the second array of photo detectors.

49. The digital camera of claim 48 wherein:

the first lens filters light of the second wavelength; and

the second lens filters light of the first wavelength.

50. The digital camera of claim 49 further comprising a frame including:

a first frame portion that defines a seat for the first lens; and

a second frame portion that defines a seat for the second lens.

51. The digital camera of claim 50 wherein:

the first frame portion blocks light from the second lens and defines a path to transmit light from the first lens; and

the second frame portion blocks light from the first lens and defines a path to transmit light from the second lens.

52. The digital camera of claim 51 wherein the at least one actuator includes:

at least one actuator coupled between the first frame portion and a third frame portion of the frame to provide movement of the first lens; and

at least one actuator coupled between the second frame portion and a fourth frame portion of the frame to provide movement of the second lens.

53. The digital camera of claim 50 further including an integrated circuit die that includes the first array of photo detectors and the second array of photo detectors.

54. The digital camera of claim 53 wherein the frame is disposed superjacent the integrated circuit die.

55. The digital camera of claim 54 wherein the frame is bonded to the integrated circuit die.

56. The digital camera of claim 55 further comprising a spacer disposed between the frame and the integrated circuit die, wherein the spacer is bonded to the integrated circuit die and the frame is bonded to the spacer.

57. The digital camera of claim 32 wherein the at least one actuator includes at least one MEMS actuator.

58. The digital camera of claim 32 further including a third array of photo detectors to sample the intensity of light of a third wavelength, and wherein the signal processing circuitry is coupled to the third array of photo detectors and generates an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, (ii) data which is representative of the intensity of light sampled by the second array of photo detectors, and/or (ii) data which is representative of the intensity of light sampled by the third array of photo detectors.

55-1. The digital camera of claim 32 wherein the at least one actuator includes at least one actuator that moves the first lens along a first axis.

56-2. The digital camera of claim 55 wherein the at least one actuator further includes at least one actuator that moves the first lens along a second axis different than the first axis.

59. A digital camera comprising:

a first array of photo detectors to sample an intensity of light; and

a second array of photo detectors to sample an intensity of light;

a first optics portion disposed in an optical path of the first array of photo detectors;

a second optics portion disposed in an optical path of the second array of photo detectors;

processor means, coupled to the first and second arrays of photo detectors, for generating an image using (i) data which is representative of the intensity of light sampled by the first array of photo detectors, and/or (ii) data which is representative of the intensity of light sampled by the second array of photo detectors; and

actuator means for providing relative movement between at least one portion of the first array of photo detectors and at least one portion of the first optics portion and for providing relative movement between at least one portion of the second array of photo detectors and at least one portion of the second optics portion.

60. A method for use in a digital camera, the method comprising:

providing a first array of photo detectors to sample an intensity of light;

providing a second array of photo detectors to sample an intensity of light;

providing a first optics portion disposed in an optical path of the first array of photo detectors;

providing a second optics portion disposed in an optical path of the second array of photo detectors;

providing relative movement between at least one portion of the first array of photo detectors and at least one portion of the first optics portion;

providing relative movement between at least one portion of the second array of photo detectors and at least one portion of the second optics portion; and

generating an image using (i) data representative of the intensity of light sampled by the first array of photo detectors, and/or (ii) data representative of the intensity of light sampled by the second array of photo detectors.

61. The method of claim 60 wherein providing relative movement includes moving the at least one portion of the first optics portion by an amount less than two times a width of one photo detector in the first array of photo detectors.

62. The method of claim 60 wherein providing relative movement includes moving the at least one portion of the first optics portion by an amount less than 1.5 times a width of one photo detector in the first array of photo detectors.

63. The method of claim 60 wherein providing relative movement includes moving the at least one portion of the first optics portion by an amount less than a width of one photo detector in the first array of photo detectors.