Lens arrays for pattern projection and imaging

• US 9,131,136 B2
• Filed: 12/06/2011
• Issued: 09/08/2015
• Est. Priority Date: 12/06/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Shpunt, Alexander, Pesach, Benny
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Kao, Yih-Sien
• Application Number:
  US13/311,584
• Publication Number:
  US 20120140109A1
• Time in Patent Office: 1,372 Days
• Field of Search: 348/36, 348/164, 348/169, 348/272, 348/273, 348/345
• US Class Current: 1/1
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method for imaging includes focusing optical radiation so as to form respective first and second optical images of a scene on different, respective first and second regions of an array of detector elements. The focused optical radiation is filtered with different, respective first and second passbands for the first and second regions. A difference is taken between respective first and second input signals provided by the detector elements in the first and second regions so as to generate an output signal indicative of the difference.

Claims

1. An imaging apparatus, comprising:

an image sensor, comprising an array of detector elements arranged in rows and columns;

objective optics, which are configured to focus optical radiation and are positioned so as to form respective first and second optical images of a scene on different, respective first and second regions of the array comprising respective first and second numbers of columns of the detector elements, such that the first number is greater than the second number, while the first and second regions have equal numbers of rows, so that the first region is wider than and has a different shape from the second region;

first and second optical filters, having different respective first and second passbands, which are positioned so as to filter the optical radiation focused by the first and second lenses onto the first and second regions, respectively; and

a subtracter, which is coupled to take a difference between respective first and second input signals provided by the detector elements in the first and second regions and to generate an output signal indicative of the difference.

2. The apparatus according to claim 1, wherein the objective optics are arranged so that the first and second optical images contain a common field of view.

3. The apparatus according to claim 1, wherein the objective optics comprise first and second lenses, which are configured to form the first and second optical images, respectively.

4. The apparatus according to claim 1, wherein the subtracter is configured to take the difference by subtracting digital pixel values from the first and second regions.

5. The apparatus according to claim 1, wherein the image sensor comprises an integrated circuit chip, and wherein the subtracter comprises an analog component on the chip.

6. The apparatus according to claim 1, and comprising a projection module, which is configured to project a pattern onto the scene at a wavelength in the first passband, while the optical radiation focused by the objective optics comprises ambient background radiation in both the first and second passbands, whereby the second input signal provides an indication of a level of the ambient background radiation for subtraction from the first input signal.

7. The apparatus according to claim 6, and comprising a processor, which is configured to process the output signal so as to generate a depth map of the scene responsively to the pattern appearing in the first optical image.

8. An imaging apparatus, comprising:

an image sensor, comprising an array of detector elements;

a plurality of lenses, which are configured to form respective optical images of different, respective portions of a scene on different, respective regions of the array along respective optical axes, wherein the lenses comprise at least;

a single first lens, which is configured to form a first optical image on a first region of the array of the detector elements along a first optical axis; and

a single second lens, which is configured to form a second optical image on a second region of the array of the detector elements along a second optical axis, which is different from the first optical axis; and

diverting elements, which are fixed to respective surfaces of at least two of the lenses and are configured to deflect the respective optical axes of the at least two of the lenses angularly outward in different, respective directions relative to a center of the image sensor, wherein the diverting elements comprise;

a first diverting element, which is fixed to the single first lens and is configured to deflect the first optical axis angularly outward in a first direction relative to a center of the image sensor so as to image a first field of view onto the first region; and

a second diverting element, which is fixed to the single second lens and is configured to deflect the second optical axis angularly outward in a different, second direction relative to the center of the image sensor so as to image a second field of view, different from the first field of view, onto the second region.

9. The apparatus according to claim 8, wherein the diverting elements comprise diffractive patterns that are fabricated on the respective surfaces of the at least two of the lenses.

10. The apparatus according to claim 9, wherein the diffractive patterns define Fresnel prisms.

11. The apparatus according to claim 8, wherein the apparatus comprises a processor, which is configured to process an output of the image sensor so as to generate an electronic image having a combined field of view encompassing the different, respective portions of the scene whose optical images are formed by the lenses.

12. The apparatus according to claim 11, and comprising a projection module, which is configured to project a pattern onto the scene, wherein the processor is configured to process the electronic image so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.

13. The apparatus according to claim 8, wherein the lenses comprise a third lens, which is configured to form a third optical image along a third optical axis on a third region of the array of detector elements, such that the third region is located between the first and second regions and the third optical axis is located between the first and second optical axes, and

wherein the third optical axis is undeflected, whereby the third lens images a third field of view, intermediate the first and second fields of view, onto the third region.

14. A method for imaging, comprising:

focusing optical radiation so as to form respective first and second optical images of a scene on different, respective first and second regions of an array of detector elements arranged in rows and columns,

wherein the first and second regions comprise respective first and second numbers of columns of the detector elements, such that the first number is greater than the second number, while the first and second regions have equal numbers of rows, so that the first region is wider than and has a different shape from the second region;

filtering the focused optical radiation with different, respective first and second passbands for the first and second regions; and

taking a difference between respective first and second input signals provided by the detector elements in the first and second regions so as to generate an output signal indicative of the difference.

15. The method according to claim 14, wherein focusing the optical radiation comprises forming the first and second optical images so as to contain a common field of view.

16. The method according to claim 14, wherein focusing the optical radiation comprises positioning first and second lenses to form the first and second optical images, respectively.

17. The method according to claim 14, wherein taking the difference comprises subtracting digital pixel values from the first and second regions.

18. The method according to claim 14, wherein the array of the detector elements is formed on an integrated circuit chip, and wherein taking the difference comprises subtracting the input signals using an analog component on the chip.

19. The method according to claim 14, and comprising projecting a pattern onto the scene at a wavelength in the first passband, while the optical radiation focused by the objective optics comprises ambient background radiation in both the first and second passbands, whereby the second input signal provides an indication of a level of the ambient background radiation for subtraction from the first input signal.

20. The method according to claim 19, and comprising processing the output signal so as to generate a depth map of the scene responsively to the pattern appearing in the first optical image.

21. A method for imaging, comprising:

positioning a plurality of lenses to form respective optical images of different, respective portions of a scene on different, respective regions of an array of detector elements along respective optical axes of the lenses, wherein the lenses comprise at least;

a single first lens, which is configured to form a first optical image on a first region of the array of the detector elements along a first optical axis; and

a single second lens, which is configured to form a second optical image on a second region of the array of the detector elements along a second optical axis, which is different from the first optical axis; and

fixing diverting elements to respective surfaces of at least two of the lenses so as to deflect the respective optical axes of the at least two of the lenses angularly outward in different, respective directions relative to a center of the array, wherein the diverting elements comprise;

a first diverting element, which is fixed to the single first lens and is configured to deflect the first optical axis angularly outward in a first direction relative to a center of the image sensor so as to image a first field of view onto the first region; and

a second diverting element, which is fixed to the single second lens and is configured to deflect the second optical axis angularly outward in a different, second direction relative to the center of the image sensor so as to image a second field of view, different from the first field of view, onto the second region.

22. The method according to claim 21, wherein fixing the diverting elements comprise fabricating diffractive patterns on the respective surfaces of the at least two of the lenses.

23. The method according to claim 22, wherein the diffractive patterns define Fresnel prisms.

24. The method according to claim 21, wherein the method comprises processing an output of the image sensor so as to generate an electronic image having a combined field of view encompassing the different, respective portions of the scene whose optical images are formed by the lenses.

25. The method according to claim 24, and comprising projecting a pattern onto the scene, and processing the electronic image so as to generate a depth map of the scene responsively to the pattern appearing in the optical images of the respective portions of the scene.