Methods and apparatus for capturing images using optical chains and/or for using captured images

• US 9,955,082 B2
• Filed: 01/30/2017
• Issued: 04/24/2018
• Est. Priority Date: 10/18/2013
• Status: Active Grant

• Current Assignee: Blue River Technology Inc. (Deere & Company)
• Original Assignee: Light Labs Inc.
• Inventors: Laroia, Rajiv
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US15/419,193
• Publication Number:
  US 20170208257A1
• Time in Patent Office: 449 Days
• Field of Search: 348335, 348345
• CPC Class Codes: G02B 13/001 Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras G02B23/243 takes precedence
• CPC Class Codes: G02B 13/0055 employing a special optical element
• CPC Class Codes: G02B 13/0065 having a beam-folding prism or mirror
• CPC Class Codes: G02B 13/009 having zoom function
• CPC Class Codes: G02B 13/02 Telephoto objectives, i.e. systems of the type + - in which the distance from the front vertex to the image plane is less than the equivalent focal length
• CPC Class Codes: G02B 15/00 Optical objectives with means for varying the magnification anamorphotic objectives G02B13/08
• CPC Class Codes: G02B 17/008 Systems specially adapted to form image relays or chained systems
• CPC Class Codes: G02B 17/0896 with variable magnification or multiple imaging planes, including multispectral systems systems with only refractive elements G02B15/14
• CPC Class Codes: G02B 27/1066 for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
• CPC Class Codes: G02B 3/0037 characterized by the distribution or form of lenses
• CPC Class Codes: G02B 5/005 Diaphragms for cameras G03B9/02
• CPC Class Codes: G02B 5/045 Prism arrays
• CPC Class Codes: G02B 5/08 Mirrors vehicle mirrors involving special optical features B60R1/08
• CPC Class Codes: G02B 7/282 Autofocusing of zoom lenses
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/6811 : based on the image signal
• CPC Class Codes: H04N 23/6812 : based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/685 : performed by mechanical compensation
• CPC Class Codes: H04N 23/689 : Motion occurring during a rolling shutter mode
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/73 : by influencing the exposure time
• CPC Class Codes: H04N 23/741 : by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 23/951 : by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/00 : Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/42 : by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
• CPC Class Codes: H04N 25/44 : by partially reading an SSIS array
• CPC Class Codes: H04N 25/70 : SSIS architectures; Circuits associated therewith
• CPC Class Codes: H04N 25/75 : Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/265 : Mixing
• CPC Class Codes: H04N 5/268 : Signal distribution or switching

Abstract

Methods and apparatus relating to image capture of image portions using optical chains with non-parallel optical axis are described. In some embodiments different portions of a scene area of interest captured by different optical chains operating in parallel are combined. The use of multiple optical chains in parallel facilitates generation of an image with a higher overall pixel count than would be possible using a single sensor of one of the optical chains and/or with more light capture than would be captured using a single one of the optical chains.

Claims

1. A method of capturing images, comprising:

capturing, using a first optical chain of a camera, a first image of a first portion of a scene area of interest, said first optical chain including a first mirror and a first sensor, an optical axis of the first optical chain between said first mirror and said first sensor being at a first angle relative to a bottom of said camera, said first optical chain having a first focal length;

capturing, using a second optical chain of said camera, a second image of a second portion of said scene area of interest, said second optical chain including a second mirror and a second sensor, an optical axis of the second camera chain between said second mirror and said second sensor being at the first angle relative to the bottom of said camera, said second optical chain having a second focal length which is smaller than said first focal length;

capturing, using a third optical chain of said camera, a third image, said third optical chain having the first focal length, said third optical chain including a third mirror and a third sensor, an optical axis of the third optical chain between said third mirror and said third sensor being at a second angle relative to the bottom of said camera, said second angle being different from the first angle; and

operating a fourth optical chain of the camera to capture a fourth image, said fourth optical chain having a third focal length which is smaller than said first and second focal lengths.

2. The method of claim 1, wherein the first mirror of the first optical chain is positioned closer to a first side of said camera than the second mirror of the second optical chain is positioned to the first side of said camera.

3. The method of claim 2, wherein said second optical chain is positioned adjacent and parallel to said first optical chain.

4. The method of claim 3, wherein at least a portion of said second optical chain is positioned above said first optical chain.

5. The method of claim 4, wherein said first and second optical chains are positioned in a first upper corner portion of said camera.

6. The method of claim 5, wherein said third optical chain is positioned in a second upper portion of said camera, said second upper portion being farther from said first side than said first upper corner portion is from said first side.

7. The method of claim 2, further comprising:

wherein said fourth optical chain is positioned at a distance from the first side of the camera which is greater than the distance between the first optical chain and said first side.

8. The method of claim 7, wherein said fourth optical chain is mounted between an optical chain in said camera having the first focal length and an optical chain in said camera having the second focal length.

9. The method of claim 8, further comprising:

operating a fifth optical chain of said camera to capture an image, said fifth optical chain having the first focal length and being positioned closer to the bottom of the camera than said first optical chain is positioned to the bottom of the camera.

10. The method of claim 9 further comprising:

generating a composite image from at least said first and second images.

11. A camera device, comprising:

a first camera module having a first focal length, the first camera module including a first mirror and a first sensor, an optical path of the first camera module between said first mirror and said first sensor being at a first angle relative to a bottom of said camera;

a second camera module having a second focal length which is smaller than said first focal length, the second camera module including a second mirror and a second sensor, an optical path of the second camera module between said second mirror and said second sensor being at said first angle relative to the bottom of said camera device; and

a third camera module having the first focal length, the third camera module including a third mirror and a third sensor, an optical path of the third camera module between said third mirror and said third sensor being at a second angle relative to the bottom of said camera device, said second angle being different from said first angle; and

a fourth camera module having a third focal length which is smaller than said first and second focal lengths.

12. The camera device of claim 11, wherein the first mirror of the first camera module is positioned closer to a first side of said camera device than the second mirror of the second camera module is positioned to the first side of said camera device.

13. The camera device of claim 12, wherein said second camera module is positioned adjacent and parallel to said first camera module.

14. The camera device of claim 13, wherein at least a portion of said second camera module is positioned above said first camera module.

15. The camera device of claim 14, wherein said first and second camera modules are positioned in a first upper corner portion of said camera device.

16. The camera device of claim 15, wherein said third camera module is positioned in a second upper portion of said camera device, said second upper portion being farther from said first side than said first upper corner portion is from said first side.

17. The camera device of claim 12, wherein said fourth camera module is positioned at a distance from the first side which is greater than the distance between the first camera module and said first side.

18. The camera device of claim 17, wherein said fourth camera module is mounted between a camera module in said camera device having the first focal length and a camera module in said camera device having the second focal length.

19. The camera device of claim 11, wherein said camera device is a handheld camera device.

20. The camera device of claim 19, wherein said camera device further includes:

a memory for storing images captured by said first, second and third camera modules; and

a processor configured to generate a composite image from images captured by said first, second and third camera modules.