Methods and apparatus for use with multiple optical chains

• US 9,467,627 B2
• Filed: 10/26/2014
• Issued: 10/11/2016
• Est. Priority Date: 10/26/2013
• Status: Active Grant

• Current Assignee: Blue River Technology Inc. (Deere & Company)
• Original Assignee: The LightCo Inc.
• Inventors: Laroia, Rajiv
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): Garces-Rivera, Angel L
• Application Number:
  US14/523,918
• Publication Number:
  US 20150116547A1
• Time in Patent Office: 716 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G02B 13/009 having zoom function
• CPC Class Codes: G02B 15/04 by changing a part
• CPC Class Codes: G02B 26/007 the movable or deformable optical element controlling the colour, i.e. a spectral characteristic, of the light
• CPC Class Codes: G02B 27/0025 for optical correction, e.g. distorsion, aberration
• CPC Class Codes: G02B 5/005 Diaphragms for cameras G03B9/02
• CPC Class Codes: G02B 7/102 controlled by a microcomputer cameras with interchangeable lenses G03B17/14
• CPC Class Codes: G03B 3/10 Power-operated focusing
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.

Claims

1. A method of using multiple optical chains, the method comprising:

capturing images using a first group of optical chains and a second group of optical chains during a first time period, said first and second groups of optical chains having a first focal length during said first time period;

generating a first composite image from images captured during said first time period by said first group of optical chains and by said second group of optical chains;

transitioning said first group of optical chains from said first focal length to a second focal length during a second time period, said second focal length being different from said first focal length;

capturing images using said second group of optical chains during the second time period, optical chains in said second group of optical chains having a different focal length than optical chains in said first group during said second time period, optical chains in said second group of optical chains having said first focal length during said second time period; and

generating a second composite image from images captured during said second time period by said second group of optical chains.

2. The method of claim 1, wherein optical chains in the second group of optical chains have the first focal length during said first and second time periods;

and

wherein optical chains in said first group of optical chains change from said first focal length to a second focal length during said second time period.

3. The method of claim 2, further comprising:

switching from using said first and second groups of optical chains to using said second group of optical chains during said second period of time in response to a user zoom control input.

4. The method of claim 2, further comprising:

performing a digital zoom operation to support a user selected zoom setting corresponding to a focal length between said first and second focal lengths.

5. The method of claim 4, wherein said digital zoom is performed in response to a user selecting a zoom setting which corresponds to the zoom level which is between a first zoom level corresponding to said first focal length and a second zoom level corresponding to said second focal length.

6. The method of claim 2, wherein said first group of optical chains includes at least four different optical chains corresponding to the first focal length,

said first group of optical chains supporting changes in focal length in discrete amounts, said change from said first to said second focal length being a change by a discrete amount.

7. The method of claim 6, wherein said at least four different optical chains in said first group capture different portions of a scene area.

8. The method of claim 7, wherein said different portions of the scene area at least partially overlap.

9. The method of claim 2, further comprising:

transitioning the second group of optical chains from said first focal length to said second focal length during a third time period; and

generating a third composite image from images captured during said second time period by said first group of optical chains.

10. The method of claim 9, wherein said first, second and third time periods follow each other;

wherein said second composite image is generated without using image data captured by the first group of optical chains; and

wherein said third composite image is generated without using image data captured by the second group optical chains, the method further comprising;

generating a composite image from image data captured by both the first and second groups of optical chains during a fourth time period during which both said first and second groups of optical chains are at the second focal length.

11. The method of claim 2, wherein said change from the first focal length to said second focal length is a discrete change.

12. The method of claim 11, wherein the number of optical chains in said first group of optical chains is at least 3.

13. The method of claim 12, wherein the number of optical chains in said second group is at least three.

14. An image capture system comprising:

multiple optical chains, said multiple optical chains including at least a first group of optical chains and a second group of optical chains, optical chains in said first and second groups of optical chains both having a first focal length during a first time period, different focal lengths during a second time period, and both having a second focal length during an additional time period following said second period of time, said first and second focal lengths being different; and

a control device configured to control said multiple optical chains, said control of the multiple optical chains including;

controlling optical chains in said first and second groups of optical during the first time period to capture images;

controlling optical chains in said second group of optical chains during the second time period to capture images, said second time period being a time period in which the first group of optical chains transitions from the first focal length to a second focal length; and

an image processor configured to;

generate a first composite image from images captured during said first time period by said first and second groups of optical chains; and

generate a second composite image from images captured during said second time period by optical chains in said second group of optical chains, said second composite image being generated without using data from said first group of optical chains.

15. The image capture system of claim 14, wherein said multiple optical chains, control device and image processor are included in a camera.

16. The image capture system of claim 14, wherein said multiple optical chains and control device are included in a camera and said image processor is included in a device external to said camera.

17. The image capture system of claim 14, wherein optical chains in the first group of optical chains transition by a discrete amount from said first focal length to said second focal length during said second time period;

and

wherein optical chains in said second group of optical chains have the first focal length during said second time period.

18. The image capture system of claim 14, further comprising:

a user zoom control; and

wherein said control device is further configured to switch from using said first group of optical chains to using said second group of optical chains in response to a user zoom control setting.

19. The image capture system of claim 14, further comprising:

a zoom control module configured to control switching from using images captured by said second group of optical chains to said first group of optical chains in response to a user initiated zoom in operation used to indicate a user intent to capture an image corresponding to a smaller scene area using a higher zoom setting than was being used at a time a user zoom in control input was activated.

20. The image capture system of claim 14, wherein the image processor is configured to perform a digital zoom operation to support a user selected zoom setting corresponding to a focal length between said first and second focal lengths.

21. A non-transitory computer readable medium comprising machine executable instructions which when executed by a processor of a camera device control the camera device including multiple optical chains to perform the steps of:

capturing images using said first group of optical chains and a second group of optical chains during a first time period, said first and second groups of optical chains having a first focal length during said first time period;

generating a first composite image from images captured during said first time period by said first group of optical chains and by said second group of optical chains;

transitioning said first group of optical chains from said first focal length to a second focal length during a second time period, said second focal length being different from said first focal length;

capturing images using said second group of optical chains during the second time period, optical chains in said second group of optical chains having a different focal length than optical chains in said first group during said second time period, optical chains in said second group of optical chains having said first focal length during said second time period; and

generating a second composite image from images captured during said second time period by said second group of optical chains.