Dual aperture zoom camera with video support and switching / non-switching dynamic control

• US 10,356,332 B2
• Filed: 01/07/2019
• Issued: 07/16/2019
• Est. Priority Date: 08/13/2015
• Status: Active Grant

• Current Assignee: Corephotonics Ltd. (Samsung Group)
• Original Assignee: Corephotonics Ltd. (Samsung Group)
• Inventors: Cohen, Noy, Gigushinski, Oded, Geva, Nadav, Shabtay, Gal, Ashkenazi, Ester, Katz, Ruthy, Goldenberg, Ephraim
• Primary Examiner(s): Tran, Nhan T
• Application Number:
  US16/241,505
• Publication Number:
  US 20190158753A1
• Time in Patent Office: 190 Days
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A dual-aperture zoom digital camera operable in both still and video modes. The camera includes Wide and Tele imaging sections with respective lens/sensor combinations and image signal processors and a camera controller operatively coupled to the Wide and Tele imaging sections. The Wide and Tele imaging sections provide respective image data. The controller is configured to output, in a zoom-in operation between a lower zoom factor (ZF) value and a higher ZF value, a zoom video output image that includes only Wide image data or only Tele image data, depending on whether a no-switching criterion is fulfilled or not.

Claims

1. A dual-aperture zoom digital camera comprising:

a) a Wide imaging section that includes a fixed focal length Wide lens with a Wide field of view FOV_W and a Wide sensor, the Wide imaging section operative to provide Wide image data of an object or scene;

b) a Tele imaging section that includes a fixed focal length Tele lens with a Tele field of view FOV_T that is narrower than FOV_W and a Tele sensor, the Tele imaging section operative to provide Tele image data of the object or scene; and

c) a camera controller operatively coupled to the Wide and Tele imaging sections and configured to evaluate if a no-switching criterion is fulfilled or not fulfilled, wherein at a zoom factor (ZF) value greater than a zoom factor ZF_T=tangent (FOV_Wide)/tangent (FOV_Tele), if the no-switching criterion is fulfilled the camera controller is further configured to output a zoom video output image that includes only digitally-zoomed Wide image data, and if the no-switching criterion is not fulfilled, the camera controller is further configured to output a zoom video output image that includes only transformed, digitally zoomed Tele image data.

2. The camera of claim 1, wherein the ZF value expresses a maximal zoom Zmax.

3. The camera of claim 1, wherein the no-switching criterion includes a shift between the Wide and Tele images calculated by global registration, the shift being greater than a first threshold.

4. The camera of claim 1, wherein the no-switching criterion includes a disparity range calculated by global registration, the disparity range being greater than a second threshold.

5. The camera of claim 1, wherein the no-switching criterion includes an effective resolution of the Tele image being lower than an effective resolution of the Wide image.

6. The camera of claim 1, wherein the no-switching criterion includes a number of corresponding features in the Wide and Tele images being smaller than a third threshold.

7. The camera of claim 1, wherein the no-switching criterion includes a majority of objects imaged in an overlap area of the Wide and Tele images being calculated to be closer to the camera than a first threshold distance.

8. The camera of claim 1, wherein the no-switching criterion includes some objects imaged in an overlap area of the Wide and Tele images being calculated to be closer than a second threshold distance while other objects imaged in the overlap area of the Wide and Tele images being calculated to be farther than a third distance threshold.

9. The camera of claim 1, wherein the camera controller includes a user control module for receiving user inputs and a sensor control module for configuring each sensor to acquire the Wide and Tele image data based on the user inputs.

10. The camera of claim 9, wherein the user inputs include a zoom factor, a camera mode and a region of interest.

11. The camera of claim 1, wherein the Tele lens includes a ratio of total track length (TTL)/effective focal length (EFL) smaller than 1.

12. The camera of claim 1, wherein the camera controller is further configured to combine in still mode, at a predefined range of ZF values, at least some of the Wide and Tele image data to provide a fused output image of the object or scene from a particular point of view.

13. A method for obtaining zoom images of an object or scene using a dual-aperture zoom digital camera, comprising:

a) configuring a camera controller to evaluate if a no-switching criterion is fulfilled or not fulfilled;

b) if the no-switching criterion is fulfilled, configuring the camera controller to output at a zoom factor (ZF) higher than a zoom factor ZF_T=tangent (FOV_Wide)/tangent (FOV_Tele) a zoom video output image that includes only digitally-zoomed Wide image data; and

c) if the no-switching criterion is not fulfilled, configuring the camera controller to output a zoom video output image that includes only transformed, digitally zoomed Tele image data.

14. The method of claim 13, wherein the ZF value expresses a maximal zoom Zmax.

15. The method of claim 13, wherein the no-switching criterion includes a shift between the Wide and Tele images calculated by global registration, the shift being greater than a first threshold.

16. The method of claim 13, wherein the no-switching criterion includes a disparity range calculated by global registration, the disparity range being greater than a second threshold.

17. The method of claim 13, wherein the no-switching criterion includes an effective resolution of the Tele image being lower than an effective resolution of the Wide image.

18. The method of claim 13, wherein the no-switching criterion includes a number of corresponding features in the Wide and Tele images being smaller than a third threshold.

19. The method of claim 13, wherein the no-switching criterion includes a majority of objects imaged in an overlap area of the Wide and Tele images being calculated to be closer to the camera than a first threshold distance.

20. The method of claim 13, wherein the no-switching criterion includes some objects imaged in an overlap area of the Wide and Tele images being calculated to be closer than a second threshold distance while other objects imaged in the overlap area of the Wide and Tele images being calculated to be farther than a third threshold distance.

21. The method of claim 13, further comprising the step of configuring the camera controller to combine in still mode, at a predefined range of ZF values, at least some of the Wide and Tele image data to provide a fused output image of the object or scene from a particular point of view.

22. The method of claim 13, wherein the step of configuring the camera controller to combine in still mode, at a predefined range of ZF values, at least some of the Wide and Tele image data to provide a fused output image includes configuring the camera controller to combine Wide and Tele image data only in focused areas.