APPLICATION PROCESSOR FOR DISPARITY COMPENSATION BETWEEN IMAGES OF TWO CAMERAS IN DIGITAL PHOTOGRAPHING APPARATUS

• US 20200137372A1
• Filed: 12/23/2019
• Published: 04/30/2020
• Est. Priority Date: 06/23/2017
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: PARK, DONG JIN, Kang, Seok Jae, Lee, Jee Hong, Im, Joon Hyuk, Kim, Chae Sung
• Granted Patent: US 11,228,748 B2
• Time in Patent Office: Days
• CPC Class Codes: G01S 19/42 Determining position
• CPC Class Codes: G01S 19/53 Determining attitude
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A digital photographing device may include a plurality of cameras on a common side of the device, an application processor for switching image capture between the camera, and a display. The application processor may switch images output on the display when the cameras are switched. During the image transition, one or more virtual viewpoint images are output between a pre-transition image and a post-transition image. The virtual viewpoint images interpolate a disparity between the pre-transition image and the post-transition image caused by the different cameras being located at different positions, and result in a smooth visual transition. When a camera switching input includes a zoom factor signal, the virtual viewpoint images may be compensated images according to the input zoom factor and a disparity.

Claims

1. A digital photographing device comprising:

a telephoto camera having a first field of view disposed on a rear side surface of the digital photographing device;

a wide-angle camera having a second field of view disposed on the rear side surface of the digital photographing device; and

an application processor connected to the telephoto camera and the wide-angle camera, the application processor being configured to;

receive a first image from the wide-angle camera and display the first image on a display;

receive information related to a zoom factor;

receive a second image from the telephoto camera;

generate a synthesized image using the first image and the second image in response to the information;

display the synthesized image on the display according to the information when the zoom factor is less than a threshold value; and

display the second image on the display according to the information when the zoom factor is equal to the threshold value,

wherein the second field of view is greater than the first field of view.

2. The digital photographing device of claim 1, wherein the first image and the second image are captured substantially simultaneously.

3. The digital photographing device of claim 2, wherein an optical axis of the telephoto camera is parallel to an optical axis of the wide-angle camera.

4. The digital photographing device of claim 3, wherein the application processor generates a plurality of synthesized images and displays the plurality of synthesized images on the display.

5. The digital photographing device of claim 4, wherein the application processor is configured to perform a visual transition smoothly by continuously displaying the first image, the plurality of synthesized images, and the second image.

6. The digital photographing device of claim 4, wherein the telephoto camera has an N times enlarged version of the wide-angle camera and the N times enlarged version is the threshold value, and

wherein N is a positive number.

7. The digital photographing device of claim 6, wherein the wide-angle camera is configured to magnify the first image up to only the N times enlarged version by digital zooming.

8. The digital photographing device of claim 6, wherein the telephoto camera further comprises a first image signal processor (ISP) and the wide-angle camera further comprises a second ISP, and

wherein the first ISP and the second ISP perform image signal processing on the first image and the second image, respectively, before the plurality of synthesized images are generated.

9. A digital photographing device comprising:

a telephoto camera having a first field of view;

a wide-angle camera having a second field of view greater than the first field of view; and

an application processor configured to;

receive a telephoto image from the telephoto camera,

receive a wide-angle image from the wide-angle camera, and

generate a plurality of synthesized images using the telephoto image and the wide-angle image,

output the wide-angle image in a first zoom factor,

output the telephoto image in a second zoom factor greater than the first zoom factor, and

output the plurality of synthesized images in a third zoom factor between the first zoom factor and the second zoom factor.

10. The digital photographing device of claim 9, wherein the telephoto camera has an N times enlarged version of the wide-angle camera and the N times enlarged version is the second zoom factor, and

wherein N is a positive number.

11. The digital photographing device of claim 10, wherein the wide-angle camera is configured to magnify the wide-angle image up to only the N times enlarged version by digital zooming.

12. The digital photographing device of claim 9, wherein the first to third zoom factors are determined by a user input.

13. The digital photographing device of claim 12, wherein the application processor is configured to:

generate a control signal in response to the user input, and

output the wide-angle image, the plurality of synthesized images, and the telephoto image sequentially in response to the control signal.

14. The digital photographing device of claim 13, wherein the user input is a touch operation on a display.

15. The digital photographing device of claim 13, wherein the user input is a zooming operation.

16. The digital photographing device of claim 13, wherein the user input is a gaze.

17. A digital photographing device comprising:

a telephoto camera having a first field of view;

a wide-angle camera having a second field of view greater than the first field of view;

a display to display an image; and

an application processor configured to;

receive a telephoto image from the telephoto camera;

receive a wide-angle image from the wide-angle camera; and

switch a displayed image from the wide-angle image to the telephoto image while the wide-angle image is displayed in response to a touch input on a portion of the wide-angle image on the display,

wherein the telephoto camera captures a target region and outputs the target region as the telephoto image.

18. The digital photographing device of claim 17, wherein the application processor is configured to gradually magnify the target region.

19. The digital photographing device of claim 18, wherein the digital photographing device is an augmented reality system.