Digital photographing apparatus and method of operating the same

• US 10,291,842 B2
• Filed: 03/02/2016
• Issued: 05/14/2019
• Est. Priority Date: 06/23/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Jae-gon, Lim, Sang-hyeon, Jeon, Seung-ryong
• Primary Examiner(s): Philippe, Gims S
• Application Number:
  US15/058,319
• Publication Number:
  US 20160381289A1
• Time in Patent Office: 1,168 Days
• Field of Search: 3482181, 348169, 34823199, 396 89, 396125, 359698, 701 3
• CPC Class Codes: G06T 7/285 using a sequence of stereo image pairs
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A digital photographing apparatus includes: a first camera configured to acquire a wide-angle image including a main subject, a second camera configured to capture a telephoto image having the main subject zoomed in with respect to the wide-angle image; and a processor configured to acquire motion information of the main subject based on the wide-angle image and the telephoto image and configured to determine one of the wide-angle image and the telephoto image as a main image based on the motion information.

Claims

1. A digital photographing apparatus comprising:

a first camera configured to capture a wide-angle image comprising a main subject;

a second camera configured to capture a telephoto image having the main subject zoomed in with respect to the wide-angle image;

a display configured to display a main image, wherein the main image is one of the wide-angle image and the telephoto image; and

a processor configured to acquire motion information of the main subject based on the wide-angle image and the telephoto image, determine one of the wide-angle image and the telephoto image as the main image to be displayed on the display based on the motion information, and based on the main image being changed between the wide-angle image and the telephoto image, update the main image displayed on the display.

2. The digital photographing apparatus of claim 1, wherein the processor is configured to determine a velocity of the main subject based on the wide-angle image and the telephoto image and configured to determine the main image between the wide-angle image and the telephoto image based on the velocity of the main subject.

3. The digital photographing apparatus of claim 2, wherein the processor is configured to determine the wide-angle image being the main image, if the velocity of the main subject is greater than a predetermined speed.

4. The digital photographing apparatus of claim 2, wherein the processor is configured to determine the telephoto image being the main image, if the velocity of the main subject is less than a predetermined speed.

5. The digital photographing apparatus of claim 1, wherein the processor is configured to generate a depth map based on the wide-angle image and the telephoto image and configured to acquire the motion information of the main subject based on the depth map.

6. The digital photographing apparatus of claim 1, wherein the processor is configured to control the second camera to move to a position corresponding to a position of the main subject.

7. The digital photographing apparatus of claim 1 wherein the display is configured to display the main image as a live-view image.

8. The digital photographing apparatus of claim 7, wherein the display is configured to display a sub image corresponding to the other one of the wide-angle image and the telephoto image, the sub image overlapping with the main image on the display.

9. The digital photographing apparatus of claim 8, wherein the processor is configured to determine a position of the sub image on the display, based on the position of the main subject in the main image.

10. The digital photographing apparatus of claim 1, further comprising a memory configured to store the main image as video.

11. A method of operating a digital photographing apparatus comprising a first camera and a second camera, the method comprising:

capturing, by the first camera, a wide-angle image comprising a main subject;

capturing, by the second camera, a telephoto image having the main subject zoomed in with respect to the wide-angle image;

displaying, on a display, a main image, wherein the main image is one of the wide-angle image and the telephoto image;

acquiring motion information of the main subject based on the wide-angle image and the telephoto image;

determining one of the wide-angle image and the telephoto image as the main image to be displayed on the display, based on the motion information; and

based on the main image changed between the wide-angle image and the telephoto image, updating the main image displayed on the display.

12. The method of claim 11, further comprising:

determining a velocity of the main subject based on the wide-angle image and the telephoto image; and

determining the main image between the wide-angle image and the telephoto image based on the velocity of the main subject.

13. The method of claim 12, wherein the determining the main image comprises determining the wide-angle image being the main image, if the velocity of the main subject is greater than a predetermined speed.

14. The method of claim 12, wherein the determining the main image comprises determining the telephoto image being the main image, if the velocity of the main subject is less than a predetermined speed.

15. The method of claim 11, wherein the acquiring the motion information of the main subject comprises:

generating a depth map based on the wide-angle image and the telephoto image; and

acquiring the motion information of the main subject based on the depth map.

16. The method of claim 11, further comprising:

controlling the second camera to move to a position corresponding to a position of the main subject.

17. The method of claim 11, wherein the displaying comprises displaying the main image as a live-view image.

18. The method of claim 17, wherein the displaying the main image comprises displaying a sub image corresponding to the other one of the wide-angle image and the telephoto image, the sub image overlapping with the main image on a display.

19. The method of claim 18, wherein the displaying the sub image comprises determining a position of the sub image on the display, based on the position of the main subject in the main image.

20. The method of claim 11, further comprising:

storing the main image as video.

21. An image processing apparatus comprising:

a first camera configured to capture a first image including a subject;

a second camera configured to capture a second image including the subject, the first image having a wider field of view (FOV) than that of the second image;

a display configured to display a main image, wherein the main image is one of the first image and the second image; and

a processor configured to acquire motion information of the subject based on the first image and the second image, determine one of the first image and the second image as the main image to be displayed on the display based on the motion information, and based on the main image being changed between the first image and the second image, update the main image displayed on the display.

22. The image processing apparatus of claim 21, wherein the processor is configured to generate a depth map based on the first image and the second image and configured to acquire the motion information of the subject based on the depth map.

23. The image processing apparatus of claim 22, wherein the depth map comprises:

a first depth map generated at a first point in time; and

a second depth map generated at a second point in time, and

wherein the processor is configured to determine a first region of interest (ROI) having the subject at the first point in time and a second ROI having the subject at the second point in time from the depth map.

24. The image processing apparatus of claim 23, wherein the processor is configured to acquire the motion information based on comparison between the first ROI and the second ROI.

25. The image processing apparatus of claim 24, wherein the processor is configured to acquire the motion information based on at least one of comparison with respect to brightness of a pixel between the first and the second ROIs and comparison with respect to a size of the first ROI including the subject and a size of the second ROI including the subject.

26. The image processing apparatus of claim 21, wherein the processor is configured to determine the main image to be displayed amongst the first and the second images based on at least one of speed of the subject and a moving direction of the subject.

27. A method of operating an image processing apparatus comprising a first camera and a second camera, the method comprising:

capturing, by the first camera, a first image including a subject;

capturing, by the second camera, a second image including the subject, the first image having a wider field of view (FOV) than that of the second image;

displaying, on a display, a main image, wherein the main image is one of the first image and the second image;

acquiring motion information of the subject based on the first image and the second image;

determining one of the first image and the second image as the main image to be displayed on the display, based on the motion information; and

based on the main image changed between the first image and the second image, updating the main image displayed on the display.

28. The method of claim 27, wherein the acquiring the motion information comprises:

generating a depth map based on the first image and the second image; and

acquiring the motion information of the subject based on the depth map.

29. The method of claim 28, wherein the generating the depth map comprises:

generating a first depth map at a first point in time; and

generating a second depth map at a second point in time, and

wherein the acquiring the motion information comprises determining a first region of interest (ROI) having the subject at the first point in time and a second ROI having the subject at the second point in time.

30. The method of claim 29, wherein the acquiring the motion information comprises acquiring the motion information based on comparison between the first ROI and the second ROI.

31. The method of claim 30, wherein the acquiring the motion information comprises acquiring the motion information based on at least one of comparison with respect to brightness of a pixel between the first and the second ROIs and comparison with respect to a size of the first ROI including the subject and a size of the second ROI including the subject.

32. The method of claim 27, wherein the determining the main image to be displayed comprises determining the main image to be displayed amongst the first and the second images based on at least one of speed of the subject and a moving direction of the subject.