PHOTOGRAPHING DEVICE FOR PRODUCING COMPOSITE IMAGE AND METHOD USING THE SAME

• US 20140184841A1
• Filed: 12/19/2013
• Published: 07/03/2014
• Est. Priority Date: 12/28/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: WOO, Ji-Hwan, KIM, Se-Hoon, KWAK, Han-tak, SHIM, Woo-sung, LEE, Seo-young, LIM, Tae-gyu
• Granted Patent: US 9,357,117 B2
• Time in Patent Office: Days
• US Class Current: 348/218.1
• CPC Class Codes: H01L 27/14618 Containers
• CPC Class Codes: H04M 1/0264 for a camera module assembly
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A photographing device includes a photographing unit, an image processor which separates an object from a first photographing image obtained by the photographing unit, a display which displays a background live view obtained by superimposing the separated object on a live view of a background, and a controller which obtains a second photographing image corresponding to the live view of the background when a command to shoot the background is input and generates a composite image based on the separated object and the second photographing image.

Claims

1. A photographing device comprising:

a photographing unit;

an image processor which separates an object from a first photographing image obtained by the photographing unit;

a display which displays a background live view obtained by superimposing the separated object on a live view of a background; and

a controller which obtains a second photographing image corresponding to the live view of the background when a command to shoot the background is input, and generates a composite image based on the separated object and the second photographing image.

2. The photographing device as claimed in claim 1, wherein, when a composite shooting mode is selected, the controller controls the display to display a live view of the object and searches for and tracks the object by monitoring respective frames of the live view of the object, and

when a command to shoot the object is input, the controller generates the first photographing image corresponding to the live view of the object and controls the image processor to separate the tracked object from the first photographing image.

3. The photographing device as claimed in claim 2, wherein the photographing unit comprises:

a first photographing unit which captures a photograph in a first shooting direction; and

a second photographing unit which captures a photograph in a second shooting direction opposite to the first shooting direction, and

when the composite shooting mode is entered, the controller activates the first photographing unit to provide the live view of the object to the display, and when the first photographing image is obtained by the first photographing unit, the controller activates the second photographing unit to provide the live view of the background, on which the separated object is superimposed and provided to the display.

4. The photographing device as claimed in claim 1, further comprising:

a storage unit which stores a previously learned object model, the object model being obtained based on a plurality of images of the object to determine an object area in which the object is located,

wherein the controller determines that the object is located in the object area determined by the object model on the first photographing image.

5. The photographing device as claimed in claim 4, wherein the display displays the first photographing image, and

when a user'"'"'s manipulation for the first photographing image is performed, the controller changes at least one of a size and a shape of the object area according to the user'"'"'s manipulation.

6. The photographing device as claimed in claim 1, wherein the controller controls the image processor to restore a shape of the object separated from the first photographing image and superimposes and displays the object having the restored shape on the live view of the background.

7. The photographing device as claimed in claim 1, wherein the controller controls the image processor to adjust at least one of a display position, a size, a color and a brightness of the object on the background live view according to a user'"'"'s selection.

8. The photographing device as claimed in claim 1, wherein the controller adjusts at least one of a display position, a size, a color and a brightness of the separated object based on the live view of the background.

9. A method for producing a composite image, the method comprising:

obtaining a first photographing image and separating an object from the first photographing image;

displaying a background live view obtained by superimposing the object on a live view of a background;

obtaining a second photographing image corresponding to the live view of the background when a command to shoot a background is input; and

generating a composite image based on the separated object and the second photographing image.

10. The method as claimed in claim 9, wherein the separating the object comprises:

when a composite shooting mode is selected, displaying a live view of the object;

searching for and tracking the object by monitoring respective frames of the live view of the object, and

when a command to shoot the object is input, generating the first photographing image corresponding to the live view of the object; and

separating the tracked object from the first photographing image.

11. The method as claimed in claim 10, wherein the searching for and tracking the object comprises:

obtaining an object model based on a plurality of images of the object to determine an object area in which the object is located; and

determining that the object is located in the object area determined by the object model on the first photographing image.

12. The method as claimed in claim 11, wherein the separating the object comprises:

displaying the first photographing image; and

when a user'"'"'s manipulation for the first photographing image is performed, changing at least one of a size and a shape of the object area according to the user'"'"'s manipulation.

13. The method as claimed in claim 9, further comprising:

restoring a shape of the object separated from the first photographing image.

14. The method as claimed in claim 9, further comprising:

adjusting at least one of a display position, a size, a color and a brightness of the separated object on the background live view according to a user'"'"'s selection.

15. The method as claimed in claim 9, further comprising:

adjusting at least one of a display position, a size, a color and a brightness of the separated object based on the live view of the background.

22. A non-transitory computer readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 9.

16. An image processing apparatus comprising:

a first image input unit which receives a first image including an object;

a second image input unit which receives a second image different from the first image;

an object processing unit which separates the object from the first image; and

an image composing unit which superimposes the separated object on the second image to be provided as a preview image to a user and generates a composite image based on the separated object and the second image when the preview image is selected by the user.

17. The image processing apparatus as claimed in claim 16, wherein the first image and the second image are received simultaneously.

18. The image processing apparatus as claimed in claim 16, wherein the first image and the second image are received in a subsequent order.

19. The image processing apparatus as claimed in claim 16, wherein the object processing unit restores a shape of the object separated from the first image and the image composing unit generates the composite image based on the object having the restored shape and the second image.

20. The image processing apparatus as claimed in claim 16, wherein the object processing unit adjusts at least one of a display position, a size, a color and a brightness of the object on the preview image according to a user'"'"'s selection.

21. The image processing apparatus as claimed in claim 16, wherein the controller adjusts at least one of a display position, a size, a color and a brightness of the separated object based on the second image.