PHOTOGRAPHING APPARATUS AND METHOD FOR SYNTHESIZING IMAGES

• US 20140098259A1
• Filed: 09/25/2013
• Published: 04/10/2014
• Est. Priority Date: 10/09/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Song, Won-seok, Kang, Tae-hoon
• Granted Patent: US 9,413,922 B2
• Time in Patent Office: Days
• US Class Current: 348/231.6
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G11B 20/10 Digital recording or reproducing
• CPC Class Codes: H04N 1/2116 Picture signal recording combined with imagewise recording, e.g. photographic recording photographic cameras G03B19/00
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A photographing apparatus for synthesizing a plurality of continuously captured images is provided. The photographing apparatus includes a photographing unit that captures a plurality of images by continuously photographing an object; an input unit that receives a selection of a reference image from the plurality of captured images and a modification section in the reference image; a display unit that displays the reference image; a controller that, when the modification section is selected in the reference image and an image for replacing the modification section is determined, generates a mask image based on the modification section and generates a final image by synthesizing the reference image and the image for replacing the modification section using the mask image; and a storage unit that stores a data file including information of the mask image, the plurality of captured images, and the final image.

Claims

1. A photographing apparatus comprising:

a photographing unit that captures a plurality of images by continuously photographing an object;

an input unit that receives a selection of a reference image from the plurality of captured images and a modification section in the reference image;

a display unit that displays the reference image;

a controller that, when the modification section is selected in the reference image and an image for replacing the modification section is determined, generates a mask image based on the modification section and generates a final image by synthesizing the reference image and the image for replacing the modification section using the mask image; and

a storage unit that stores a data file comprising information of the mask image, the plurality of captured images, and the final image,

wherein the storage unit stores the plurality of captured images, the final image, and the data file in separate folders, and

when a modification request of the final image is received, the controller reads the data file from the storage unit to re-synthesize the reference image and the image for replacing the modification section.

2. The photographing apparatus of claim 1, wherein,

when the controller generates the mask image, the controller performs image synthesis at least once, in which the controller sequentially applies the mask image to other images of the plurality of captured images according to an input command through the input unit, separates an image section corresponding to the modification section in the other images, synthesizes the separated image section and the modification section of the reference image, and displays the synthesized image, and

when a storing command is received through the input unit, the controller determines that an image finally displayed is the final image and stores the final image in the storage unit.

3. The photographing apparatus of claim 2, wherein, when an undo command is received during the image synthesis or while editing the final image, the controller restores and displays a previously image, which is an image displayed before the image synthesis was performed, using the mask image information stored in the data file.

4. The photographing apparatus of claim 1, wherein, when the modification request is received, the controller sets the final image added to the data file as the reference image and provides an interface for selecting a modification section in the final image.

5. The photographing apparatus of claim 1, wherein the data file is divided into a header and a body, the body stores the plurality of captured images and the mask image, and the header stores information of the plurality of captured images and the mask image, and

when the final image is generated and added to the data file, the controller changes the information stored in the header.

6. The photographing apparatus of claim 5, wherein the mask image information comprises mask image feature information stored in the header of the mask image stored in the body, and

the mask image feature information comprises masking section location and size information of the mask image.

7. The photographing apparatus of claim 1, wherein the storage unit is a non-volatile memory.

8. An image synthesizing method comprising:

capturing a plurality of images by continuously photographing an object;

receiving a selection of a reference image from the plurality of captured images;

displaying the reference image;

when a modification section is selected in the reference image and an image for replacing the modification section is determined, generating a final image by synthesizing the reference image and the image for replacing the modification section using a mask image based on the modification section;

storing a data file comprising information of the mask image, the plurality of captured images, and the final image; and

when a modification request for the final image is received, reading the data file to re-synthesize the reference image and the image for replacing the modification section.

9. The image synthesizing method of claim 8, wherein the generating of the final image comprises:

when the modification section is selected in the reference image, generating a mask image based on the modification section;

performing image synthesis at least once by sequentially applying the mask image to other images of the plurality of captured images according to an input command, separating an image section corresponding to the modification section in the other images, synthesizing the separated image section and the modification section of the reference image, and displaying the synthesized image; and

when a storing command is received, determining that an image finally displayed is the final image.

10. The image synthesizing method of claim 9, further comprising:

when an undo command is received during the image synthesis or while editing the final image, restoring and displaying a previous image, which is an image displayed before the image synthesis was performed, using the mask image information stored in the data file.

11. The image synthesizing method of claim 8, further comprising:

when the modification request is received, setting the final image added to the data file as the reference image and providing an interface for selecting a modification section in the final image.

12. The image synthesizing method of claim 8, wherein the data file is divided into a header and a body, the body stores the plurality of captured images and the mask image, and the header stores information of the plurality of captured images and the mask image, and

when the final image is generated and added to the data file, changing the information stored in the header.

13. The image synthesizing method of claim 12, wherein the mask image information comprises mask image feature information stored in the header of the mask image stored in the body, and

the mask image feature information comprises masking section location and size information of the mask image.

14. The image synthesizing method of claim 8, wherein the data file is stored in a non-volatile memory.