Display apparatus for generating a background image and control method thereof

• US 9,807,300 B2
• Filed: 11/02/2015
• Issued: 10/31/2017
• Est. Priority Date: 11/14/2014
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Han, Jeong-ho
• Primary Examiner(s): Hung, Yubin
• Application Number:
  US14/929,837
• Publication Number:
  US 20160155009A1
• Time in Patent Office: 729 Days
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06V 10/273 removing elements interfering with the pattern to be recognised
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 5/2222 Prompting
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A display apparatus is provided. The display apparatus includes a storage unit configured to, in response to a subject being captured, store a captured first image, an output unit configured to, in response to the first image being stored, output a guide message for guiding a subject so as to move out of a subject area of the first image, and a controller configured to, in response to the subject being moved and re-capturing being performed, acquire a re-captured second image, detect a local image area corresponding to the subject area of the first image from the second image, synthesize the detected local image area with the first image, generate a background image from which the subject is removed, and store the background image in the storage unit.

Claims

1. A control method of a display apparatus for generating a background image, the method comprising:

storing a captured first image of a subject;

detecting a subject area in the captured first image;

calculating a direction and distance in which the subject moves in order to get out of the subject area,

outputting a guide message for guiding the subject to move out of the subject area according to the calculated direction and distance;

re-capturing the subject after the subject has moved out of the subject area;

storing a second image including the re-captured subject after the subject has moved out of the subject area;

detecting a local image area corresponding to the subject area of the first image from the stored second image; and

synthesizing, by way of a processor of the display apparatus, the detected local image area with the stored first image to generate a background image from which the subject has been removed.

2. The method of claim 1, further comprising:

capturing the subject to acquire a third image; and

comparing the generated background image with the third image to separate a subject image from the third image and to display the subject image separated from the third image.

3. The method of claim 2, wherein the displaying of the subject image comprises synthesizing the subject image separated from the third image with a pre-stored background image to display the synthesized image comprising the subject image separated from the third image synthesized with the pre-stored background image.

4. The method of claim 2, wherein the detecting of the subject area comprises:

detecting a user face part in the first image; and

detecting a local area comprising the user face part as the subject area.

5. The method of claim 2, wherein the detecting of the subject area comprises:

capturing the subject sequentially a plurality of times to store a plurality of first images; and

comparing the plurality of first images to detect an area, from which a motion is sensed, as the subject area.

6. The method of claim 2, further comprising:

dividing the subject area into a plurality of sub areas; and

dividing the local image area of the second image into a plurality of sub local image areas respectively corresponding to the plurality of sub areas,

wherein the local image area is synthesized with the first image in units of at least one sub local image areas.

7. The method of claim 1, wherein the guide message is a graphical user interface (GUI) message displayed on a display unit displaying the first image to indicate the direction and the distance to which the subject is to move.

8. The method of claim 1, wherein the guide message is a voice message that guides a direction and distance to which the subject is to move.

9. The method of claim 1, wherein the subject area is detected by using a face tracking algorithm or by capturing a subject sequentially a plurality of times.

10. A computer program processed by a processor and stored on a non-transitory computer-readable to execute the method of claim 1.

11. A display apparatus for generating a background image comprising:

a storage to store a captured first image of a subject;

an output unit to output a guide message for guiding the subject to move out of a subject area of the first image; and

a processor configured to, acquire a re-captured second image of the subject after the subject has moved out of the subject area, detect a local image area corresponding to the subject area of the first image from the second image, and synthesize, by way of a processor of the display apparatus, the detected local image area with the first image to generate a background image from which the subject has been removed and to store the background image in the storage,

wherein the processor calculates a direction and distance in which the subject moves in order to get out of the subject area,

wherein the guide message is a message for guiding a direction and a distance to which the subject is to move according to the calculated direction and distance.

12. The display apparatus of claim 11, wherein the output unit comprises a display unit,

wherein the processor controls the display unit to capture the subject so as to acquire a third image, compare the background image with the third image, separate a subject image from the third image, and display the subject image separated from the third image.

13. The display apparatus of claim 12, wherein the processor controls the display unit to synthesize the subject image separated from the third image with a pre-stored background image and display the synthesized image comprising the subject image separated from the third image synthesized with the pre-stored background image.

14. The display apparatus of claim 12, wherein the processor detects a user face part in the first image and detects a local area comprising the user face part as a subject area.

15. The display apparatus of claim 12, wherein the storage unit captures the subject sequentially a plurality of times to store a plurality of first images,

wherein the processor compares the plurality of first images to detect an area, from which a motion is sensed, as a subject area.

16. The display apparatus of claim 12, wherein the processor detects a subject area comprising the subject in the first image, divides the subject area into a plurality of sub areas, divides the local image area detected from the second image into a plurality of local image areas respectively corresponding to the plurality of sub areas, and synthesizes at least one sub local image areas with the first image.

17. The display apparatus of claim 11, wherein the guide message is a GUI message displayed on the display unit displaying the first image to indicate a direction and a distance to which the subject is to move.

18. The display apparatus of claim 11, wherein the guide message is a voice message for guiding the direction and the distance to which the subject is to move.

19. An image capturing method comprising:

capturing a first image of a subject, using a camera, and detecting a subject area including the subject within the captured first image;

calculating a direction and distance in which the subject moves in order to get out of the subject area,

transmitting a signal from the camera to a mobile device, the signal including a command causing the mobile device to output a guide message to guide the subject to move out of the subject area of the first image according to the calculated direction and distance while staying within an area of the captured first image; and

capturing a second image of the subject, using the camera, after the subject has moved out of the subject area in accordance with the guide message.

20. The image capturing method of claim 19, wherein the guide message comprises at least one of a GUI message, displayed on a display screen of the mobile device, that indicates the direction and the distance in which the subject is to move, and a voice message, output through a speaker unit of the mobile device, that indicates the direction and the distance in which the subject is to move.