METHOD OF SYNTHESIZING IMAGES PHOTOGRAPHED BY PORTABLE TERMINAL, MACHINE-READABLE STORAGE MEDIUM, AND PORTABLE TERMINAL

• US 20140232743A1
• Filed: 02/20/2014
• Published: 08/21/2014
• Est. Priority Date: 02/21/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: NA, Jin-Hee, YOON, Young-Kwon, LEE, Ki-Huk
• Granted Patent: US 9,324,305 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability

Abstract

A system generates a synthesized image by combining content of a first image with content of a second image where both the first and second images are acquired by a portable terminal, The system identifies a portion of the second image, selects at least a part of the portion of the second image as a region of interest and generates a synthesized image by incorporating content of the first image in the region of interest. The method displays and stores the synthesized image.

Claims

1. A method of generating a synthesized image by combining content of a first image with content of a second image, the first and second images being acquired by a portable terminal, comprising:

identifying a portion of the second image;

selecting at least a part of the portion of the second image as a region of interest;

generating a synthesized image by incorporating content of the first image in the region of interest;

displaying the synthesized image; and

storing the synthesized image.

2. The method of claim 1, wherein the step of identifying a portion of a second image is performed in response to at least one of, texture information about the second image, learned information pre-stored in a database and information supporting identifying the region designated by a user.

3. The method of claim 1, wherein the selecting of the region of interest comprises:

displaying a plurality of candidate regions of interest corresponding to portions of the second image; and

selecting one of the plurality of candidate regions of the interest in response to an input.

4. The method of claim 3, wherein the first image is mapped to each of the plurality of regions of interest to be displayed.

5. The method of claim 1, wherein the portion of the second image corresponds to a region designated by a user in the second image and including the steps of:

transforming first image content by at least one of scaling, rotation and translation operations; and

incorporating transformed content of the first image into the region of interest.

6. The method of claim 1, further comprising changing the region of interest to another region of interest corresponding to another part of second image in response to input data.

7. The method of claim 1, further comprising modifying the region of interest in response to an input of a user.

8. The method of claim 1, further comprising:

detecting a change in the portion of the second image;

modifying the region of interest so as to correspond to the changed portion of the second image; and

mapping the first image to the modified region of interest and displaying the mapped image.

9. The method of claim 1, further comprising:

detecting a change in positions of corner characteristic points defining the portion of the second image;

modifying the region of interest so as to correspond to the position-changed corner characteristic points; and

mapping the first image to the modified region of interest and displaying the mapped image.

10. The method of claim 1, wherein the region of interest corresponds to one surface of a building or an object, and an area of the one surface is limited by corner characteristic points or edges.

11. The method of claim 1, wherein when the portion of the second image is identified, the first image is automatically mapped to the region of interest to be displayed.

12. The method of claim 1, wherein the first and second images are images acquired at substantially the same time.

13. A non-transitory machine-readable storage medium for recording a program for executing a method of generating a synthesized image by combining content of a first image with content of a second image, the first and second images being acquired by a portable terminal, comprising:

identifying a portion of a second image;

selecting at least a part of the portion of the second image as a region of interest;

generating a synthesized image by incorporating content of the first image in the region of interest;

displaying the synthesized image; and

storing the synthesized image.

14. A portable terminal, comprising:

a first camera that acquires a first image;

a second camera that acquires a second image;

a storage unit that stores the first and second images;

a display unit that displays the first and second images on a screen; and

a controller configured for,

identifying a portion of the second image;

selecting at least a part of the portion of the second image as a region of interest;

generating a synthesized image by incorporating content of the first image in the region of interest; and

storing the synthesized image.

15. The portable terminal of claim 14, wherein the region of interest corresponds to one surface of a building or a subject, and an area of the one surface is limited by corner characteristic points or edges.

16. The portable terminal of claim 14, wherein the controller is configured for:

displaying a plurality of candidate regions of interest corresponding to portions of the second image; and

selecting one of the plurality of candidate regions of interest in response to an input.

17. The portable terminal of claim 14, wherein the controller is configured for:

detecting a change in the portion of the second image;

modifying the region of interest so as to correspond to the changed portion of the second image; and

mapping the first image to the modified region of interest and displaying the mapped image.

18. The portable terminal of claim 14, wherein the controller is configured for changing the region of interest to another region of interest corresponding to another part of second image in response to input data.

19. A method of generating a synthesized image by combining content of a first image with content of a second image, the first and second images being acquired by a portable terminal, comprising:

identifying a portion of the second image;

selecting at least a part of the portion of the second image as a region of interest;

transforming first image content by at least one of scaling, rotation and translation operations;

generating a synthesized image by incorporating transformed content of the first image in the region of interest;

displaying the synthesized image; and

storing the synthesized image.

20. The method of claim 19, wherein the step of generating a synthesized image comprises combining transformed first image pixel luminance content into the portion of the second image by at least one of, image warping, texture mapping, addition, substitution, merging, overlay, superimposition and weighted combination of luminance pixel content to provide a combined image of the first and second image.