Image overlay compositing

• US 9,478,054 B1
• Filed: 11/09/2013
• Issued: 10/25/2016
• Est. Priority Date: 11/09/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lewis, Justin, James, Gavin
• Primary Examiner(s): WANG, JIN CHENG
• Application Number:
  US14/076,199
• Time in Patent Office: 1,081 Days
• Field of Search: 345/629, 345/605, 382/218, 382/274, 382/275, 382/284, 382/294, 348/218.1
• US Class Current: 1/1
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/20172 Image enhancement details
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/30 Control of display attribute
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Implementations generally relate to image overlay compositing. In some implementations, a method includes receiving a first image and a second image. The method further includes determining one or more attributes of each of the first image and the second image, where the one or more attributes includes one or more image types. The method further includes determining one or more compositing techniques combine the first image and the second image based on one or more of the attributes.

Claims

1. A method comprising:

receiving a first image and a second image;

determining one or more attributes of the first image and the second image, wherein the one or more attributes include at least one of the following attributes;

an image type, image size, a face content, a body content, a texture, a lighting characteristic, a color characteristic, and a border characteristic; and

selecting one or more of a gradient domain blending technique, an alpha blending technique, and a tone mapping technique to combine the first image and the second image based on the one or more attributes, wherein

selection of an alpha blending technique is based on at least one of the following first conditions;

at least one of the first image and the second image includes a cartoon, a complex boundary of at least one of the first image and the second image, time available, and memory available, and

selection of at least one of a gradient domain blending technique and a tone mapping technique is based on at least one of the following second conditions;

at least one of the first image and the second image includes a body or a face, the first image has color characteristics similar to color characteristics of the second image, the first image has lighting that is different than lighting of the second image, a smooth boundary of the first image and the second image, differences between a foreground and a background of the first image or the second image, a large size of at least one of the first image and the second image, and the first image has a texture that is different than a texture of the second image.

2. The method of claim 1, wherein selecting one or more of the gradient domain blending technique, the alpha blending technique, and the tone mapping technique comprises eliminating one or more compositing techniques.

3. The method of claim 1, wherein the method further comprises enabling a user to drag the first image onto the second image to indicate that the first image is to be combined with the second image.

4. The method of claim 1, wherein selecting one or more of the gradient domain blending technique, the alpha blending technique, and the tone mapping technique is based on a voting scheme.

5. The method of claim 1, wherein the method further comprises receiving a selection of one or more elements of the first image drug onto the second image, wherein the selected one or more elements are to be combined with the second image.

6. A non-transitory computer readable storage medium including instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving a first image and a second image;

selecting at least one of an alpha blending technique, a gradient domain blending technique and a tone mapping technique to combine the first image and the second image, wherein

selection of an alpha blending technique is based on at least one of the following first conditions;

at least one of the first image and the second image includes a cartoon, a complex boundary of at least one of the first image and the second image, time available, and memory available, and

selection of at least one of a gradient domain blending technique and a tone mapping technique is based on at least one of the following second conditions;

at least one of the first image and the second image includes a body or a face, the first image has color characteristics similar to color characteristics of the second image, the first image has lighting that is different than lighting of the second image, a smooth boundary of the first image and the second image, differences between a foreground and a background of the first image or the second image, a large size of at least one of the first image and the second image, and the first image has a texture that is different than a texture of the second image.

7. The non-transitory computer readable storage medium of claim 6, wherein selecting at least one of the alpha blending technique, the gradient domain blending technique and the tone mapping technique comprises eliminating one or more compositing techniques.

8. The non-transitory computer readable storage medium of claim 6, further comprises enabling a user to drag the first image onto the second image to indicate that the first image is to be combined with the second image.

9. The non-transitory computer readable storage medium of claim 6, wherein selecting at least one of the alpha blending technique, the gradient domain blending technique and the tone mapping technique is based on a voting scheme.

10. The non-transitory computer readable storage medium of claim 6, wherein at least one of the first image and the second image is a video.

11. The non-transitory computer readable storage medium of claim 6, wherein at least one of the first image and the second image includes an animated element.

12. A system comprising:

one or more processors; and

logic encoded in one or more tangible media for execution by the one or more processors and when executed operable to perform operations comprising;

receiving a first image and a second image; and

determining one or more attributes of the first image and the second image, wherein the one or more attributes include at least one of the following attributes;

image type, texture, lighting characteristics, and border characteristics; and

selecting at least one of an alpha blending technique, a gradient domain blending technique and a tone mapping technique to combine the first image and the second image based on one or more of the attributes, wherein

selection of an alpha blending technique is based on at least one of the following first conditions;

at least one of the first image and the second image includes a cartoon, a complex boundary of at least one of the first image and the second image, time available, and memory available, and

selection of at least one of a gradient domain blending technique and a tone mapping technique is based on at least one of the following second conditions;

at least one of the first image and the second image includes a body or a face, the first image has color characteristics similar to color characteristics of the second image, the first image has lighting that is different than lighting of the second image, a smooth boundary of the first image and the second image, differences between a foreground and a background of the first image or the second image, a large size of at least one of the first image and the second image, and the first image has a texture that is different than a texture of the second image; and

combining the first image and second image using the selected at least one of the alpha blending technique, the gradient domain blending technique and the tone mapping technique.

13. The system of claim 12, wherein, to select at least one of the alpha blending technique, the gradient domain blending technique and the tone mapping technique, the logic when executed is further operable to perform operations comprising eliminating one or more compositing techniques.

14. The system of claim 12, wherein the logic when executed is further operable to perform operations comprising enabling a user to drag the first image onto the second image to indicate that the first image is to be combined with the second image.

15. The system of claim 12, wherein selecting at least one of the alpha blending technique, the gradient domain blending technique and the tone mapping technique is based on a voting scheme.

16. The system of claim 12, at least one of the first image and the second image includes an animated element.

17. The system of claim 12, wherein the logic when executed is further operable to perform operations comprising receiving a selection of one or more elements of the first image drug onto the second image, wherein the selected one or more elements are to be combined with the second image.