Patch-based synthesis techniques using color and color gradient voting
First Claim
1. A method, comprising:
- synthesizing, by one or more computing devices, a region in a target image from image data obtained from one or more source images, the synthesizing comprising;
identifying a target patch in the target image to be synthesized;
identifying one or more source patches in the one or more source images as corresponding to the target patch;
applying one or more transformations to each of the source patches;
comparing each of the transformed source patches to the target patch and selecting one of the transformed source patches as best matching the target patch based on one or more criteria, the one or more criteria comprising at least color gradient information determined from the transformed source patches;
andblending the selected transformed source patch into the target image using a voting technique that averages color and color gradient values from the transformed source patch to produce a final image.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer-readable storage media for patch-based image synthesis using color and color gradient voting. A patch matching technique provides an extended patch search space that encompasses geometric and photometric transformations, as well as color and color gradient domain features. The photometric transformations may include gain and bias. The patch-based image synthesis techniques may also integrate image color and color gradients into the patch representation and replace conventional color averaging with a technique that performs voting for colors and color gradients and then solves a screened Poisson equation based on values for colors and color gradients when blending patch(es) with a target image.
-
Citations
20 Claims
-
1. A method, comprising:
synthesizing, by one or more computing devices, a region in a target image from image data obtained from one or more source images, the synthesizing comprising; identifying a target patch in the target image to be synthesized; identifying one or more source patches in the one or more source images as corresponding to the target patch; applying one or more transformations to each of the source patches; comparing each of the transformed source patches to the target patch and selecting one of the transformed source patches as best matching the target patch based on one or more criteria, the one or more criteria comprising at least color gradient information determined from the transformed source patches; and blending the selected transformed source patch into the target image using a voting technique that averages color and color gradient values from the transformed source patch to produce a final image. - View Dependent Claims (2, 3, 4, 5, 6, 18)
-
7. A system, comprising:
-
at least one processor; and a memory comprising program instructions, the program instructions executable by the at least one processor to synthesize a region in a target image from image data obtained from one or more source images, the synthesizing comprising; identifying a target patch in the target image to be synthesized; identifying one or more source patches in the one or more source images that best match the target patch; applying one or more transformations to each of the source patches; comparing each of the transformed source patches to the target patch and selecting one of the transformed source patches as best matching the target patch based on one or more criteria, the one or more criteria comprising at least color gradient information; and blending the selected transformed source patch into the target image using a voting technique that averages color and color gradient values from the transformed source patch to produce a final image. - View Dependent Claims (8, 9, 10, 11, 19)
-
-
12. A non-transitory computer-readable storage medium storing program instructions, the program instructions computer-executable to implement operations comprising synthesizing a target region in a target image by performing operations comprising:
-
identifying a target patch in the target image to be synthesized; identifying one or more source patches in the one or more source images that best match the target patch; applying one or more transformations to each of the source patches; comparing each of the transformed source patches to the target patch and selecting one of the transformed source patches as best matching the target patch based on one or more criteria, the one or more criteria comprising at least color gradient information; and blending the selected transformed source patch into the target image using a voting technique that averages color and color gradient values from the transformed source patch to produce a final image. - View Dependent Claims (13, 14, 15, 16, 17, 20)
-
Specification