Structure-Preserving Clone Brush

• US 20120236019A1
• Filed: 04/12/2012
• Published: 09/20/2012
• Est. Priority Date: 04/30/2003
• Status: Active Grant

• Current Assignee: EveryScape Incorporated
• Original Assignee: EveryScape Incorporated
• Inventors: Oh, Byong Mok, Durand, Fredo
• Granted Patent: US 8,379,049 B2
• Time in Patent Office: Days
• US Class Current: 345/589
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

The invention provides tools and techniques for clone brushing pixels in an image while accounting for inconsistencies in apparent depth and orientation within the image. The techniques do not require any depth information to be present in the image, and the data structure of the image is preserved. The techniques allow for color compensation between source and destination regions. A snapping technique is also provided to facilitate increased accuracy in selecting source and destination positions.

Claims

1-20. -20. (canceled)

21. A method for clone-brushing in a 2D image comprising a) specifying a first world plane in the 2D image;

b) providing a source position and a destination position in the 2D image;

c) identifying a destination region in the 2D image relative to the destination position;

d) determining a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position;

e) transforming 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image relative to the first world plane in the destination region is maintained; and

f) copying the transformed 2D image information to the destination region.

22. The method of claim 21, wherein specifying a first world plane in the 2D image comprises specifying two sets of parallel lines.

23. The method of claim 21, wherein transforming 2D image information of the source region further comprises a bilinear interpolation of 2D image information in the source region relative to the first world plane.

24. The method of claim 21 further comprising:

providing a first color sample region for the source region;

providing a second sample color region for the destination region; and

computing a color ratio between the second color sample region and the first color sample region, wherein transforming 2D image information of the source region relative to the first world plane further comprises applying the color ratio to the 2D image information of the source region.

25. The method of claim 24, wherein the color ratio is computed using Gaussian weighted averages of the first and second sample color regions.

26. The method of claim 24, wherein the first color sample region is provided with respect to the first world plane.

27. A computer program product for clone-brushing in a 2D image, the computer program product comprising a non-transitory computer readable medium having computer readable program code stored thereon, the computer readable program code including program code for:

a) specifying a first world plane in the 2D image;

b) providing a source position and a destination position in the 2D image;

c) identifying a destination region in the 2D image relative to the destination position;

d) determining a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position;

e) transforming 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image in the destination region relative to the first world plane is maintained; and

f) copying the transformed 2D image information to the destination region.

28. The computer program product of claim 27, wherein specifying a first world plane in the 2D image comprises specifying two sets of parallel lines.

29. The computer program product of claim 27, wherein transforming 2D image information of the source region further comprises a bilinear interpolation of 2D image information in the source region relative to the first world plane.

30. The computer program product of claim 27 further comprising program code for:

providing a first color sample region for the source region;

providing a second sample color region for the destination region; and

computing a color ratio between the second color sample region and the first color sample region, wherein transforming 2D image information of the source region relative to the first world plane further comprises applying the color ratio to the 2D image information of the source region.

31. The computer program product of claim 30, wherein the color ratio is computed using Gaussian weighted averages of the first and second sample color regions.

32. The computer program product of claim 30, wherein the first color sample region is provided with respect to the first world plane.

33. A system for editing a 2D image, the system comprising:

a computer comprising a processor, memory, and a display, the memory containing instructions that, when executed by the processor, cause the computer to;

receive an input 2D image;

interact with a user to specify a first world plane in the 2D image;

interact with a user to provide a source position and a destination position in the 2D image;

interact with a user to identifying a destination region in the 2D image relative to the destination position;

determine a source region in the 2D image relative to the first world plane and corresponding to the destination region, using the source position and the destination position;

transform 2D image information of the source region to 2D image information of the destination region such that the perspective of the 2D image relative to the first world plane in the destination region is maintained; and

copy the transformed 2D image information to the destination region.

34. The system of claim 33, wherein the instructions, when executed by the processor, further cause the computer to interact with the user to specify a world plane by drawing two sets of parallel lines.

35. The system of claim 33, wherein the instructions, when executed by the processor, further cause the computer to interact with the user to:

provide a first color sample region for the source region;

provide a second sample color region for the destination region; and

compute a color ratio between the second color sample region and the first color sample region, wherein the color ratio is applied to the 2D image information of the source region when the 2D information of the source region is transformed to 2D image information of the destination region.