Method for Sliced Inpainting

• US 20080170807A1
• Filed: 11/27/2007
• Published: 07/17/2008
• Est. Priority Date: 11/27/2006
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Nik Software, Inc. (Alphabet Inc.)
• Inventors: KOKEMOHR, Nils
• Granted Patent: US 9,053,530 B2
• Time in Patent Office: Days
• US Class Current: 382/294
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 5/005 Retouching; Inpainting; Scratch removal detecting, correction, reducing or removing defects, e.g. non-responsive pixels of solid state image sensors H04N25/68, scratch removal for cinematographic films scanned by electronic image sensor H04N5/253
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

A method for replacing image data in a destination region that is divided into sub-pieces along one or more cutting paths, which start and end at two different points on the border, and finding replacement data for the sub-pieces. The cutting paths may be determined as a function of the type of image structured at the start and the end points. The cutting paths may also be determined as a function of the area of the sub-pieces and the lengths of the cutting paths. Optionally, the destination region may be determined by a spot detection algorithm. Further optionally, the spot detection algorithm may comprise calculation of a high pass filter, or detection of areas of luminosity and border-to-volume ratios. A method for moving an image element within an image is also provided.

Claims

1. A method for replacing image data in a destination region having a border, comprising:

dividing the destination region into sub-pieces along one or more cutting paths, the cutting paths starting and ending at two different points on the border of the destination region; and

finding replacement data for the sub-pieces.

2. The method of claim 1, where the cutting paths are determined as a function of the type of image structured at the start and the end point of the cutting path.

3. The method of claim 1, where the cutting paths are determined as a function of the area of the sub-pieces and the lengths of the cutting paths.

4. The method of claim 1, where the destination region is the product of a rotation, a perspective correction, a lens distortion correction, or a creative image distortion.

5. The method of claim 1, where the destination region is determined by a spot detection algorithm.

6. The method of claim 5, where the spot detection algorithm comprises calculation of a high pass filter.

7. The method of claim 5, where the spot detection algorithm comprises detection of areas of luminosity and border-to-volume ratios.

12. A computer readable medium is provided having contents for causing a computer-based information handling system to perform the steps of the method of claim 1.

8. A method for moving an image element within an image, comprising:

receiving the boundary of a source region comprising the image element;

receiving a destination region within the image;

copying image data from the source region to the destination region;

determining a residual region, comprising area of the source region that does not intersect with the destination region; and

applying an inpainting routine to the residual region.

9. The method of claim 8, where before the applying step, the residual region is divided into sub-pieces.

10. The method of claim 8, where the copying step comprises an adaption method.

11. The method of claim 10, where the source and destination regions have margins, and the adaption method is based upon differences between pixel values of the margin of the source region and the margin of the destination region.

13. A computer readable medium is provided having contents for causing a computer-based information handling system to perform the steps of the method of claim 8.