IMAGE INPAINTING APPARATUS AND METHOD USING RESTRICTED SEARCH REGION

• US 20110103706A1
• Filed: 10/29/2010
• Published: 05/05/2011
• Est. Priority Date: 10/29/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Hong, Tae-Hwa, Cho, Sung-Dae, JEONG, Young-Min
• Granted Patent: US 8,437,567 B2
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal

Abstract

Disclosed is an image inpainting apparatus and method using a restricted search region. The image inpainting apparatus sets a target image region to be inpainted in response to an image inpainting request, sets a surrounding image region, which has a preset size and includes the set target image region, sets a plurality of similar image regions by grouping similar pixels in the surrounding image region, divides the surrounding image region into the plurality of set similar image regions, divides the target image region according to the similar image regions, sets a search region of each divided target image region, and detects an image of an image region most similar to each divided target image region from the set search region of each divided target image region, thereby performing image inpainting. Accordingly, image inpainting is performed using a search region, which has been determined to include a similar image most similar to an image to inpaint, so that it is possible to increase the probability of searching for an image most similar to the inpainting image region.

Claims

1. An image inpainting apparatus using a restricted search region, the apparatus comprising:

a target region setup unit for setting a target image region to be inpainted in response to an image inpainting request;

a surrounding region setup unit for setting a surrounding image region which has a preset size and comprises the set target image region;

a similar region division unit for setting a plurality of similar image regions by grouping similar pixels in the set surrounding image region, and dividing the surrounding image region into the plurality of set similar image regions;

a search region setup unit for dividing the target image region according to the similar image regions, and setting a search region of each divided target image region; and

an inpainting processing unit for detecting an image of an image region most similar to each divided target image region from the set search region of each divided target image region, and copying and pasting the detected image into each corresponding target image region.

2. The apparatus as claimed in claim 1, wherein the similar region division unit calculates edge values of pixels included in the set surrounding image region, calculates difference values of the calculated edge values between the pixels, compares the calculated difference values with a preset threshold value, and groups the pixels according to a result of the comparison to set resultant pixel groups as the similar image regions.

3. The apparatus as claimed in claim 2, wherein, when a calculated difference value is greater than or equal to the threshold value as a result of the comparison, the similar region division unit groups a plurality of pixels having a difference value, which is less than the threshold value, among the calculated difference values, and sets the grouped pixels as a similar image region.

4. The apparatus as claimed in claim 3, wherein the search region setup unit estimates division regions, into which the target image region is to be divided, based on pixels located in a position at which the plurality of set similar image regions and the target image region meet each other, divides the target image region into the estimated division regions, and sets a similar image region adjacent to each divided target image region as a search region of said each divided target image region.

5. An image inpainting method using a restricted search region, the method comprising the steps of:

setting a target image region to be inpainted in response to an image inpainting request;

setting a surrounding image region which has a preset size and comprises the set target image region;

setting a plurality of similar image regions by grouping similar pixels in the set surrounding image region, and dividing the surrounding image region into the plurality of set similar image regions;

dividing the target image region according to the similar image regions, and setting a search region of each divided target image region; and

detecting an image of an image region most similar to each divided target image region from the set search region of each divided target image region, and copying and pasting the detected image into each corresponding target image region.

6. The method as claimed in claim 5, wherein dividing surrounding image region into the plurality of set similar image regions comprises:

calculating edge values of pixels included in the set surrounding image region and calculating difference values of the calculated edge values between the pixels;

comparing the calculated difference values with a preset threshold value; and

grouping the pixels according to a result of the comparison and setting resultant pixel groups as the similar image regions.

7. The method as claimed in claim 6, wherein grouping the pixels according to a result of the comparison and setting resultant pixel groups as the similar image regions comprises, when a calculated difference value is greater than or equal to the threshold value, grouping a plurality of pixels having a difference value, which is less than the threshold value, among the calculated difference values, and setting the grouped pixels as a similar image region.

8. The method as claimed in claim 7, wherein setting the search region comprises:

estimating division regions, into which the target image region is to be divided, based on pixels located in a position at which the plurality of set similar image regions and the target image region meet each other, and dividing the target image region into the estimated division regions; and

setting a similar image region adjacent to each divided target image region as a search region of the each divided target image region.

9. A computer-readable recording medium having recorded thereon a program for executing the method of claim 5.