IMAGE PROCESSING METHOD, IMAGE PROCESSING APPARATUS, PROGRAM AND IMAGE PROCESSING SYSTEM

• US 20100061637A1
• Filed: 08/31/2009
• Published: 03/11/2010
• Est. Priority Date: 09/05/2008
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mochizuki, Daisuke, Terayama, Akiko, Mori, Eijiro, Ikeda, Takuo, Noda, Takuro
• Application Number:
  US12/550,455
• Publication Number:
  US 20100061637A1
• Time in Patent Office: Days
• US Class Current: 382/199
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56

Abstract

An image processing apparatus includes a binarization unit that binarizes a selected image region based on prescribed criteria into an image trimming target white pixel region and a background black pixel region, a hole filling unit that fills a hole of the white pixel region by converting a black pixel surrounded by the white pixel region into the white pixel, a distance conversion unit that calculates a distance value from each white pixel to the black pixel region, a skeleton extraction unit that extracts points indicating a skeleton of the white pixel region according to each distance value, and a trimming outline determination unit that excludes a less significant point based on prescribed conditions, draws an oval or perfect circle according to each distance value, centered at a non-excluded point, and determines an outer edge of ovals or perfect circles as an outline for trimming a trimming target image.

Claims

1. An image processing method comprising the steps of:

performing distance conversion that calculates a distance value from a first pixel region on a trimming target side to a second pixel region on a background side of a binarized image;

performing skeleton extraction that extracts a plurality of points indicating a skeleton of the first pixel region according to the distance value of each first pixel; and

performing trimming outline determination that excludes a point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, draws an oval or a perfect circle according to the distance value of a pixel of each point, centered at a position of a non-excluded point, and determines an outer edge of a plurality of drawn ovals or perfect circles as an outline for trimming an image on the trimming target side.

2. The image processing method according to claim 1, wherein the step of performing trimming outline determination excludes a point, out of the plurality of extracted points, located inside an oval or a perfect circle already drawn, judging the point to be less significant.

3. The image processing method according to claim 1, wherein the step of performing trimming outline determination excludes a point, out of the plurality of extracted points, where the distance value of a pixel of each point is equal to or smaller than a given threshold, judging the point to be less significant.

4. The image processing method according to claim 1, wherein the step of performing trimming outline determination draws an oval or a perfect circle according to the distance value of a pixel of each point in a sequence of points, out of the plurality of extracted points, detected by scanning a selected image region sequentially from an upper left.

5. The image processing method according to claim 1, wherein the step of performing trimming outline determination draws a prescribed number of ovals or perfect circles according to the distance value in a sequence of points of pixels having a larger distance value, out of the plurality of extracted points.

6. The image processing method according to claim 1, further comprising the steps of:

performing binarization by binarizing an image region selected from an original image based on prescribed criteria into the first pixel region on the image trimming target side and the second pixel region on the background side; and

performing hole filling by filling a hole of the first pixel region by converting a second pixel surrounded by the first pixel region into a value of the first pixel,

wherein the step of performing distance conversion calculates a distance value from each first pixel of the first pixel region where the hole is filled by the step of performing hole filling to the second pixel region.

13. The image processing method according to claim 1, wherein a selected image region is extracted from an original image by using a technique of extracting an attention-getting region in an image based on prescribed criteria.

14. The image processing method according to claim 1, wherein data related to an outer edge of a plurality of ovals or perfect circles, or a polygon, determined as the outline for trimming the image is stored as vector data in a storage unit.

7. An image processing method comprising the steps of:

performing maximum image extraction that extracts a maximum region in the first pixel region on the trimming target side of the binarized image;

performing outline point extraction that extracts a plurality of outline points of the extracted maximum region in the first pixel region; and

performing trimming outline determination that excludes an outline point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, and determines a polygon connecting adjacent points of non-excluded outline points as an outline for trimming an image on the trimming target side.

8. The image processing method according to claim 7, wherein the step of performing trimming outline determination detects a polygon where an area of a polygon formed by three or more adjacent outline points, out of the plurality of extracted points, is smallest, and excludes an outline point located in middle of three or more outline points forming the detected polygon, judging the outline point to be less significant.

9. The image processing method according to claim 8, wherein the step of performing trimming outline determination assigns different weights to an area of a triangle formed by three or more adjacent outline points, out of the plurality of extracted points, depending on whether the triangle forms either one of a protrusion or a hollow of a polygon connecting adjacent points of the plurality of outline points, detects a triangle where an area after assigning weights is smallest, and excludes an outline point located in middle of three outline points forming the detected triangle, judging the outline point to be less significant.

10. The image processing method according to claim 7, wherein the step of performing trimming outline determination ends if the number of outline points becomes equal to or smaller than a prescribed number as a result of repeating excluding an outline point judged to be less significant.

11. The image processing method according to claim 7, further comprising the step of performing thinning-out that excludes every other or every plurality of outline points extracted by the step of performing outline point extraction,

wherein the step of performing trimming outline determination is executed on the outline points after the step of performing thinning-out.

12. The image processing method according to claim 7, further comprising the step of performing smoothing that smoothes the outline points extracted by the step of performing outline point extraction according to positions of adjacent points of each outline point,

wherein the step of performing trimming outline determination is executed on the outline points after the step of performing smoothing.

15. An image processing apparatus comprising:

a distance conversion unit that calculates a distance value from a first pixel region on a trimming target side to a second pixel region on a background side of a binarized image;

a skeleton extraction unit that extracts a plurality of points indicating a skeleton of the first pixel region according to the distance value of each first pixel; and

a trimming outline determination unit that excludes a point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, draws an oval or a perfect circle according to the distance value of a pixel of each point, centered at a position of a non-excluded point, and determines outer edge of a plurality of drawn ovals or perfect circles as an outline for trimming an image on the trimming target side.

16. A program causing a computer to implement a process comprising:

processing of calculating a distance value from a first pixel region on a trimming target side to a second pixel region on a background side of a binarized image;

processing of extracting a plurality of points indicating a skeleton of the first pixel region according to the distance value of each first pixel; and

processing of excluding a point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, drawing an oval or a perfect circle according to the distance value of a pixel of each point, centered at a position of a non-excluded point, and determining an outer edge of a plurality of drawn ovals or perfect circles as an outline for trimming an image on the trimming target side.

17. An image processing system comprising:

a distance conversion unit that calculates a distance value from a first pixel region on a trimming target side to a second pixel region on a background side of a binarized image;

a skeleton extraction unit that extracts a plurality of points indicating a skeleton of the first pixel region according to the distance value of each first pixel;

a first trimming outline determination unit that excludes a point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, draws an oval or a perfect circle according to the distance value of a pixel of each point, centered at a position of a non-excluded point, and determines an outer edge of a plurality of drawn ovals or perfect circles as an outline for trimming an image on the trimming target side;

a maximum image extraction unit that extracts a maximum region in the first pixel region on the trimming target side of the binarized image;

an outline point extraction unit that extracts a plurality of outline points of the extracted maximum region in the first pixel region;

a second trimming outline determination unit that excludes an outline point, out of the plurality of extracted points, judged to be less significant based on prescribed conditions, and determines a polygon connecting adjacent points of non-excluded outline points as an outline for trimming the image on the trimming target side; and

a selection unit that selects one of a first outline determined by the first trimming outline determination unit and a second outline determined by the second trimming outline determination unit.

18. The image processing system according to claim 17, wherein the selection unit selects one of the first outline and the second outline according to any one of conditions including:

making random selection;

making selection based on a ratio of a total area of the first outline and a total area of the second outline;

making selection based on at least one shape of the first outline and the second outline; and

making selection based on an error of a shape of the first outline and a shape of the second outline with respect to the first pixel region after binarization.