Method of extracting a region of a specific configuration and determining copy conditions

• US 5,930,391 A
• Filed: 05/01/1998
• Issued: 07/27/1999
• Est. Priority Date: 09/13/1995
• Status: Expired due to Term

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Kinjo, Naoto
• Primary Examiner(s): Johns, Andrew W.
• Application Number:
  US09/070,767
• Time in Patent Office: 452 Days
• Field of Search: 382/173, 382/197, 382/199, 382/203, 382/316
• US Class Current: 382/173
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

A method of extracting an outer edge in an image comprises setting at least one or more search conditions to search for edges and searching for an initial starting as a reference point. From this reference point, it is determined whether one of the search conditions are satisfied within a particular range from the reference point. When the search condition is satisfied, the portion that satisfied the search condition is set as a next reference point. The reference points are connected in the order in which they were set as reference points to extract the outer edge. The search conditions may be set in a hierarchical order so that if one condition is not met, a different search condition may be used in the search for a subsequent reference point. The search conditions may comprise density or luminance characteristics, and may be further particularized to correspond to characteristics to extract the outer edge of a human face. As a further feature, the area corresponding to the extracted outer edge region is subject to appropriate processing depending on the characteristics of the extracted region.

Claims

1. In the extraction of a specific region of an image, a method of extracting a specific region comprising the steps of:

(a) setting, in accordance with characteristics of the specific region, at least one search condition for searching for portions corresponding to an outer edge of the specific region on the basis of a predetermined image characteristic amount;

(b) searching for portions assumed to correspond to the outer edge of the specific region, and setting one of the search portions as a reference point;

(c) searching for a portion which satisfies said at least one search condition and which exists within a predetermined search range in the image, said search range being based on the reference point, and in a case in which a portion which satisfies said at least one search condition and exists within the predetermined search range is detected, setting the detected portion as a next reference point; and

(d) extracting, as a line representing an outer edge of the specific region, a line which is formed by connecting a plurality of portions of the image in the order in which said portions were set as reference points.

2. A method of extracting a specific region according to claim 1, wherein said step (a) comprises:

determining a plurality of characteristic points on the outer edge of the specific region to be extracted to determine a first search condition as said at least one search condition; and

setting, for each section between characteristic points of the specific region, a second search condition for searching for portions corresponding to an outer edge between the characteristic points;

judging, for each set reference point determined in said step (c), whether the set reference point satisfied said first search condition or said second search condition with respect to a previous reference point; and

each time the set reference point is judged to, have satisfied said first search condition, setting the second search condition as a search condition used for searching for a next reference point.

3. A method of extracting a specific region according to claim 2, wherein in said step (a)

said first and second search conditions are set on the basis of respective different image characteristic amounts, and a respective priority is set for each one of the first and second search conditions;

and

wherein in a case in which no portion satisfying the search condition of the highest priority is detected in at least one of steps (b) and (c), searching for a portion which satisfies the search condition of the next highest priority is performed in at least one of steps (a) and (c); and

in a case in which a portion satisfying the search condition of said next highest priority is detected, the detected portion is set as a next reference point.

4. A method of extracting a specific region according to claim 3, wherein each of said first and second search conditions includes search conditions for searching for portions corresponding to the outer edge of the specific region on the basis of any of the amount of change in density or the amount of change in luminance at each portion, the direction of change in density or the direction of change in luminance at each portion, the density value or the luminance value at each portion, and the hue at each portion.

5. A method of extracting a specific region of claim 4, wherein said first search condition corresponds to characteristics of a person'"'"'s face and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

6. A method according to claim 5, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) using said second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

7. A method of extracting a specific region of claim 3 wherein said second search condition corresponds to characteristics of a person'"'"'s face, and said method, further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

8. A method according to claim 7, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) using said second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

9. A method of extracting a specific region according to claim 2, wherein each of first and second said search conditions includes search conditions for searching for portions corresponding to the outer edge of the specific region on the basis of any of the amount of change in density or the amount of change in luminance at each portion, the direction of change in density or the direction of change in luminance at each portion, the density value or the luminance value at each portion, and the hue at each portion.

10. A method of extracting a specific region of claim 9 wherein said first search condition corresponds to characteristics of a person'"'"'s face and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d) is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

11. A method according to claim 10, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) using said second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the same search condition.

12. A method of extracting a specific region of claim 2 wherein said first search condition corresponds to characteristics of a person'"'"'s face and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

13. A method according to claim 12, further comprising the steps of:

extracting a line representing an outer edge of second region from the image using steps (b)-(d) using the second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

14. A method of extracting a specific region according to claim 1,

wherein in said step (a), one of a plurality of search conditions for searching for portions corresponding to the outer edge of the specific region is set as the search condition on the basis of respectively different image characteristic amounts, and a respective priority for each of the plurality of search conditions is set;

and

wherein in a case in which no portion satisfying the search condition of the highest priority is detected in at least one of steps (b) and (c), searching for a portion which satisfies the search condition of the next highest priority is performed in at least one of steps (b) and (c); and

in a case in which a portion satisfying the search condition of said next highest priority is detected, the detected portion is set as a next reference point.

15. A method for extracting a specific region according to claim 14, wherein each of said plurality search conditions includes search conditions for searching for portions corresponding to the outer edge of the specific region on the basis of any of the amount of change in density or the amount of change in luminance at each portion, the direction of change in density or the direction of change in luminance at each portion, the density value or the luminance value at each portion, and the hue at each portion.

16. A method of extracting a specific region of claim 15 wherein at least one of said plurality of said search conditions corresponds to characteristics of a person'"'"'s face and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

17. A method according to claim 16, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) using a second one of said plurality of search conditions, said second search condition corresponding to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

18. A method of extracting a specific region of claim 14 wherein at least one of said plurality of search conditions corresponds to characteristics of a person'"'"'s face, and said method, further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

19. A method according to claim 18, further comprising the steps of:

extracting a line representing an outer edge of second region from the image using steps (b)-(d) using one of said plurality of search conditions as a second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

20. A method of extracting a specific region according to claim 11, wherein said search condition includes search conditions for searching for portions corresponding to the outer edge of the specific region on the basis of any of the amount of change in density or the amount of change in luminance at each portion, the direction of change in density or the direction of change in luminance at each portion, the density value or the luminance value at each portion, and the hue at each portion.

21. A method of extracting a specific region of claim 20 wherein said search condition corresponds to characteristics of a person'"'"'s face, and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained by said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

22. A method according to claim 21, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) using a second search condition corresponding to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

23. A method of extracting a specific region of claim 1 wherein said search condition corresponds to characteristics of a persons face and said method further comprises the steps of:

(e) judging whether a region of the image, which region is demarcated by the extracted line obtained in said extracting step (d), is a region corresponding to a person'"'"'s face; and

(f) determining copy conditions for copying the image onto a copy material, on the basis of an image characteristic amount in the region judged to be a region corresponding to a person'"'"'s face in said judging step (e).

24. A method according to claim 23, further comprising the steps of:

extracting a line representing an outer edge of a second region from the image using steps (b)-(d) and using the second search condition which corresponds to characteristics different than characteristics corresponding to a person'"'"'s face; and

wherein in said judging step (e), judging whether the region corresponds to a person'"'"'s face further takes into consideration the line extracted by using the second search condition.

25. A method of extracting a specific region according to claim 1, wherein said step (a) comprises:

determining a plurality of characteristic points on the outer edge of the specific region to be extracted; and

setting, for each section between characteristic points of the specific region, a search condition for searching for portions corresponding to an outer edge of the specific region at the section between the characteristic points in accordance with characteristics of a part of the specific region corresponding to the section between the characteristic points;

judging for each set reference point determined in said step (c), whether the set reference point corresponds to one of the plurality of characteristic points or corresponds to a point on a section between characteristic points; and

each time the set reference point is judged to correspond to a characteristic point, setting a search condition for searching for portions corresponding to the outer edge of the specific region at a section between a characteristic point corresponding to the set reference point and the next characteristic point on the outer edge of the specific region.