System for detecting skin-tone regions within an image

• US 6,148,092 A
• Filed: 01/08/1998
• Issued: 11/14/2000
• Est. Priority Date: 01/08/1998
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Qian, Richard
• Primary Examiner(s): Bella, Matthew C.
• Assistant Examiner(s): CHAWAN, SHEELA C
• Application Number:
  US09/004,539
• Time in Patent Office: 1,041 Days
• Field of Search: 382/103, 382/118, 382/156, 382/164, 382/190, 382/193, 382/209, 382/274, 382/276, 382/282, 382/283
• US Class Current: 382/118
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 40/162 using pixel segmentation or colour matching

Abstract

A system detects a face within an image by receiving the image which includes a plurality of pixels, where a plurality of the pixels of the image is represented by respective groups of at least three values. The image is filtered by transforming a plurality of the respective groups of the at least three values to respective groups of less than three values, where the respective groups of the less than three values has less dependency on brightness than the respective groups of the at least three values. Regions of the image representative of skin-tones are determined based on the filtering. A first distribution of the regions of the image representative of the skin-tones in a first direction is calculated. A second distribution of the regions of the image representative of the skin-tones in a second direction is calculated, where the first direction and the second direction are different. The face within the image is located based on the first distribution and the second distribution. The estimated face location may also be used for tracking the face between frames of a video.

Claims

1. A method of detecting a skin-tone region within an image comprising the steps of;

(a) receiving said image including a plurality of pixels of said image is represented by respective groups of at least three values, said values are in a first color space;

(b) filtering said image by transforming a plurality of said respective groups of said at least three values in said first color space to respective groups of less than three values in a second color space, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values;

(c) determining regions of said image in said second color space representative of skin-tones based on said filtering of step (b);

(d) calculating a first distribution of said regions of said image in a color space different than said second color space representative of said skin-tones in a first direction;

(e) calculating a second distribution of said regions of said image in said different color space of step (d) representative of said skin-ton in a second direction, where said first direction and said second direction are different; and

(f) locating said skin-tone region within said image based on said first distribution and said second distribution.

2. The method of claim 1 where said image includes from a video containing multiple images.

3. The method of claim 1 where said image includes a human face.

4. The method of claim 1 where said at least three values includes a red value, a green value, and a blue value.

5. The method of claim 4 where said respective groups of less than three values includes, a r value defined by said red value divided by the summation of said red value, said green value, and said blue value, and a g value defined by said green value divided by the summation of said red value, said green value, and said blue value.

6. The method of claim 1 wherein at least one of said regions is an individual pixel of said image.

7. The method of claim 1 wherein said determining of step (c) is based on a polygonal shape.

8. The method of claim 1 wherein said determining of step (c) is based on a circle.

9. The method of claim 1 wherein at least one of said first distribution and said second distribution is a histogram.

10. The method of claim 1 wherein said first distribution is in a x-direction.

11. The method of claim 10 wherein said second distribution is in a y-direction.

12. The method of claim 11 wherein said first distribution and said second distribution are in orthogonal directions.

13. The method of claim 1 wherein said first distribution and said second distribution are independent of each other.

14. The method of claim 1 further comprising the steps of:

(a) calculating a first generally central location of said first distribution;

(b) calculating a first generally central location of said second distribution; and

(c) locating said face based on said first generally central location of said first distribution and said first generally central location of said second distribution.

15. The method of claim 14 wherein at least one of said first generally central location of said first distribution and said first generally central location of said second distribution is a mean.

16. The method of claim 14 wherein the size of said face is based on the variance of said first distribution and the variance of said second distribution.

17. The method of claim 1 wherein said face is tracked between subsequent frames.

18. The method of claim 17 wherein jitter movement of said face is reduced between said subsequent frames.