Method, apparatus, and program for object detection in digital image

• US 20070036429A1
• Filed: 08/09/2006
• Published: 02/15/2007
• Est. Priority Date: 08/09/2005
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Photo Film Co Limited (Fujifilm Holdings Corporation)
• Inventors: Terakawa, Kensuke
• Application Number:
  US11/500,928
• Publication Number:
  US 20070036429A1
• Time in Patent Office: Days
• US Class Current: 382/159
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships

Abstract

In a method of detection of a predetermined object in an input image, one or more sample image groups representing the object of which a predetermined part or parts is/are occluded is/are prepared in addition to a sample image group representing the entirety of the object, by shifting a position at which sample images in the entirety sample image group are cut. A plurality of detectors are generated by causing the detectors to learn the respective types of the sample image groups according to a machine learning method. The detectors are applied to partial images cut sequentially from the input image at different positions, and judgment is made as to whether each of the partial images is an image representing the object in the state of the entirety or in the state of occlusion thereof.

Claims

1. An object detection method for detecting a predetermined object in an input image, the method comprising the steps of:

preparing a plurality of detectors comprising a detector for judging whether a detection target image is an image representing the entirety of the predetermined object and a detector or detectors of at least one type for judging whether a detection target image is an image representing the predetermined object of which a predetermined part is covered, by causing the plurality of detectors to learn according to a method of machine learning a characteristic of the predetermined object in respective sample image groups obtained to include an entirety sample image group comprising sample images representing the entirety of the predetermined object in predetermined different sizes and a covered sample image group or covered sample image groups of at least one type comprising sample images representing the predetermined object of which the predetermined part is covered;

cutting partial images in the predetermined sizes at different positions in the input image; and

judging whether each of the partial images is an image representing the entirety of the predetermined object or whether each of the partial images is an image representing the predetermined object of which the predetermined part is covered, by applying at least one of the plurality of detectors on each of the partial images as the detection target image.

2. The object detection method according to claim 1, wherein the covered sample image group or groups is/are obtained by cutting each of the sample images in the entirety sample image group by a frame having the same size as the corresponding sample image at a position shifted by a predetermined length in a predetermined direction.

3. The object detection method according to claim 2, wherein the predetermined direction is either a horizontal or vertical direction of the sample images and the predetermined length ranges from ⅓

to ⅕

of a width of the predetermined object.

4. The object detection method according to claim 1, wherein the predetermined object is a face including eyes, nose, and mouth and the predetermined part is a part of the eyes or the mouth.

5. The object detection method according to claim 1, wherein the machine learning method is boosting.

6. An object detection apparatus for detecting a predetermined object in an input image, the apparatus comprising:

a plurality of detectors comprising a detector for judging whether a detection target image is an image representing the entirety of the predetermined object and a detector or detectors of at least one type for judging whether a detection target image is an image representing the predetermined object of which a predetermined part is covered, by causing the plurality of detectors to learn according to a method of machine learning a characteristic of the predetermined object in respective sample image groups obtained to include an entirety sample image group comprising sample images representing the entirety of the predetermined object in predetermined different sizes and a covered sample image group or covered sample image groups of at least one type comprising sample images representing the predetermined object of which the predetermined part is covered;

partial image cutting means for cutting partial images in the predetermined sizes at different positions in the input image; and

judgment means for judging whether each of the partial images is an image representing the entirety of the predetermined object or whether each of the partial images is an image representing the predetermined object of which the predetermined part is covered, by applying at least one of the plurality of detectors on each of the partial images as the detection target image.

7. The object detection apparatus according to claim 6, wherein the covered sample image group or groups is/are obtained by cutting each of the sample images in the entirety sample image group by a frame having the same size as the corresponding sample image at a position shifted by a predetermined length in a predetermined direction.

8. The object detection apparatus according to claim 7, wherein the predetermined direction is either a horizontal or vertical direction of the sample images and the predetermined length ranges from ⅓

to ⅕

of a width of the predetermined object.

9. The object detection apparatus according to claim 6, wherein the predetermined object is a face including eyes, nose, and mouth and the predetermined part is a part of the eyes or the mouth.

10. The object detection apparatus according to claim 6, wherein the machine learning method is boosting.

11. A program for detecting a predetermined object in an input image, the program causing a computer to function as:

a plurality of detectors comprising a detector for judging whether a detection target image is an image representing the entirety of the predetermined object and a detector or detectors of at least one type for judging whether a detection target image is an image representing the predetermined object of which a predetermined part is covered, by causing the plurality of detectors to learn according to a method of machine learning a characteristic of the predetermined object in respective sample image groups obtained to include an entirety sample image group comprising sample images representing the entirety of the predetermined object in predetermined different sizes and a covered sample image group or covered sample image groups of at least one type comprising sample images representing the predetermined object of which the predetermined part is covered;

partial image cutting means for cutting partial images in the predetermined sizes at different positions in the input image; and

judgment means for judging whether each of the partial images is an image representing the entirety of the predetermined object or whether each of the partial images is an image representing the predetermined object of which the predetermined part is covered, by applying at least one of the plurality of detectors on each of the partial images as the detection target image.

12. The program according to claim 11, wherein the covered sample image group or groups is/are obtained by cutting each of the sample images in the entirety sample image group by a frame having the same size as the corresponding sample image at a position shifted by a predetermined length in a predetermined direction.

13. The program according to claim 12, wherein the predetermined direction is either a horizontal or vertical direction of the sample images and the predetermined length ranges from ⅓

to ⅕

of a width of the predetermined object.

14. The program according to claim 11, wherein the predetermined object is a face including eyes, nose, and mouth and the predetermined part is a part of the eyes or the mouth.

15. The program according to claim 11, wherein the machine learning method is boosting.