IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM

• US 20080181508A1
• Filed: 01/29/2008
• Published: 07/31/2008
• Est. Priority Date: 01/30/2007
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Matsugu, Masakazu, Kaneda, Yuji, Mori, Katsuhiko
• Granted Patent: US 8,165,399 B2
• Time in Patent Office: Days
• US Class Current: 382/190
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/175 Static expression

Abstract

A feature point detection unit (153) and feature amount extraction unit (154) extract a plurality of features of an object from input image data. When there are unextracted features of the plurality of features, a weight setting unit (155) sets weights for the extracted features. A facial expression determination unit (156) executes recognition processing of the object based on the features weighted by the weight setting unit (155).

Claims

1. An image processing apparatus comprising:

a feature extraction unit adapted to extract a plurality of predetermined features in an object from input image data;

a weight setting unit adapted to set weights for the features extracted by said feature extraction unit when there are features which are not extracted by said feature extraction unit; and

a recognition processing unit adapted to execute recognition processing of the object based on the features weighted by said weight setting unit.

4. The apparatus according to claim 1, wherein the object is a person, and said apparatus further comprises a face detection unit adapted to detect a face of the object from the image data,

wherein said feature extraction unit extracts, from the image data, a plurality of predetermined features on the face of the object detected by said face detection unit.

5. The apparatus according to claim 4, further comprising a normalization unit adapted to normalize a size and direction of the face of the object detected by said face detection unit,

wherein said feature extraction unit extracts, from the image data, a plurality of predetermined features on the face of the object normalized by said normalization unit.

6. The apparatus according to claim 1, further comprising a region setting unit adapted to set, for the image data, regions associated with the plurality of features to be extracted by said feature extraction unit,

wherein said feature extraction unit extracts the plurality of features from the regions set by said region setting unit.

7. The apparatus according to claim 1, wherein said feature extraction unit calculates variations associated with the features as the features on the object.

8. The apparatus according to claim 1, wherein the object is a person, and said recognition processing unit executes as the recognition processing one of recognition processing of a facial expression of the object and personal verification of the object.

10. The apparatus according to claim 1, further comprising a storage unit adapted to store the image data based on a result of the recognition processing by said recognition processing unit.

2. An image processing apparatus comprising:

a feature extraction unit adapted to extract a plurality of predetermined features in an object from input image data;

a limitation unit adapted to limit, when there are features which are not extracted by said feature extraction unit, a range of recognition processing based on the unextracted features; and

a recognition processing unit adapted to execute recognition processing of the object based on the range limited by said limitation unit.

3. An image processing apparatus comprising:

a feature extraction unit adapted to extract a plurality of predetermined features in an object from input image data;

a supplementation unit adapted to supplement, when there are features which are not extracted by said feature extraction unit, of the plurality of features, the unextracted features based on information of the features extracted by said feature extraction unit; and

a recognition processing unit adapted to execute recognition processing of the object based on the unextracted features supplemented by said supplementation unit and the features extracted by said feature extraction unit.

9. The apparatus according to claim 3, wherein when there is a feature which is not extracted by said feature extraction unit, said supplementation unit supplements the unextracted feature based on information of a feature which is extracted by said feature extraction unit and is located at a position symmetric to the unextracted feature about a specific axis of the object.

11. An image processing method comprising:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a weight setting step of setting weights for the features extracted in the feature extraction step when there are features which are not extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the features weighted in the weight setting step.

12. An image processing method comprising:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a limitation step of limiting, when there are features which are not extracted in the feature extraction step, a range of recognition processing based on the unextracted features; and

a recognition processing step of executing recognition processing of the object based on the range limited in the limitation step.

13. An image processing method comprising:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a supplementation step of supplementing, when there are features which are not extracted in the feature extraction step, of the plurality of features, the unextracted features based on information of the features extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the unextracted features supplemented in the supplementation step and the features extracted in the feature extraction step.

14. A program stored in a computer-readable storage medium for making a computer execute:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a weight setting step of setting weights for the features extracted in the feature extraction step when there are features which are not extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the features weighted in the weight setting step.

15. A program stored in a computer-readable storage medium for making a computer execute:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a limitation step of limiting, when there are features which are not extracted in the feature extraction step, a range of recognition processing based on the unextracted features; and

a recognition processing step of executing recognition processing of the object based on the range limited in the limitation step.

16. A program stored in a computer-readable storage medium for making a computer execute:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a supplementation step of supplementing, when there are features which are not extracted in the feature extraction step, of the plurality of features, the unextracted features based on information of the features extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the unextracted features supplemented in the supplementation step and the features extracted in the feature extraction step.