Image processing apparatus, image processing method, and program

• US 8,165,399 B2
• Filed: 01/29/2008
• Issued: 04/24/2012
• Est. Priority Date: 01/30/2007
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kaneda, Yuji, Matsugu, Masakazu, Mori, Katsuhiko
• Primary Examiner(s): PERUNGAVOOR, SATHYANARAYA V
• Application Number:
  US12/021,659
• Publication Number:
  US 20080181508A1
• Time in Patent Office: 1,547 Days
• Field of Search: 382/190
• US Class Current: 382/190
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/175 Static expression

Abstract

A feature point detection unit (153) and feature amount extraction unit (154) extract a plurality of features of an object from input image data. When there are unextracted features of the plurality of features, a weight setting unit (155) sets weights for the extracted features. A facial expression determination unit (156) executes recognition processing of the object based on the features weighted by the weight setting unit (155).

Claims

1. An image processing apparatus comprising:

a feature extraction unit adapted to extract a plurality of predetermined features in an object from input image data;

a supplementation unit adapted to supplement, when there are features which are not extracted by said feature extraction unit, of the plurality of features, the unextracted features based on information of the features extracted by said feature extraction unit; and

a recognition processing unit adapted to execute recognition processing of the object based on the unextracted features supplemented by said supplementation unit and the features extracted by said feature extraction unit,

wherein when there is a feature which is not extracted by said feature extraction unit, said supplementation unit supplements the unextracted feature based on information of a feature which is extracted by said feature extraction unit and is located at a position symmetric to the unextracted feature about a specific axis of the object.

2. An image processing method comprising:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a supplementation step of supplementing, when there are features which are not extracted in the feature extraction step, of the plurality of features, the unextracted features based on information of the features extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the unextracted features supplemented in the supplementation step and the features extracted in the feature extraction step,

wherein when there is a feature which is not extracted by said feature extraction step, said supplementation step supplements the unextracted feature based on information of a feature which is extracted by said feature extraction step and is located at a position symmetric to the unextracted feature about a specific axis of the object.

3. A program stored in a non-transitory computer-readable storage medium for making a computer execute:

a feature extraction step of extracting a plurality of predetermined features in an object from input image data;

a supplementation step of supplementing, when there are features which are not extracted in the feature extraction step, of the plurality of features, the unextracted features based on information of the features extracted in the feature extraction step; and

a recognition processing step of executing recognition processing of the object based on the unextracted features supplemented in the supplementation step and the features extracted in the feature extraction step,

wherein when there is a feature which is not extracted by said feature extraction step, said supplementation step supplements the unextracted feature based on information of a feature which is extracted by said feature extraction step and is located at a position symmetric to the unextracted feature about a specific axis of the object.