Extracting features from face regions and auxiliary identification regions of images for person recognition and other applications

• US 20080075336A1
• Filed: 09/26/2006
• Published: 03/27/2008
• Est. Priority Date: 09/26/2006
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Tretter, Daniel, Zhang, Tong, Luo, Huitao
• Granted Patent: US 7,689,011 B2
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions

Abstract

Method, apparatus, and systems for extracting features from face regions and auxiliary identification regions of images are described. In one aspect, a face region containing at least a portion of a person'"'"'s face is detected in an input image. An auxiliary identification region outside the face region is identified in the input image. Facial features characterizing the face region are determined. Auxiliary identification features characterizing the auxiliary identification region are calculated. An indexing datum is derived from the facial features and the auxiliary identification features. The indexing datum is stored in association with the input image.

Claims

1. A method, comprising:

detecting in an input image a face region containing at least a portion of a person'"'"'s face;

identifying in the input image an auxiliary identification region outside the face region;

determining facial features characterizing the face region;

calculating auxiliary identification features characterizing the auxiliary identification region;

deriving an indexing datum from the facial features and the auxiliary identification features; and

storing the indexing datum in association with the input image.

2. The method of claim 1, wherein the identifying comprises selecting a region of the input image below and adjacent to the face region as the auxiliary identification region.

3. The method of claim 1, wherein the identifying comprises selecting a region of the input image surrounding the face region as the auxiliary identification region.

4. The method of claim 1, wherein the identifying comprises determining dimensions of the auxiliary identification region as a function of corresponding dimensions of the face region.

5. The method of claim 1, wherein the calculating comprises calculating one or more photometric invariant features characterizing the auxiliary identification region.

6. The method of claim 1, further comprising color normalizing the auxiliary identification region before calculating the auxiliary identification features.

7. The method of claim 6, wherein the color normalizing comprises determining a transform mapping the face region to a reference color space, and applying the transform to the auxiliary identification region to obtain a normalized auxiliary identification region in the reference color.

8. The method of claim 6, wherein the calculating comprises calculating one or more color features from the color normalized auxiliary identification region.

9. The method of claim 6, wherein the calculating comprises calculating one or more texture features from the color normalized auxiliary identification region.

10. The method of claim 1, further comprising computing one or more measures of similarity between the stored indexing datum and one or more indexing data determined for respective candidate images in a collection, and selecting one or more of the candidate images based on the computed similarity measures.

11. An apparatus configured to cause a machine to perform operations comprising:

detecting in an input image a face region containing at least a portion of a person'"'"'s face;

identifying in the input image an auxiliary identification region outside the face region;

determining facial features characterizing the face region;

calculating auxiliary identification features characterizing the auxiliary identification region;

deriving an indexing datum from the facial features and the auxiliary identification features; and

storing the indexing datum in association with the input image.

12. The apparatus of claim 11, wherein the machine-readable instructions cause the machine to select a region of the input image below and adjacent to the face region as the auxiliary identification region.

13. The apparatus of claim 11, wherein the machine-readable instructions cause the machine to select a region of the input image surrounding the face region as the auxiliary identification region.

14. The apparatus of claim 11, wherein the machine-readable instructions cause the machine to determine dimensions of the auxiliary identification region as a function of corresponding dimensions of the face region.

15. The apparatus of claim 11, wherein the machine-readable instructions cause the machine to calculate one or more photometric invariant features characterizing the auxiliary identification region.

16. The apparatus of claim 11, wherein the machine-readable instructions cause the machine to color normalize the auxiliary identification region before calculating the auxiliary identification features.

17. The apparatus of claim 16, wherein the machine-readable instructions cause the machine to determine a transform mapping the face region to a reference color space, and applying the transform to the auxiliary identification region to obtain a normalized auxiliary identification region in the reference color.

18. The apparatus of claim 16, wherein the machine-readable instructions cause the machine to calculate one or more color features from the color normalized auxiliary identification region.

19. The apparatus of claim 16, wherein the machine-readable instructions cause the machine to calculate one or more texture features from the color normalized auxiliary identification region.

20. A system, comprising:

a face detection processing component operable to detect in an input image a face region containing at least a portion of a person'"'"'s face;

an auxiliary identification region processing component operable to identify in the input image an auxiliary identification region outside the face region;

a feature extraction processing component operable to determine facial features characterizing the face region and calculate auxiliary identification features characterizing the auxiliary identification region; and

an indexing datum processing component operable to derive an indexing datum from the facial features and the auxiliary identification features, and to store the indexing datum in association with the input image.