Classification system for consumer digital images using automatic workflow and face detection and recognition
First Claim
1. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device, the programming instructions comprising:
- (a) a face detection module for identifying a group of pixels corresponding to a face region within digital image data acquired by the acquisition device;
(b) a normalization module for generating a normalized face region from said face region;
(c) a face recognition module for automatically extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region;
(d) a workflow module for automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, the workflow module further for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; and
(e) a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media, andwherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints,wherein the determining by the face recognition module comprises automatically determining that the new faceprint corresponds to a known identity based on one or more geometric distance proximities being within a predetermined proximity threshold, andwherein the predetermined proximity threshold comprises a first threshold, and the determining by the workflow module comprises confirming whether the normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold.
6 Assignments
0 Petitions
Accused Products
Abstract
A processor-based system operating according to digitally-embedded programming instructions includes a face detection module for identifying face regions within digital images. A normalization module generates a normalized version of the face region. A face recognition module automatically extracts a set of face classifier parameter values from the normalized face region that are referred to as a faceprint. A workflow module automatically compares the extracted faceprint to a database of archived faceprints previously determined to correspond to known identities. The workflow module determines based on the comparing whether the new faceprint corresponds to any of the known identities, and associates the new faceprint and normalized face region with a new or known identity within a database. A database module serves to archive data corresponding to the new faceprint and its associated parent image according to the associating by the workflow module within one or more digital data storage media.
-
Citations
157 Claims
-
1. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device, the programming instructions comprising:
-
(a) a face detection module for identifying a group of pixels corresponding to a face region within digital image data acquired by the acquisition device; (b) a normalization module for generating a normalized face region from said face region; (c) a face recognition module for automatically extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region; (d) a workflow module for automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, the workflow module further for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; and (e) a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, wherein the determining by the face recognition module comprises automatically determining that the new faceprint corresponds to a known identity based on one or more geometric distance proximities being within a predetermined proximity threshold, and wherein the predetermined proximity threshold comprises a first threshold, and the determining by the workflow module comprises confirming whether the normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold. - View Dependent Claims (25, 26, 29, 30, 32)
-
-
2. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital-image acquisition device, the programming instructions comprising;
-
(a) a face detection module for identifying of pixels corresponding to a face region within digital image data acquired by the acquisition device; (b) a normalization module for generating a normalized face region from said face region; (c) a face recognition module for automatically extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region; (d) a workflow module for automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, the workflow module further for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; and (e) a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises requesting user confirmation whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 27, 28, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 69)
-
-
3. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device the programming instructions comprising:
-
(a) a face detection module for identifying a group of pixels corresponding to a face region within digital image data acquired by the acquisition device; (b) a normalization module for generating a normalized face region from said face region; (c) a face recognition module for automatically extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region; (d) a workflow module for automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, the workflow module further for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; and (e) a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media, and wherein the set of face classifier parameters comprises a combination of two or more of principle components vectors, independent component vectors, fourier components, discrete cosine transform components, wavelet transform components and gabor transform components, wherein the set of classifier parameters may be subdivided into two or more subsets of face classifier parameters wherein each subset facilitates a particular step of the comparing and determining a match of said set of face classifier parameters with a previously determined known identity. - View Dependent Claims (68)
-
-
4. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device, the programming instructions comprising a workflow module providing for the automatic or semiautomatic processing of normalized face regions from which face classifier parameter values are automatically extracted and collectively referred to as a faceprint, the processing comprising:
-
(i) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, (ii) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and (iii) associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises automatically determining that the new faceprint corresponds to a known identity based on one or more geometric distance proximities being within a predetermined proximity threshold, and wherein the predetermined proximity threshold comprises a first threshold, and the determining by the workflow module comprises confirming whether a normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold. - View Dependent Claims (77, 78)
-
-
5. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device, the programming instructions comprising a workflow module providing for the automatic or semiautomatic processing of normalized face regions from which face classifier parameter values are automatically extracted and collectively referred to as a faceprint, the processing comprising:
-
(i) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities (ii) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and (iii) associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises confirming whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match. - View Dependent Claims (81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125)
-
-
6. A processor-based system operating according to digitally-embedded programming instructions residing on one or more processor-readable memories and communicating with one or more digital data storage media for classifying and archiving images including face regions that are acquired with a digital image acquisition device the programming instructions comprising a workflow module providing for the automatic or semiautomatic processing of normalized face regions from which face classifier parameter values are automatically extracted and collectively referred to as a faceprint, the processing comprising:
-
(i) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, (ii) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and (iii) associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein the set of face classifier parameters comprises a combination of two or more of principle components vectors, independent component vectors, fourier components, discrete cosine transform components, wavelet transform components and gabor transform components, and wherein the set of face classifier parameters may be subdivided into two or more subsets of face classifier parameters wherein each subset facilitates a particular step of the comparing and determining a match of said set of face classifier parameters with a previously determined known identity. - View Dependent Claims (70, 71, 72, 73, 74, 75, 76, 79, 80, 112)
-
-
7. A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of:
-
(a) generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values, collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; and (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises automatically determining that the new faceprint corresponds to a known identity based on one or more geometric distance proximities being within a predetermined proximity threshold, and wherein the predetermined proximity threshold comprises a first threshold, and the determining comprises requesting user confirmation whether the normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold, and statistically calculating at least one proximity to be within a threshold when the probability that the proximity is within the threshold is above a predetermined probability value. - View Dependent Claims (126, 127, 128)
-
-
8. A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of:
-
(a) generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values, collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; and (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises automatically determining that the new faceprint corresponds to a known identity based on one or more geometric distance proximities being within a predetermined proximity threshold, and wherein the predetermined proximity threshold comprises a first threshold, and the determining comprises requesting user confirmation whether the normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold, and wherein the determining comprises automatically determining that the new faceprint does not correspond to a known identity based on one or more geometric distance proximities being outside the second threshold or a third threshold greater than the second threshold. - View Dependent Claims (134)
-
-
9. A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of:
-
(a) Generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; and (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises automatically determining that the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first face print with multiple archived faceprints corresponding to a same known identity each result in a determination of an identity match, wherein a predetermined proximity threshold comprises a first threshold, and the determining comprises confirming whether the normalized face region associated with the new faceprint corresponds to a known identity when a geometric distance proximity is outside the first threshold and within a second threshold greater than the first threshold. - View Dependent Claims (129, 130, 131, 132, 133, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157)
-
-
10. A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of:
-
(a) generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; and (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data, storage media, and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises requesting user confirmation whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponds to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match.
-
Specification