Method and system for enhancing three dimensional face modeling using demographic classification
First Claim
Patent Images
1. A method for face modeling, comprising the steps of:
- (a) processing face detection and facial feature detection on a plurality of images for a person with a single or a plurality of image capturing systems,(b) locating four landmarks on the face of the person based on the facial feature detection,wherein the face is detected by the face detection, andwherein three point features from the four landmarks form a basis plane,(c) training support vector machine (SVM) based demographic classifiers with between one and two thousand images as an input at a learning phase,(d) processing said plurality of images to obtain demographic recognition of the person in the captured images using the support vector machine (SVM) based demographic classifiers,(e) choosing a face model specific to the demographic recognition of the person as an approximate face model,whereby calculation of affine coordinates using demographic dependent constant can be facilitated by the chosen approximate face model, and(f) combining said demographic recognition with affine coordinate based mesh adjustment technique for said face modeling,wherein said demographic recognition comprises gender and ethnicity recognition, andwhereby the face modeling is followed by a view generation of the face using rendering tools.
3 Assignments
0 Petitions
Accused Products
Abstract
The present invention is a system and method for modeling faces from images captured from a single or a plurality of image capturing systems at different times. The method first determines the demographics of the person being imaged. This demographic classification is then used to select an approximate three dimensional face model from a set of models. Using this initial model and properties of camera projection, the model is adjusted leading to a more accurate face model.
-
Citations
10 Claims
-
1. A method for face modeling, comprising the steps of:
-
(a) processing face detection and facial feature detection on a plurality of images for a person with a single or a plurality of image capturing systems, (b) locating four landmarks on the face of the person based on the facial feature detection, wherein the face is detected by the face detection, and wherein three point features from the four landmarks form a basis plane, (c) training support vector machine (SVM) based demographic classifiers with between one and two thousand images as an input at a learning phase, (d) processing said plurality of images to obtain demographic recognition of the person in the captured images using the support vector machine (SVM) based demographic classifiers, (e) choosing a face model specific to the demographic recognition of the person as an approximate face model, whereby calculation of affine coordinates using demographic dependent constant can be facilitated by the chosen approximate face model, and (f) combining said demographic recognition with affine coordinate based mesh adjustment technique for said face modeling, wherein said demographic recognition comprises gender and ethnicity recognition, and whereby the face modeling is followed by a view generation of the face using rendering tools. - View Dependent Claims (2, 3, 4, 5)
-
-
6. An apparatus for face modeling, comprising:
-
(a) a single or a plurality of image capturing means directed at a person, (a) means for processing face detection and facial feature detection on a plurality of images for the person, (b) means for locating four landmarks on the face of the person based on the facial feature detection, wherein the face is detected by the face detection, and wherein three point features from the four landmarks form a basis plane, (c) means for training support vector machine (SVM) based demographic classifiers with between one and two thousand images as an input at a learning phase, (d) a processing means for recognizing demographics from at least an image, (e) a selection means that chooses a face model specific to the demographic recognition of the person as an approximate face model, whereby calculation of affine coordinates using demographic dependent constant can be facilitated by the chosen approximate face model, (f) a processing means for combining the demographics recognition with affine coordinate based mesh adjustment technique for said face modeling, and (g) at least a rendering tool for a view generation of the face, wherein the demographics recognition comprises gender and ethnicity recognition. - View Dependent Claims (7, 8, 9, 10)
-
Specification