System and method for automatically detecting neutral expressionless faces in digital images
First Claim
Patent Images
1. A system for automatically detecting neutral, expressionless face images in digital images, the system comprising:
- an image acquisition unit;
an face detector receiving input from the image acquisition unit, detecting one or more face subimages of one or more faces in the image;
a characteristic point detector that receives input from the face detector and that estimates one or more characteristic facial features as characteristic points in each detected face subimage, one of the characteristic points being a first and a second mouth corner on a mouth of the face;
a facial feature detector that detects one or more contours of one or more facial components;
a facial feature analyzer that determines a mouth shape of the mouth from the contour of the mouth and creates a representation of the mouth shape, the mouth being one of the facial components; and
a face classification unit that classifies the representation into one of a neutral class and a non-neutral class.
4 Assignments
0 Petitions
Accused Products
Abstract
A system and method for automatic detecting neutral expressionless faces in digital images and video is described. First a face detector is used to detect the pose and position of a face and find the facial components. Second, the detected face is normalized to a standard size face. Then a set of geometrical facial features and three histograms in zones of mouth are extracted. Finally, by feeding these features to a classifier, the system detects if there is the neutral expressionless face or not.
226 Citations
38 Claims
-
1. A system for automatically detecting neutral, expressionless face images in digital images, the system comprising:
-
an image acquisition unit;
an face detector receiving input from the image acquisition unit, detecting one or more face subimages of one or more faces in the image;
a characteristic point detector that receives input from the face detector and that estimates one or more characteristic facial features as characteristic points in each detected face subimage, one of the characteristic points being a first and a second mouth corner on a mouth of the face;
a facial feature detector that detects one or more contours of one or more facial components;
a facial feature analyzer that determines a mouth shape of the mouth from the contour of the mouth and creates a representation of the mouth shape, the mouth being one of the facial components; and
a face classification unit that classifies the representation into one of a neutral class and a non-neutral class. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
-
-
36. A method for automatically detecting neutral, expressionless face images in digital images, the method comprising the steps of:
-
acquiring an image;
detecting one or more face subimages of one or more faces in the image;
estimating one or more characteristic facial features as characteristic points in each detected face subimage, one of the characteristic points being a first and a second mouth corner on a mouth of the face;
detecting one or more contours of one or more facial components;
determining a mouth shape of the mouth from the contour of the mouth;
creating a representation of the mouth shape, the mouth being one of the facial components; and
classifying the representation into one of a neutral class and a non-neutral class.
-
-
37. A system for automatically detecting neutral, expressionless face images in digital images, the method comprising:
-
means for acquiring an image;
means for detecting one or more face subimages of one or more faces in the image;
means for estimating one or more characteristic facial features as characteristic points in each detected face subimage, one of the characteristic points being a first and a second mouth corner on a mouth of the face;
means for detecting one or more contours of one or more facial components;
means for determining a mouth shape of the mouth from the contour of the mouth;
means for creating a representation of the mouth shape, the mouth being one of the facial components; and
means for classifying the representation into one of a neutral class and a non-neutral class.
-
-
38. A program storage device, readable by machine, tangibly embodying a program of instructions executable by the machine to cause the machine to perform a method for automatically detecting neutral, expressionless face images in digital images, the method comprising the steps of:
-
acquiring an image;
detecting one or more face subimages of one or more faces in the image;
estimating one or more characteristic facial features as characteristic points in each detected face subimage, one of the characteristic points being a first and a second mouth corner on a mouth of the face;
detecting one or more contours of one or more facial components;
determining a mouth shape of the mouth from the contour of the mouth;
creating a representation of the mouth shape, the mouth being one of the facial components; and
classifying the representation into one of a neutral class and a non-neutral class.
-
Specification