Facial expression recognition apparatus, image sensing apparatus, facial expression recognition method, and computer-readable storage medium
First Claim
Patent Images
1. An apparatus comprising:
- an image input unit configured to input an image;
a face detection unit configured to detect a face image of a person from an image input by said image input unit;
a calculation unit configured to calculate a first facial expression evaluation value corresponding to a first facial expression and a second facial expression evaluation value corresponding to a second facial expression for the detected face based on the face image detected by said face detection unit;
a holding unit configured to hold a relationship between the first facial expression evaluation value and the second facial expression evaluation value;
a first determination unit configured to determine a first priority, of the first facial expression, and a second priority, of the second facial expression, based on the held relationship;
a weighting unit configured to weight at least one of the first facial expression evaluation value, the second facial expression evaluation value, and a threshold for determining the facial expression, using the determined respective priority; and
a second determination unit configured to determine a facial expression of the face image based on the first facial expression evaluation value, the second facial expression evaluation value, and the threshold.
1 Assignment
0 Petitions
Accused Products
Abstract
A facial expression recognition apparatus (10) detects a face image of a person from an input image, calculates a facial expression evaluation value corresponding to each facial expression from the detected face image, updates, based on the face image, the relationship between the calculated facial expression evaluation value and a threshold for determining a facial expression set for the facial expression evaluation value, and determines the facial expression of the face image based on the updated relationship between the facial expression evaluation value and the threshold for determining a facial expression.
-
Citations
13 Claims
-
1. An apparatus comprising:
-
an image input unit configured to input an image; a face detection unit configured to detect a face image of a person from an image input by said image input unit; a calculation unit configured to calculate a first facial expression evaluation value corresponding to a first facial expression and a second facial expression evaluation value corresponding to a second facial expression for the detected face based on the face image detected by said face detection unit; a holding unit configured to hold a relationship between the first facial expression evaluation value and the second facial expression evaluation value; a first determination unit configured to determine a first priority, of the first facial expression, and a second priority, of the second facial expression, based on the held relationship; a weighting unit configured to weight at least one of the first facial expression evaluation value, the second facial expression evaluation value, and a threshold for determining the facial expression, using the determined respective priority; and a second determination unit configured to determine a facial expression of the face image based on the first facial expression evaluation value, the second facial expression evaluation value, and the threshold. - View Dependent Claims (2, 3, 4, 5)
-
-
6. An image sensing apparatus comprising:
-
an image input unit configured to input an image; a face detection unit configured to detect a face image of a person from an image input by said image input unit; an estimation unit configured to estimate an attribute of the person based on the detected face image of the person; a calculation unit configured to calculate a facial expression evaluation value corresponding to a facial expression based on the face image detected by said face detection unit;
a first determination unit configured to determine priority corresponding to the facial expression evaluation value, based on the estimated attribute;a second determination unit configured to determine a facial expression of the face image based on the calculated facial expression evaluation value and a threshold for determining a facial expression; and an image sensing unit configured to perform image capturing based on the facial expression of the face image determined by said second determination unit, wherein said image sensing unit performs image capturing based on a relationship between facial expression evaluation values respectively corresponding to a first facial expression and a second facial expression, which are calculated by said calculation unit, and a threshold for determining a facial expression set for each facial expression evaluation value. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A facial expression recognition method comprising:
-
an image input step of inputting an image; a face detection step of detecting a face image of a person from an image input in the image input step; a calculation step of calculating a first facial expression evaluation value corresponding to a first facial expression and a second facial expression evaluation value corresponding to a second facial expression for the detected face based on the face image detected in the face detection step; a holding step of holding a relationship between the first facial expression evaluation value and the second facial expression evaluation value; a first determination step of determining a first priority, of the first facial expression, and a second priority, of the second facial expression, based on the held relationship; a weighting step of weighting at least one of the first facial expression evaluation value, the second facial expression evaluation value, and a threshold for determining the facial expression, using the determined respective priority; and a second determination step of determining a facial expression of the face image based on the first facial expression evaluation value, the second facial expression evaluation value, and the threshold.
-
-
12. A computer-readable storage medium storing a facial expression recognition program for causing a computer to function as
a face detection unit configured to detect a face image of a person from an image, a calculation unit configured to calculate a first facial expression evaluation value corresponding to a first facial expression and a second facial expression evaluation value corresponding to a second facial expression for the detected face based on the face image detected by the face detection unit, a holding unit configured to hold a relationship between the first facial expression evaluation value and the second facial expression evaluation value, a first determination unit configured to determine a first priority of the first facial expression, and a second priority, of the second facial expression, based on the held relationship; -
a weighting unit configured to weight at least one of the first facial expression evaluation value, the second facial expression evaluation value, and a threshold for determining the facial expression, using the determined respective priority; a second determination unit configured to determine a facial expression of the face image based on the first facial expression evaluation value, the second facial expression evaluation value, and the threshold.
-
-
13. A method performed by an image sensing apparatus, the method comprising:
-
an image input step of inputting an image; a face detection step of detecting a face image of a person from an image input in the image input step; an estimation step of estimating an attribute of the person based on the detected face image of the person; a calculation step of calculating a facial expression evaluation value corresponding to a facial expression based on the face image detected in the face detection step; a first determination step of determining priority corresponding to the facial expression evaluation value, based on the estimated attribute; a second determination step of determining a facial expression of the face image based on the calculated facial expression evaluation value and a threshold for determining a facial expression; and an image sensing step of performing image capturing based on the facial expression of the face image determined in the second determination step, wherein the image sensing step performs image capturing based on a relationship between facial expression evaluation values respectively corresponding to a first facial expression and a second facial expression, which are calculated in the calculation step, and a threshold for determining a facial expression set for each facial expression evaluation value.
-
Specification