Facial expression recognition systems and methods and computer program products thereof
First Claim
1. A facial expression recognition method, comprising:
- receiving a first facial image and a second facial image;
calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of a plurality of expression information respectively; and
determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the plurality of expression information and a plurality of the expression features of optical flow field in a facial database, wherein the facial database comprises the plurality of expression information and the plurality of expression features of optical flow field, and wherein each of the expression features of optical flow field corresponds to one of the plurality of expression information,wherein the facial database further comprises a weight mask corresponding to each of the plurality of expression information and the step of calculating the expression feature of optical flow field further comprises;
generating the calculated expression feature of optical flow field according to the expression feature of optical flow field between the first facial image and the second facial image and the weight mask corresponding to each of the plurality of expression information.
1 Assignment
0 Petitions
Accused Products
Abstract
A facial expression recognition system includes a facial database, an image capture unit, an expression recognition data generation unit and an expression recognition unit. The facial database includes a plurality of expression information and expression features of optical flow field, wherein each of the expression features of optical flow field corresponds to one of the expression information. The image capture unit captures a plurality of facial images. The expression recognition data generation unit is coupled to the image capture unit and the facial database for receiving a first facial image and a second facial image from the image capture unit and calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of the expression information. The expression recognition unit is coupled to the expression recognition data generation unit for determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the expression information and the variation features in optical flow in the facial database.
21 Citations
18 Claims
-
1. A facial expression recognition method, comprising:
-
receiving a first facial image and a second facial image; calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of a plurality of expression information respectively; and determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the plurality of expression information and a plurality of the expression features of optical flow field in a facial database, wherein the facial database comprises the plurality of expression information and the plurality of expression features of optical flow field, and wherein each of the expression features of optical flow field corresponds to one of the plurality of expression information, wherein the facial database further comprises a weight mask corresponding to each of the plurality of expression information and the step of calculating the expression feature of optical flow field further comprises; generating the calculated expression feature of optical flow field according to the expression feature of optical flow field between the first facial image and the second facial image and the weight mask corresponding to each of the plurality of expression information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A facial expression recognition system, comprising:
-
a facial database, including a plurality of expression information and a plurality of expression features of optical flow field, wherein each of the expression features of optical flow field corresponds to one of the plurality of expression information; an image capture unit, capturing a plurality of facial images; an expression recognition data generation unit coupled to the image capture unit and the facial database, receiving a first facial image and a second facial image from the image capture unit and calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of the plurality of expression information respectively; and an expression recognition unit coupled to the expression recognition data generation unit, determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the plurality of expression information and the variation features in optical flow in the facial database, wherein the facial database further comprises a weight mask corresponding to each of the plurality of expression information and the expression recognition data generation unit further generates the calculated expression feature of optical flow field according to the expression feature of optical flow field between the first facial image and the second facial image and the weight mask corresponding to each of the plurality of expression information. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A facial expression recognition apparatus, comprising:
-
a shell; a facial database disposed inside of the shell, including a plurality of expression information and a plurality of expression features of optical flow field, wherein each of the expression features of optical flow field corresponds to one of the plurality of expression information; an image capture unit disposed inside of the shell, capturing a plurality of facial images; an expression recognition data generation unit disposed inside of the shell and coupled to the image capture unit and the facial database, receiving a first facial image and a second facial image from the image capture unit and calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of the plurality of expression information respectively; an expression recognition unit disposed inside of the shell and coupled to the expression recognition data generation unit, determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the plurality of expression information and the variation features in optical flow in the facial database; and a display unit disposed outside of the shell and coupled to the expression recognition unit for displaying a result corresponding to the determined facial expression, wherein the facial database further comprises a weight mask corresponding to each of the plurality of expression information and the expression recognition data generation unit further generates the calculated expression feature of optical flow field according to the expression feature of optical flow field between the first facial image and the second facial image and the weight mask corresponding to each of the plurality of expression information.
-
-
18. A non-transitory computer-readable storage medium storing a computer program, which, when executed, causes a device to perform a facial expression recognition method, and the method comprising:
-
receiving a first facial image and a second facial image; calculating an expression feature of optical flow field between the first facial image and the second facial image corresponding to each of a plurality of expression information respectively; and determining a facial expression corresponding to the first and second facial images according to the calculated expression feature of optical flow field for each of the plurality of expression information and a plurality of the expression features of optical flow field in a facial database, wherein the facial database comprises the plurality of expression information and the plurality of expression features of optical flow field, and wherein each of the expression features of optical flow field corresponds to one of the plurality of expression information, wherein the facial database further comprises a weight mask corresponding to each of the plurality of expression information and the step of calculating the expression feature of optical flow field further comprises; generating the calculated expression feature of optical flow field according to the expression feature of optical flow field between the first facial image and the second facial image and the weight mask corresponding to each of the plurality of expression information.
-
Specification