FACIAL EXPRESSION CONTROL SYSTEM, FACIAL EXPRESSION CONTROL METHOD, AND COMPUTER SYSTEM THEREOF

• US 20140139424A1
• Filed: 10/21/2013
• Published: 05/22/2014
• Est. Priority Date: 11/22/2012
• Status: Active Grant

• Current Assignee: Wistron Corporation
• Original Assignee: Wistron Corporation
• Inventors: CHANG, Chih-Sung
• Granted Patent: US 9,690,369 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/175 Static expression
• CPC Class Codes: G06V 40/176 Dynamic expression

Abstract

A facial expression control system, a facial expression control method, and a computer system thereof are disclosed. The facial expression control system includes a face detection module, a database, and a processing module. The face detection module is used for determining whether a facial expression feature is detected in a captured image. The database is used for storing a control parameter table, wherein the control parameter table is corresponding to the facial expression feature. If the face detection module detects the facial expression feature, the control parameter table of the database is accessed according to the facial expression feature to get an encode signal and transmitted to the processing module. The processing module is used for generating a control signal according to the encode signal.

Claims

1. A facial expression control system used in a computer system for controlling the computer system having an image capture module for capturing a captured image of a user, the facial expression control system comprising:

a face detection module, electrically connected to the image capture module for determining whether a facial expression feature is detected in the captured image;

a database for storing a control parameter table, wherein the control parameter table is corresponding to the facial expression feature; and

a processing module electrically connected to the database and the face detection module;

wherein if the face detection module detects a facial expression feature, the control parameter table of the database is accessed according to the facial expression feature to get an encode signal and transmitted to the processing module which generates a control signal according to the encode signal.

2. The facial expression control system as claimed in claim 1, wherein the facial expression feature comprises a right eye feature, a left eye feature, and a mouth feature.

3. The facial expression control system as claimed in claim 2, wherein the face detection module detects an open eyes expression or a closed eyes expression to be respectively regarded as the right eye feature or the left eye feature.

4. The facial expression control system as claimed in claim 2, wherein the face detection module detects an open mouth expression or a closed mouth expression to be regarded as the mouth feature.

5. The facial expression control system as claimed in claim 2, wherein the face detection module simultaneously detects a plurality of right eye features, a plurality of left eye features, and a plurality of mouth features in the captured image;

the face detection module further accesses the control parameter table of the database according to the plurality of right eye features, the plurality of left eye features, and the plurality of mouth features to get the encode signal.

6. The facial expression control system as claimed in claim 1, wherein the face detection module further divides the captured image into a plurality of corresponding regions to make the detected facial expression feature correspond to the plurality of corresponding regions to get a corresponding coordinate value;

the face detection module further accesses the control parameter table of the database according to the corresponding coordinate value to get the encode signal.

7. The facial expression control system as claimed in claim 1, wherein the face detection module further detects a user'"'"'s facial feature to get a user account;

the processing module further generates different control signals according to different user accounts.

8. A facial expression control method used in a facial expression control system to control a computer system, the method comprises the following steps:

setting a control parameter table;

capturing a captured image;

determining whether a facial expression feature is detected in the captured image;

if yes, accessing the control parameter table according to the facial expression feature to get an encode signal; and

generating a control signal according to the encode signal.

9. The facial expression control method as claimed in claim 8, wherein the step of detecting the facial expression features comprises detecting a right eye feature, a left eye feature, and a mouth feature.

10. The facial expression control method as claimed in claim 9, further comprising the following step:

respectively detecting an open eyes expression or a closed eyes expression to be regarded as the right eye feature or the left eye feature.

11. The facial expression control method as claimed in claim 9, further comprising the following step:

detecting an open mouth expression or a closed mouth expression to be regarded as the mouth feature.

12. The facial expression control method as claimed in claim 9, wherein getting the encode signal further comprising the following steps:

detecting a plurality of right eye features, a plurality of left eye features, and a plurality of mouth features in the captured image simultaneously; and

accessing the control parameter table according to the plurality of right eye features, the plurality of left eye features, and the plurality of mouth features to get the encode signal.

13. The facial expression control method as claimed in claim 8, wherein the step of getting the encode signal further comprising the following steps:

dividing the captured image into a plurality of corresponding regions;

corresponding the detected facial expression feature with the corresponding region to get a corresponding coordinate value; and

accessing the control parameter table according to the corresponding coordinate value to get the encode signal.

14. The facial expression control method as claimed in claim 8, further comprising the following steps:

detecting facial features of a user to get a user account; and

generating a different control signal according to a different user account.

15. A computer system, comprising:

an image capture module for capturing a captured image of a user; and

a facial expression control system, comprising;

a face detection module electrically connected to the image capture module for determining whether a facial expression feature is detected in the captured image;

a database for storing a control parameter table, wherein the control parameter table is corresponding to the facial expression feature; and

a processing module electrically connected to the database and the face detection module;

wherein if the face detection module detects the facial expression feature, the control parameter table of the database is accessed according to the facial expression feature to get an encode signal and transmitted to the processing module which generated a control signal according to the encode signal.

16. The computer system as claimed in claim 15, wherein the facial expression features comprise a right eye feature, a left eye feature, and a mouth feature.

17. The computer system as claimed in claim 16, wherein the face detection module detects an open eyes expression or a closed eyes expression respectively to be regarded as the right eye feature or the left eye feature.

18. The computer system as claimed in claim 16, wherein the face detection module detects an open mouth expression or a closed mouth expression to be regarded as the mouth feature.

19. The computer system as claimed in claim 16, wherein the face detection module simultaneously detects a plurality of right eye features, a plurality of left eye features, and a plurality of mouth features in the captured image;

the face detection module further accesses the control parameter table of the database according to the plurality of right eye features, the plurality of left eye features, and the plurality of mouth features to get the encode signal.

20. The computer system as claimed in claim 15, wherein the face detection module further divides the captured image into a plurality of corresponding regions to make the detected facial expression feature correspond to the plurality of corresponding regions to get a corresponding coordinate value;

the face detection module further accesses the control parameter table of the database according to the corresponding coordinate value to get the encode signal.

21. The computer system as claimed in claim 15, wherein the face detection module further detects a user'"'"'s facial feature to get a user account;

the processing module further generates different control signals according to different user accounts.