SYSTEM FOR RAPID DETECTION OF DROWSINESS IN A MACHINE OPERATOR
First Claim
Patent Images
1. A system for detecting drowsiness in a machine operator, the process comprising:
- an image acquisition module operable to electronically capture a plurality of facial images of the machine operator;
a face localization module having a generic face mesh grid, said face localization module operable to create a neutral face mesh grid by fitting said generic face mesh grid to a desired first captured facial image, said face localization module also operable to create a subsequent face mesh grid by fitting said generic face mesh grid to a desired second captured facial image;
a facial orientation module operable to determine a facial variation between a facial orientation parameter of said neutral face mesh grid and a facial orientation parameter of said subsequent face mesh grid;
a facial action database having a plurality of stored high priority sleepiness facial actions, said plurality of stored high priority sleepiness facial actions each having an assigned sleepiness severity value;
an action estimation module having a comparison algorithm, said action estimation module operable to compare said facial variation with said plurality of stored high priority sleepiness facial actions using said comparison algorithm and select a stored high priority sleepiness facial action that matches said facial variation within a predetermined amount;
a matching module operable to identify and select stored high priority sleepiness facial actions that are within a predetermined range of likeness to said identified stored high priority sleepiness facial action;
a sleepiness level module operable to compare assigned sleepiness values of all selected stored high priority sleepiness facial actions and generate a probability of a current level of sleepiness;
a warning module operable to actuate an actuator as a function of the current level of sleepiness having a highest probability.
2 Assignments
0 Petitions
Accused Products
Abstract
The present invention discloses a system and a process for rapidly detecting drowsiness in a individual operating a machine. The system can capture a plurality of facial images of the individual and compare one or more facial parameters from the images to a plurality of stored high priority sleepiness facial actions that are in a prioritized action database. Based on the comparison, a current level of sleepiness can be determined for the individual and an actuator can be actuated in order to alert the individual and possibly any other individuals that may be in the vicinity.
-
Citations
16 Claims
-
1. A system for detecting drowsiness in a machine operator, the process comprising:
-
an image acquisition module operable to electronically capture a plurality of facial images of the machine operator; a face localization module having a generic face mesh grid, said face localization module operable to create a neutral face mesh grid by fitting said generic face mesh grid to a desired first captured facial image, said face localization module also operable to create a subsequent face mesh grid by fitting said generic face mesh grid to a desired second captured facial image; a facial orientation module operable to determine a facial variation between a facial orientation parameter of said neutral face mesh grid and a facial orientation parameter of said subsequent face mesh grid; a facial action database having a plurality of stored high priority sleepiness facial actions, said plurality of stored high priority sleepiness facial actions each having an assigned sleepiness severity value; an action estimation module having a comparison algorithm, said action estimation module operable to compare said facial variation with said plurality of stored high priority sleepiness facial actions using said comparison algorithm and select a stored high priority sleepiness facial action that matches said facial variation within a predetermined amount; a matching module operable to identify and select stored high priority sleepiness facial actions that are within a predetermined range of likeness to said identified stored high priority sleepiness facial action; a sleepiness level module operable to compare assigned sleepiness values of all selected stored high priority sleepiness facial actions and generate a probability of a current level of sleepiness; a warning module operable to actuate an actuator as a function of the current level of sleepiness having a highest probability. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A process for detecting drowsiness in a machine operator, the process comprising:
-
capturing a plurality of facial images as a function of time the operator is operating the machine; selecting a set of facial landmark points on a desired first captured image; selecting a set of facial landmark points on a desired second captured image; creating a neutral face mesh grid by fitting a generic face mesh grid to the set of facial landmark points on the desired first captured facial image; creating a subsequent face mesh grid by fitting the generic face mesh grid the set of facial landmark points on the desired second captured facial image; calculating a facial variation between the neutral face mesh grid and the subsequent facial mesh grid; providing a facial action database having a plurality of stored high priority sleepiness facial actions, said plurality of stored high priority sleepiness facial actions each having an assigned sleepiness severity value; comparing the facial variation to the plurality of stored high priority sleepiness facial actions; selecting one of the stored high priority sleepiness facial actions that is within a predetermined range of likeness of the facial variation; comparing the selected stored high priority sleepiness facial action with all of the plurality of stored high priority sleepiness facial actions; selecting all of the stored high priority sleepiness facial actions that are similar to the selected one stored high priority sleepiness facial action within a predetermined range of likeness; generating a trigger packet containing data on all of the selected stored high priority sleepiness facial actions; evaluating all of the assigned sleepiness severity values for all of the selected stored high priority sleepiness facial actions; calculating a probability for each of the selected stored high priority sleepiness facial actions; calculating a current sleepiness level as a function of the selected stored high priority sleepiness facial action having the highest probability; and actuating an actuator as a function of the current sleepiness level. - View Dependent Claims (16)
-
Specification