OPERATOR FATIGUE MONITORING SYSTEM

• US 20160082838A1
• Filed: 08/06/2015
• Published: 03/24/2016
• Est. Priority Date: 09/21/2014
• Status: Active Grant

• Current Assignee: Progress Rail Locomotive Inc. (Caterpillar Incorporated)
• Original Assignee: Electro-Motive Diesel Incorporated (Caterpillar Incorporated)
• Inventors: MELAS, Dennis John, SEMPLE, John David
• Granted Patent: US 9,990,552 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/1114 Tracking parts of the body
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness

Abstract

A fatigue monitoring system is disclosed for use with a machine. The fatigue monitoring system may have an input device configured to generate a first signal indicative of an activity performed by a machine operator, a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator, and a warning device. The fatigue monitoring system may also have a controller in communication with the input device, the scanning device, and the warning device. The controller may be configured to determine a time between generations of the first signal, to make a comparison of the recognized characteristic with a threshold characteristic, and to selectively activate the warning device based on the time or the comparison.

Claims

1. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to;

determine a time between generations of the first signal;

make a comparison of the recognized characteristic with, a threshold characteristic; and

selectively activate the warning device based on the time or the comparison.

2. The fatigue monitoring system of claim 1, wherein the activity includes a control activity associated air operation of the machine.

3. The fatigue monitoring system of claim 1, wherein the activity is associated with only resetting of the fatigue monitoring system.

4. The fatigue monitoring system of claim 1, wherein the recognized characteristic is a facial characteristic.

5. The fatigue monitoring system of claim 4, wherein the facial characteristic is one of an eyelid position, an eye blink frequency, and a head pose.

6. The fatigue monitoring system of claim 1, Wherein:

the scanning device is an IR camera disposed within a cabin of the machine; and

the fatigue monitoring system further includes at least one IR source also disposed within the cabin of the machine.

7. The fatigue monitoring system of claim 1, wherein the warning device is one of a visual warning device and an audible warning device.

8. The fatigue monitoring system of claim 7, wherein:

the warning device is an audible warning device; and

the fatigue monitoring system further includes a visual warning device.

9. The fatigue monitoring system of claim 8, further including a penalty device, wherein the controller is further configured to selectively activate the penalty device based on the time and the comparison.

10. The fatigue monitoring system of claim 9, wherein the penalty device includes a brake of the machine.

11. The fatigue monitoring system of claim 10, wherein the controller is further configured to selectively reduce throttling of the machine when the brake of the machine is activated as a penalty.

12. The fatigue monitoring system of claim 9, wherein the controller is configured to:

rate a fatigue level of the machine operator based on the comparison; and

selectively activate the visual warning device when the fatigue level is a first level or the time between generations of the first signal exceeds a first threshold level.

13. The fatigue monitoring system of claim 12, wherein the controller is further configured to selectively activate the audible warning device When the fatigue level is a second level or the time between generations of the first signal exceeds a second threshold level greater than the first threshold level.

14. The fatigue monitoring system of claim 12, wherein the controller is further configured to selectively activate the penalty device when the fatigue level is a third level or the time between generations of the first signal exceeds a third threshold level greater than the second threshold level.

15. The fatigue monitoring system of claim 12, wherein the controller is further configured to selectively log a fault condition when the warning device is activated.

16. The fatigue monitoring system of claim 12, wherein the controller is further configured to selectively log a fault condition and communicate the fault condition to a central control facility when the penalty device is activated.

17. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to;

determine a time between generations of the first signal;

selectively implement a first level response When the time between generations of the first signal exceeds a first threshold time;

selectively implement a second level response when the time between generations of the first signal exceeds a second threshold time greater than the first threshold time;

make a comparison of the recognized characteristic with a threshold characteristic; and

selectively implement the second level response based on the comparison.

18. A method of monitoring fatigue of a machine operator, comprising:

receiving inputs indicative of an activity performed by the machine operator;

scanning a facial characteristic of the machine operator;

determining a time between receipt of the inputs;

making a comparison of the characteristic with a threshold characteristic; and

selectively activating a warning device based on the time or the comparison.

19. The method of claim 18, wherein the activity includes one of a control activity associated with machine operation and a resetting activity.

20. The method of claim 18, further including selectively affecting machine braking or fueling based on the time and the comparison.