Operator fatigue monitoring system

• US 9,990,552 B2
• Filed: 08/06/2015
• Issued: 06/05/2018
• Est. Priority Date: 09/21/2014
• Status: Active Grant

• Current Assignee: Progress Rail Locomotive Inc. (Caterpillar Incorporated)
• Original Assignee: Progress Rail Locomotive Inc. (Caterpillar Incorporated)
• Inventors: Melas, Dennis John, Semple, John David
• Primary Examiner(s): Shah, Tanmay
• Application Number:
  US14/820,281
• Publication Number:
  US 20160082838A1
• Time in Patent Office: 1,034 Days
• Field of Search: 340575
• CPC Class Codes: A61B 5/1114 Tracking parts of the body
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness

Abstract

A fatigue monitoring system is disclosed for use with a machine. The fatigue monitoring system may have an input device configured to generate a first signal indicative of an activity performed by a machine operator, a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator, and a warning device. The fatigue monitoring system may also have a controller in communication with the input device, the scanning device, and the warning device. The controller may be configured to determine a time between generations of the first signal, to make a comparison of the recognized characteristic with a threshold characteristic, and to selectively activate the warning device based on the time or the comparison.

Claims

1. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to;

determine a time between generations of the first signal;

make a comparison of the recognized characteristic with a threshold characteristic;

selectively activate the warning device based on the time or the comparison;

selectively log a first fault condition and communicate the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively log a second fault condition when the warning device is activated.

2. The fatigue monitoring system of claim 1, wherein the activity includes a control activity associated with an operation of the machine.

3. The fatigue monitoring system of claim 1, wherein the activity is associated with only resetting of the fatigue monitoring system.

4. The fatigue monitoring system of claim 1, wherein the recognized characteristic is a facial characteristic.

5. The fatigue monitoring system of claim 4, wherein the facial characteristic is one of an eyelid position, an eye blink frequency, and a head pose.

6. The fatigue monitoring system of claim 1, wherein:

the scanning device is an IR camera disposed within a cabin of the machine; and

the fatigue monitoring system further includes at least one IR source also disposed within the cabin of the machine.

7. The fatigue monitoring system of claim 1, wherein the warning device is one of a visual warning device and an audible warning device.

8. The fatigue monitoring system of claim 7, wherein:

the warning device is an audible warning device; and

the fatigue monitoring system further includes a visual warning device.

9. The fatigue monitoring system of claim 1, wherein the penalty device includes a brake of the machine.

10. The fatigue monitoring system of claim 9, wherein the controller is further configured to selectively reduce throttling of the machine when the brake of the machine is activated as a penalty.

11. The fatigue monitoring system of claim 8, wherein the controller is configured to:

rate a fatigue level of the machine operator based on the comparison; and

selectively activate the visual warning device when the fatigue level is a first level or the time between generations of the first signal exceeds a first threshold level.

12. The fatigue monitoring system of claim 11, wherein the controller is further configured to selectively activate the audible warning device when the fatigue level is a second level or the time between generations of the first signal exceeds a second threshold level greater than the first threshold level.

13. The fatigue monitoring system of claim 11, wherein the controller is further configured to selectively activate the penalty device when the fatigue level is a third level or the time between generations of the first signal exceeds a third threshold level greater than the second threshold level.

14. A fatigue monitoring system for a machine, comprising:

an input device configured to generate a first signal indicative of an activity performed by a machine operator;

a scanning device configured to generate a second signal indicative of a recognized characteristic of the machine operator;

a warning device; and

a controller in communication with the input device, the scanning device, and the warning device, the controller configured to;

determine a time between generations of the first signal;

selectively implement a first level response when the time between generations of the first signal exceeds a first threshold time;

selectively implement a second level response when the time between generations of the first signal exceeds a second threshold time greater than the first threshold time;

make a comparison of the recognized characteristic with a threshold characteristic;

selectively implement the second level response based on the comparison;

selectively log a first fault condition and communicate the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively log a second fault condition when the warning device is activated.

15. A method of monitoring fatigue of a machine operator, comprising:

receiving inputs indicative of an activity performed by the machine operator;

scanning a facial characteristic of the machine operator;

determining a time between receipt of the inputs;

making a comparison of the characteristic with a threshold characteristic;

selectively activating a warning device based on the time or the comparison;

selectively logging a first fault condition and communicating the first fault condition to a central control facility when a penalty device is activated, wherein the penalty device is activated based on the time and the comparison; and

selectively logging a second fault condition when the warning device is activated.

16. The method of claim 15, wherein the activity includes one of a control activity associated with machine operation and a resetting activity.

17. The method of claim 15, further including selectively affecting machine braking or fueling based on the time and the comparison.