SYSTEM AND METHOD FOR CONTROLLING OPERATION OF MACHINE

• US 20170297581A1
• Filed: 04/19/2016
• Published: 10/19/2017
• Est. Priority Date: 04/19/2016
• Status: Abandoned Application

• Current Assignee: Caterpillar Incorporated
• Original Assignee: Caterpillar Incorporated
• Inventors: Hatfield, Michael, Crane, Timothy M.
• Application Number:
  US15/132,314
• Publication Number:
  US 20170297581A1
• Time in Patent Office: Days
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2040/0827 due to sleepiness
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2300/125 Heavy duty trucks
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/221 Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2556/45 External transmission of data to or from the vehicle
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G05B 9/02 electric
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa

Abstract

The present disclosure relates to system for controlling operation of machine. The system includes fatigue detection unit configured to generate a signal indicative of fatigue parameter of an operator of the machine. The system includes proximity sensing unit to capture image of a surrounding area of the machine. The system further includes a controller, configured to determine fatigue condition of the operator and to detect presence of an obstacle in the surrounding area of the machine. The controller is further configured to generate a warning signal based on the fatigue condition of the operator and the captured image of the surrounding area of the machine. The controller is configured to communicate signal indicative of the action of the operator with a control module of the machine. The control module autonomously control operation of the machine based on a signal indicative of the action of the operator.

Claims

1. A system for controlling operation of a machine, the system comprising:

a fatigue detection unit disposed in the machine, the fatigue detection unit configured to generate a signal indicative of at least one fatigue parameter of an operator of the machine;

a proximity sensing unit disposed in the machine, the proximity sensing unit configured to capture image of a surrounding area of the machine; and

a controller communicatively coupled to the fatigue detection unit and the proximity sensing unit, the controller configured to;

determine a fatigue condition of the operator based on the signal indicative of the at least one fatigue parameter received from the fatigue detection unit;

detect a presence of an obstacle in the surrounding area of the machine based on the captured image of the surrounding area of the machine;

generate a warning signal based on the fatigue condition of the operator and the captured image of the surrounding area of the machine;

monitor action of the operator in response to the generated warning signal; and

communicate a signal indicative of the action of the operator with a control module of the machine, the control module configured to autonomously control operation of the machine based on a signal indicative of the action of the operator.

2. The system of claim 1, wherein the fatigue detection unit comprises a camera unit and a plurality of sensors disposed within an operator cabin of the machine.

3. The system of claim 1, wherein the proximity sensing unit comprises a front image capturing device and a rear image capturing device.

4. The system of claim 1, wherein the autonomous control operation of the machine comprises at least one of terminating operation of the machine and shutting down an engine of the machine.

5. The system of claim 1, wherein the controller is configured to communicate with a remote station for validating the fatigue condition of the operator.

6. The system of claim 1, wherein the at least one fatigue parameter of the operator is selected from eye blinks, heart beats, sitting posture with respect to a steering wheel and movement of head, hands and legs.

7. The system of claim 1, wherein the controller is configured to compare the at least one fatigue parameter with a threshold range, and configured to determine the fatigue condition of the operator based on the comparison of the at least one fatigue parameter with the threshold range.

8. The system of claim 1, wherein the controller is configured to generate the warning signal if a distance of the obstacle in the captured image of the surrounding area of the machine is within a threshold distance.

9. The system of claim 1, wherein the controller is configured to communicate the signal indicative of the action of the operator with the control module of the machine, if a response time required by the operator for taking action exceeds a threshold time.

10. A method of controlling operation of a machine, the method comprising:

determining a fatigue condition of an operator based on a signal indicative of at least one fatigue parameter received from a fatigue detection unit, via a controller;

detecting a presence of an obstacle in a surrounding area of the machine based on a captured image of the surrounding area of the machine via a proximity sensing unit;

generating a warning signal based on the fatigue condition of the operator and the captured image of the surrounding area of the machine via the controller;

monitoring an action of the operator in response to the generated warning signal; and

communicating a signal indicative of the action of the operator with a control module of the machine for autonomously controlling operation of the machine based on the signal indicative of the action of the operator.

11. The method of claim 10, wherein the autonomously controlling operation of the machine comprises at least one of terminating operation of the machine and shutting down an engine of the machine.

12. The method of claim 10 further comprising, communicating with a remote station for validating the fatigue condition of the operator via the controller.

13. The method of claim 10, wherein the at least one fatigue parameter of the operator is selected from eye blinks, heart beats, sitting posture with respect to a steering wheel and movement of head, hands and legs.

14. The method of claim 10 further comprising, comparing the at least one fatigue parameter with a threshold range, and determining the fatigue condition of the operator based on the comparison of the at least one fatigue parameter with the threshold range.

15. The method of claim 10 further comprising, generating the warning signal if a distance of the obstacle in the captured image of the surrounding area of the machine is within a threshold distance.

16. The method of claim 10 further comprising, communicating the signal indicative of the action of the operator with the control module of the machine via the controller, if a response time required by the operator for the taking action exceeds within a threshold time range.

17. A machine comprising:

a frame;

an operator cabin mounted on the frame of the machine;

a fatigue detection unit disposed within the operator cabin of the machine, the fatigue detection unit configured to generate a signal indicative of at least one fatigue parameter of an operator of the machine;

a proximity sensing unit disposed in the machine, the proximity sensing unit configured to capture image of a surrounding area of the machine; and

a controller communicatively coupled to the fatigue detection unit and the proximity sensing unit, the controller configured to;

determine a fatigue condition of the operator based on the signal indicative of the at least one fatigue parameter received from the fatigue detection unit;

detect a presence of an obstacle in the surrounding area of the machine based on the captured image of the surrounding area of the machine;

generate a warning signal based on the fatigue condition of the operator and the captured image of the surrounding area of the machine;

monitor action of the operator in response to the generated warning signal; and

communicate a signal indicative of the action of the operator with a control module of the machine, the control module configured to autonomously control operation of the machine based on the signal indicative of the action of the operator.

18. The machine of claim 17, wherein the controller is configured to compare at least one fatigue parameter with a threshold range, and configured to determine the fatigue condition of the operator based on the comparison of the at least one fatigue parameter with a threshold range.

19. The machine of claim 17, wherein the controller is configured to generate the warning signal if a distance of the obstacle in the captured image of the surrounding area of the machine is within a threshold distance.

20. The machine of claim 17, wherein the controller is configured to communicate the signal indicative of the action of the operator with the control module of the machine, if a response time required by the operator for taking action is exceeding a threshold time.