Method and apparatus for calculating an operator distraction level

• US 7,039,551 B2
• Filed: 09/25/2002
• Issued: 05/02/2006
• Est. Priority Date: 02/04/2002
• Status: Expired due to Fees

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Shu, David, Schwartz, David
• Primary Examiner(s): Wachsman, Hal
• Assistant Examiner(s): West, Jeffrey R
• Application Number:
  US10/256,098
• Publication Number:
  US 20030149545A1
• Time in Patent Office: 1,315 Days
• Field of Search: 702/33, 702/57, 702/113, 702/150, 702/176, 702/182, 702/183, 702/188, 702/189, 702/177, 701/45, 701/48, 701/57, 701/62, 701/93, 701/98, 701/120, 701/301, 701/35, 701/36, 340/435, 340/439, 340/438, 340/576, 340/679, 340/680
• US Class Current: 702/182
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: B60R 21/01542 detecting passenger motion
• CPC Class Codes: B60R 21/01552 detecting position of specific human body parts, e.g. face, eyes or hands
• CPC Class Codes: B60W 2540/229 Attention level, e.g. attentive to driving, reading or sleeping
• CPC Class Codes: B60W 40/08 related to drivers or passengers

Abstract

A method, apparatus, and computer program product are provided for calculating an indicator of operator distraction for an equipment operator. First, distraction-correlated indicator information from devices around an operator is received. Next, a distraction level is estimated. Subsequently, an output is produced indicative of the distraction level to facilitate a threat assessment decision. Additional operations may include grouping information into complex task types comprising sets of related activities. Next, an elapsed time is determined since the start of the first activity in a complex task. The delay since the most recent activity in the complex task is compared with a minimum task quiescent period. When the delay exceeds the minimum task quiescent period, the elapsed time and the delay are reset. Also, during the performance of a complex task, the type and the elapsed time of the complex task are correlated with other information to facilitate a threat assessment decision.

Claims

1. A method for calculating an indicator of operator distraction for an equipment operator comprising the following steps:

receiving distraction-correlated indicator information regarding an operator from devices around an operator;

estimating a distraction level from the distraction-correlated indicator information; and

producing an output indicative of the distraction level in order to facilitate a threat assessment decision,

wherein in the step of producing an output, the output produced ensures that when the distraction of the operator is high, the threat assessment decision is made conservatively,

wherein the distraction-correlated indicator information is received from at least one device selected from a group comprising vision-based sensing systems, range-finding systems, and operator-manipulated devices,

wherein the step of estimating a distraction level further comprises the steps of;

grouping the distraction-correlated indicator information into complex task types comprising sets of related activities, including at least a first activity and a most recent activity;

determining an elapsed time since a start of the first activity in a complex task;

determining a delay time since the most recent activity in the complex task;

comparing the delay time since the most recent activity with a minimum task quiescent period, and when the delay time exceeds the minimum task quiescent period, resetting the elapsed time and the delay time; and

during a performance of a complex task, correlating a type of the complex task, and the elapsed time of the complex task with the distraction-correlated indicator information in order to produce the output for facilitating the threat assessment decision.

2. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 1, wherein in the receiving step, the distraction-correlated indicator information includes a duration of a current activity.

3. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 2, wherein the step of correlating is performed by a controller selected from a group consisting of fuzzy rule-based controllers and rule-based controllers.

4. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 3, wherein in the step of receiving distraction-correlated indicator information, the distraction-correlated indicator information is based on secondary activities performed by the operator of a vehicle.

5. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 4, further comprising a step of adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

6. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 5, wherein in the step of adjusting the operational parameters, the operational parameters adjusted are collision warning system parameters.

7. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 1, wherein in the step of receiving distraction-correlated indicator information, the distraction-correlated indicator information is based on secondary activities performed by the operator of equipment selected from a group consisting of manufacturing equipment and process control equipment.

8. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 7, further comprising a step of adjusting operational parameters of the equipment to accommodate the operator'"'"'s distraction.

9. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 1, wherein in the step of receiving distraction-correlated indicator information, the distraction-correlated indicator information is based on secondary activities performed by the operator of a vehicle.

10. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 9, further comprising a step of adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

11. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 10, wherein in the step of adjusting the operational parameters, the operational parameters adjusted are collision warning system parameters.

12. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 1, wherein the step of correlating is performed by a controller selected from the group consisting of fuzzy rule-based controllers and rule-based controllers.

13. A method for calculating an indicator of operator distraction for an equipment operator as set forth in claim 1, further comprising a step of producing a second output including a confidence level of the output that is indicative of the distraction level for facilitating a threat assessment decision.

14. An apparatus for calculating an indicator of operator distraction for an equipment operator comprising:

means for receiving distraction-correlated indicator information regarding an operator from devices around an operator;

means for estimating a distraction level from the distraction-correlated indicator information; and

means for producing an output indicative of the distraction level in order to facilitate a threat assessment decision,

wherein in the means for producing an output produces an output that ensures that when the distraction of the operator is high, the threat assessment decision is made conservatively,

wherein the distraction-correlated indicator information is received from at least one device selected from a group comprising vision-based sensing systems, range-finding systems, and operator-manipulated devices,

wherein the means for estimating a distraction level further comprises;

means for grouping the distraction-correlated indicator information into complex task types comprising sets of related activities, including at least a first activity and a most recent activity;

means for determining an elapsed time since a start of the first activity in a complex task;

means for determining a delay time since the most recent activity in the complex task;

means for comparing the delay time since the most recent activity with a minimum task quiescent period, and when the delay time exceeds the minimum task quiescent period, resetting the elapsed time and the delay time; and

means for, during a performance of a complex task, correlating a type of the complex task, and the elapsed time of the complex task with the distraction-correlated indicator information in order to produce the output for facilitating the threat assessment decision.

15. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 14, wherein the means for receiving receives distraction-correlated indicator information including a duration of a current activity.

16. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 15, wherein the means for correlating operates by use of a controller selected from a group consisting of fuzzy rule-based controllers and rule-based controllers.

17. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 16, wherein the means for receiving distraction-correlated indicator information receives distraction-correlated indicator information that is based on secondary activities performed by the operator of a vehicle.

18. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 17, further comprising means for adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

19. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 18, wherein in the means for adjusting the operational parameters adjusts collision warning system parameters.

20. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 14, wherein in the means for receiving distraction-correlated indicator information receives distraction-correlated indicator information based on secondary activities performed by the operator of equipment selected from a group consisting of manufacturing equipment and process control equipment.

21. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 20, further comprising means for adjusting operational parameters of the equipment to accommodate the operator'"'"'s distraction.

22. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 14, wherein the means for receiving distraction-correlated indicator information receives distraction-correlated indicator information based on secondary activities performed by the operator of a vehicle.

23. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 22, further comprising a means for adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

24. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 23, wherein the means for adjusting the operational parameters adjusts collision warning system parameters.

25. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 14, wherein in the means for correlating operates by use of a controller selected from the group consisting of fuzzy rule-based controllers and rule-based controllers.

26. An apparatus for calculating an indicator of operator distraction for an equipment operator as set forth in claim 14, further comprising a means for producing a second output including a confidence level of the output that is indicative of the distraction level for facilitating a threat assessment decision.

27. A computer program product for calculating an indicator of operator distraction for an equipment operator comprising, the computer program product comprising means stored on a computer readable medium for

receiving distraction-correlated indicator information regarding an operator from devices around an operator;

estimating a distraction level from the distraction-correlated indicator information; and

producing an output indicative of the distraction level in order to facilitate a threat assessment decision,

wherein the means for producing an output is configured to produce an output that ensures that when the distraction of the operator is high, the threat assessment decision is made conservatively,

wherein the means for receiving distraction-correlated indicator information is configured for receiving from at least one device selected from a group comprising vision-based sensing systems, range-finding systems, and operator-manipulated devices,

wherein the means for estimating a distraction level further comprises;

means for grouping the distraction-correlated indicator information into complex task types comprising sets of related activities, including at least a first activity and a most recent activity;

means for determining an elapsed time since a start of the first activity in a complex task;

means for determining a delay time since the most recent activity in the complex task;

means for comparing the delay time since the most recent activity with a minimum task quiescent period, and when the delay time exceeds the minimum task quiescent period, resetting the elapsed time and the delay time; and

means for, during the performance of a complex task, correlating a type of the complex task, and the elapsed time of the complex task with the distraction-correlated indicator information in order to produce the output for facilitating the threat assessment decision.

28. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 27, wherein the means for receiving is configured to receive distraction-correlated indicator information including a duration of a current activity.

29. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 28, wherein the means for correlating is configured to operate by use of a controller selected from the group consisting of fuzzy rule-based controllers and rule-based controllers.

30. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 29, wherein the means for receiving distraction-correlated indicator information is configured to receive distraction-correlated indicator information that is based on secondary activities performed by the operator of a vehicle.

31. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 30, further comprising, on the computer-readable medium, means for adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

32. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 31, wherein the means for adjusting the operational parameters is configured to adjust collision warning system parameters.

33. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 27, wherein the means for receiving distraction-correlated indicator information is configured to receive distraction-correlated indicator information based on secondary activities performed by the operator of equipment selected from a group consisting of manufacturing equipment and process control equipment.

34. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 33, further comprising, on the computer-readable medium, means for adjusting operational parameters of the equipment to accommodate the operator'"'"'s distraction.

35. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 27, wherein the means for receiving distraction-correlated indicator information is configured to receive distraction-correlated indicator information based on secondary activities performed by the operator of a vehicle.

36. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 35, further comprising, on the computer-readable medium, means for adjusting operational parameters of the vehicle to accommodate the operator'"'"'s distraction.

37. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 36, wherein the means for adjusting the operational parameters is configured to adjust collision warning system parameters.

38. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 27, wherein in the means for correlating is configured to operate by use of a controller selected from the group consisting of fuzzy rule-based controllers and rule-based controllers.

39. A computer program product for calculating an indicator of operator distraction for an equipment operator as set forth in claim 27, further comprising, on the computer-readable medium, a means for producing a second output including a confidence level of the output that is indicative of the distraction level for facilitating a threat assessment decision.