Methods for Evaluating Human Performance in Aviation

• US 20160027336A1
• Filed: 10/06/2015
• Published: 01/28/2016
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Towers, John, Thaheld, Johann F., Perry, Nathan C.
• Granted Patent: US 10,102,773 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G09B 19/14 Traffic procedures, e.g. traffic regulations
• CPC Class Codes: G09B 19/165 Control of aircraft
• CPC Class Codes: G09B 9/08 for teaching control of aircraft, e.g. Link trainer
• CPC Class Codes: G09B 9/10 with simulated flight- or engine-generated force being applied to aircraft occupant G09B9/28 takes precedence

Abstract

An aviation performance evaluation methodology that can be implemented in various ways depending on the applications of interest. Baseline standards for expected performance are stored in one or more databases. One database may contain performance parameters and another database may contain baseline standards such as expert gaze data. Real-time actual performance data is acquired using an eye tracker system comprising at least one video camera, at least one infrared light source, and a computer system which receives image data from the video camera(s). More specifically, the actual and expected performance data are input to a computer system that is programmed to analyze the actual performance based on a comparison of the actual and expected performance data. Based on the results of the comparative analysis, context-adjusted inferences can be made regarding performance, adopted strategies, gaze scan quality, alertness or distraction, situational awareness, and workload.

Claims

1. A method for recording pilot performance during operation of an aircraft, comprising:

using an eye tracker device, monitoring a pilot'"'"'s gaze during operation of the aircraft;

detecting a gaze location where the pilot'"'"'s gaze intersects an instrument panel or a flight deck window of the aircraft during operation of the aircraft; and

storing gaze location data in a data storage device onboard the aircraft during operation of the aircraft.

2. The method as recited in claim 1, wherein the data storage device is a flight data recorder.

3. The method as recited in claim 1, further comprising:

retrieving stored gaze location data from the data storage device;

performing a comparative analysis comparing the retrieved gaze location data with baseline standard data; and

assessing pilot performance based on results of the comparative analysis comparing the retrieved gaze location data with baseline standard data.

4. The method as recited in claim 1, further comprising:

measuring the pilot'"'"'s eye pupil diameter during operation of the aircraft; and

storing pupil diameter data in the data storage device during operation of the aircraft.

5. The method as recited in claim 4, further comprising:

retrieving stored pupil diameter data from the data storage device;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data; and

assessing pilot cognitive workload based on results of the comparative analysis comparing the retrieved pupil diameter data with baseline standard data.

6. The method as recited in claim 1, further comprising:

measuring the pilot'"'"'s blink reflex during operation of the aircraft; and

storing blink reflex data in the data storage device during operation of the aircraft.

7. The method as recited in claim 6, further comprising:

retrieving stored blink reflex data from the data storage device;

performing a comparative analysis comparing the retrieved blink reflex data with baseline standard data; and

assessing pilot fatigue based on results of the comparative analysis comparing the retrieved blink reflex data with baseline standard data.

8. A method for identifying a pilot occupying a pilot seat on an aircraft, comprising:

storing files of image data representing respective images of faces of authorized pilots in a database;

placing a camera on a flight deck such that a field of view of the camera will include a face of a person occupying a pilot seat on the aircraft;

using the camera to acquire image data representing an image of the face of the person occupying the pilot seat;

storing the acquired image data in memory onboard the aircraft;

comparing the acquired image data to the stored image data; and

generating a first signal if the acquired image data matches image data in one of the stored files of image data or generating a second signal different than the first signal if the acquired image data does not match image data in any one of the stored files of image data.

9. The method as recited in claim 8, further comprising disabling pilot flight control onboard the aircraft in response to generation of the second signal.

10. A system for identifying a pilot occupying a pilot seat on an aircraft, comprising:

a database storing files of image data representing respective images of faces of authorized pilots;

a camera installed on a flight deck such that a field of view of the camera will include a face of a person occupying a pilot seat on the aircraft;

a computing device programmed to receive image data from said camera, compare the image data from the camera to the image data in the files of image data stored in the database, and generate either a first signal if the acquired image data matches image data in one of the stored files of image data or a second signal different than the first signal if the acquired image data does not match image data in any one of the stored files of image data; and

means for disabling pilot flight control onboard the aircraft in response to generation of the second signal.

11. The system as recited in claim 10, wherein said computing device and said database are located onboard the aircraft.

12. The system as recited in claim 10, wherein said computing device and said database are located on the ground.

13. A method for evaluating pilot performance during a flight of an aircraft, comprising:

using an eye tracker device, monitoring the pilot'"'"'s eyes during the flight;

measuring a blink reflex of the pilot'"'"'s eye pupil during the flight;

storing blink reflex data in a data storage device onboard the aircraft during the flight;

retrieving the stored blink reflex data from the data storage device after the flight;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data; and

assessing pilot fatigue based on results of the comparative analysis comparing the retrieved blink reflex with baseline standard data.

14. The method as recited in claim 13, further comprising:

measuring a pupil diameter of the pilot'"'"'s eye pupil during the flight;

storing pupil diameter data in a data storage device onboard the aircraft during the flight;

retrieving the stored pupil diameter data from the data storage device after the flight;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data; and

assessing pilot cognitive workload based on results of the comparative analysis comparing the retrieved pupil diameter data with baseline standard data.

15. The method as recited in claim 13, further comprising scheduling the pilot'"'"'s next assignment taking into account the assessment of pilot cognitive workload.

16. A method for evaluating system operator performance during operation of a system, comprising:

using an eye tracker device, monitoring a system operator'"'"'s gaze during operation of the system;

detecting a gaze location where the system operator'"'"'s gaze intersects an instrument panel or a display console during operation of the system performing a comparative analysis comparing the retrieved gaze location data with baseline standard data; and

assessing system operator performance based on results of the comparative analysis comparing the retrieved gaze location data with baseline standard data.

17. The method as recited in claim 16, further comprising:

measuring the system operator'"'"'s eye pupil diameter during operation of the system;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data; and

assessing system operator cognitive workload based on results of the comparative analysis comparing the retrieved pupil diameter data with baseline standard data.

18. The method as recited in claim 16, further comprising:

measuring the system operator'"'"'s blink reflex during operation of the system;

performing a comparative analysis comparing the retrieved blink reflex data with baseline standard data; and

assessing system operator fatigue based on results of the comparative analysis comparing the retrieved blink reflex data with baseline standard data.

19. The method as recited in claim 16, wherein the system operator is a pilot and the system is an aircraft in flight.

20. The method as recited in claim 16, wherein the system operator is an air traffic controller and the system is an air traffic management system.

21. The method as recited in claim 16, further comprising:

monitoring pilot manipulation of the flight deck instruments via the changing state of instrument variables; and

evaluating that activity relative to a current context, a baseline performance database, and system parameters.