Methods for evaluating human performance in aviation

• US 10,102,773 B2
• Filed: 10/06/2015
• Issued: 10/16/2018
• Est. Priority Date: 04/23/2012
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Towers, John, Thaheld, Johann F., Perry, Nathan C.
• Primary Examiner(s): Musselman, Timothy A
• Application Number:
  US14/875,727
• Publication Number:
  US 20160027336A1
• Time in Patent Office: 1,106 Days
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G09B 19/14 Traffic procedures, e.g. traffic regulations
• CPC Class Codes: G09B 19/165 Control of aircraft
• CPC Class Codes: G09B 9/08 for teaching control of aircraft, e.g. Link trainer
• CPC Class Codes: G09B 9/10 with simulated flight- or engine-generated force being applied to aircraft occupant G09B9/28 takes precedence

Abstract

An aviation performance evaluation methodology that can be implemented in various ways depending on the applications of interest. Baseline standards for expected performance are stored in one or more databases. One database may contain performance parameters and another database may contain baseline standards such as expert gaze data. Real-time actual performance data is acquired using an eye tracker system comprising at least one video camera, at least one infrared light source, and a computer system which receives image data from the video camera(s). More specifically, the actual and expected performance data are input to a computer system that is programmed to analyze the actual performance based on a comparison of the actual and expected performance data. Based on the results of the comparative analysis, context-adjusted inferences can be made regarding performance, adopted strategies, gaze scan quality, alertness or distraction, situational awareness, and workload.

Claims

1. A system for identifying a pilot occupying a pilot seat on an aircraft, comprising:

a database storing files of image data representing respective images of faces of authorized pilots;

a camera installed on a flight deck such that a field of view of the camera will include a face of a person occupying a pilot seat on the aircraft;

a first processor programmed to receive image data from said camera representing an image of the face of the person occupying the pilot seat, compare the image data from the camera to the image data in the files of image data stored in the database, and generate either a first signal if the acquired image data matches image data in one of the stored files of image data or a second signal different than the first signal if the acquired image data does not match image data in any one of the stored files of image data;

a second processor operatively coupled to receive signals from said first processor;

a pilot flight control which is operable by a pilot to output flight control signals;

an autopilot system which is activatable by said second processor to output flight control signals;

a flight control computer programmed to control flight of the aircraft in response to receipt of flight control signals; and

switches controlled by said second processor, wherein said switches are configured and controlled so that said flight control computer receives flight control signals from said autopilot system and does not receive flight control signals from said pilot flight control in response to receipt of said second signal by said second processor from said first processor.

2. The system as recited in claim 1, wherein said computing device and said database are located onboard the aircraft.

3. The system as recited in claim 1, wherein said computing device and said database are located on the ground.

4. A method for evaluating pilot performance during a first flight of an aircraft, comprising:

using an eye tracker device, monitoring the pilot'"'"'s eyes during the first flight;

measuring a blink reflex of the pilot'"'"'s eye pupil during the first flight;

storing blink reflex data in a data storage device onboard the aircraft during the first flight;

retrieving the stored blink reflex data from the data storage device after the first flight;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data;

assessing pilot fatigue based on results of the comparative analysis comparing the retrieved blink reflex with baseline standard data, wherein pilot fatigue is assessed at a pilot monitoring and control center;

sending results of the assessment of pilot fatigue to a scheduler at an airline control center;

determining that the pilot is scheduled to pilot a second flight; and

not allowing the pilot to pilot the second flight if the assessment of pilot fatigue following the first flight indicates that the pilot is too fatigued to safely pilot an aircraft.

5. The method as recited in claim 4, further comprising:

measuring a pupil diameter of the pilot'"'"'s eye pupil during the flight;

storing pupil diameter data in a data storage device onboard the aircraft during the flight;

retrieving the stored pupil diameter data from the data storage device after the flight;

performing a comparative analysis comparing the retrieved pupil diameter data with baseline standard data; and

assessing pilot cognitive workload based on results of the comparative analysis comparing the retrieved pupil diameter data with baseline standard data.