Avionics text entry, cursor control, and display format selection via voice recognition
First Claim
1. A method, comprising:
- recognizing, via an eye tracking system comprising an eye tracking system processor, a beginning eye tracking command to begin outputting text data received from a voice recognition system implemented in an aircraft to a text buffer on a display based on a current location of a pilot'"'"'s gaze, wherein the text buffer is implemented as at least one of a portion of a cockpit display of the aircraft or a display implemented on a keypad of the aircraft;
recognizing, via the voice recognition system, pilot speech as the text data;
outputting, via the eye tracking system, the text data to the text buffer for graphical presentation to a pilot of the aircraft, wherein the text buffer is configured to temporarily display the text data as textual content to the pilot at least until a destination computing device is selected by the pilot;
detecting, via the voice recognition system, an end command to end outputting the text data received from the voice recognition system to the text buffer;
receiving a confirmation input from the pilot, the confirmation input indicating that the pilot has confirmed accuracy of the text data of the text buffer;
receiving a destination selection from the pilot, the destination selection indicating the destination computing device selected by the pilot for the text data of the text buffer;
outputting the text data of the text buffer to the destination computing device selected by the pilot, the destination computing device including a processor configured to utilize the text data to execute instructions of aircraft function software to perform one or more aircraft function operations, wherein the destination computing device selected by the pilot is a flight management system (FMS) implemented in the aircraft, a weather radar system implemented in the aircraft, an attitude and heading reference system (AHRS) implemented in the aircraft, or a traffic collision avoidance system (TCAS) implemented in the aircraft;
utilizing, by the processor of the destination computing device, the text data to execute the instructions of the aircraft function software to perform the one or more aircraft function operations; and
performing a cursor control operation on a graphical user interface (GUI) of at least one cockpit display of the aircraft, wherein performing the cursor control operation comprises;
recognizing, via the voice recognition system, a cursor control keyword configured to indicate that a voice recognition sequence is for performing the cursor control operation to move a cursor from a current position to a new position;
recognizing, via the voice recognition system, at least two move keywords configured to indicate where to move the cursor; and
performing one or more cursor control operations to move the cursor of the GUI from the current position to a second position based at least on the at least two move keywords.
1 Assignment
0 Petitions
Accused Products
Abstract
A method includes detecting an initiation command to begin outputting text data received from a voice recognition system to a text buffer of an aircraft. The method includes recognizing user speech as the text data and outputting the text data to the text buffer for presentation to a user. The method further includes detecting an end command to end outputting the text data received from the voice recognition system to the text buffer. The method also includes receiving a confirmation input from the user, the confirmation input indicating that the user has confirmed accuracy of the text data of the text buffer. The method additionally includes receiving a destination selection from the user, the destination selection indicating a destination selected by the user for the text data of the text buffer. The method further includes outputting the text data of the text buffer to the destination selected by the user.
-
Citations
12 Claims
-
1. A method, comprising:
-
recognizing, via an eye tracking system comprising an eye tracking system processor, a beginning eye tracking command to begin outputting text data received from a voice recognition system implemented in an aircraft to a text buffer on a display based on a current location of a pilot'"'"'s gaze, wherein the text buffer is implemented as at least one of a portion of a cockpit display of the aircraft or a display implemented on a keypad of the aircraft; recognizing, via the voice recognition system, pilot speech as the text data; outputting, via the eye tracking system, the text data to the text buffer for graphical presentation to a pilot of the aircraft, wherein the text buffer is configured to temporarily display the text data as textual content to the pilot at least until a destination computing device is selected by the pilot; detecting, via the voice recognition system, an end command to end outputting the text data received from the voice recognition system to the text buffer; receiving a confirmation input from the pilot, the confirmation input indicating that the pilot has confirmed accuracy of the text data of the text buffer; receiving a destination selection from the pilot, the destination selection indicating the destination computing device selected by the pilot for the text data of the text buffer; outputting the text data of the text buffer to the destination computing device selected by the pilot, the destination computing device including a processor configured to utilize the text data to execute instructions of aircraft function software to perform one or more aircraft function operations, wherein the destination computing device selected by the pilot is a flight management system (FMS) implemented in the aircraft, a weather radar system implemented in the aircraft, an attitude and heading reference system (AHRS) implemented in the aircraft, or a traffic collision avoidance system (TCAS) implemented in the aircraft; utilizing, by the processor of the destination computing device, the text data to execute the instructions of the aircraft function software to perform the one or more aircraft function operations; and performing a cursor control operation on a graphical user interface (GUI) of at least one cockpit display of the aircraft, wherein performing the cursor control operation comprises; recognizing, via the voice recognition system, a cursor control keyword configured to indicate that a voice recognition sequence is for performing the cursor control operation to move a cursor from a current position to a new position; recognizing, via the voice recognition system, at least two move keywords configured to indicate where to move the cursor; and performing one or more cursor control operations to move the cursor of the GUI from the current position to a second position based at least on the at least two move keywords. - View Dependent Claims (2, 3, 4, 5, 6, 8, 9, 10, 11, 12)
-
-
7. A method for selecting a cockpit display format of a graphical user interface (GUI) of at least two cockpit displays of an aircraft, comprising:
-
receiving a command to initiate a voice recognition sequence; recognizing, via a voice recognition system implemented in an aircraft, a cockpit display format keyword configured to indicate that the voice recognition sequence is for selecting the cockpit display format of a GUI of at least two cockpit displays of the aircraft; recognizing a targeted cockpit display of the at least two cockpit displays for the cockpit display format, wherein recognizing the targeted cockpit display of the at least two cockpit displays for the cockpit display format further comprises; recognizing, via the voice recognition system, a cockpit display target keyword configured to indicate the targeted cockpit display of the at least two cockpit displays for the cockpit display format; and recognizing, via an eye tracking system, an eye tracking cockpit display target command configured to indicate the targeted cockpit display of the at least two cockpit displays for the display format; recognizing, via the voice recognition system, a size keyword configured to indicate a size to make a window to display on the targeted cockpit display; recognizing, via the voice recognition system, a content keyword configured to indicate content to display in the window on the targeted cockpit display; performing a cursor control operation on the GUI, wherein performing the cursor control operation comprises; recognizing, via the voice recognition system, a cursor control keyword configured to indicate that a voice recognition sequence is for performing the cursor control operation to move a cursor from a current position to a new position; recognizing, via the voice recognition system, at least one move keyword configured to indicate where to move the cursor; and performing one or more cursor control operations to move the cursor of the GUI from the current position to a second position based at least on the at least one move keyword; receiving a command to conclude the voice recognition sequence for selecting the cockpit display format; and performing one or more cockpit display format operations to generate and output GUI data to the targeted cockpit display of the at least two cockpit displays of the aircraft, wherein the GUI data is generated based at least on the content to display, the size to make the window, and the targeted cockpit display, wherein the content to display includes at least one of map content or flight checklist content.
-
Specification