Automatic speech recognition system and method for aircraft

• US 7,881,832 B2
• Filed: 07/13/2006
• Issued: 02/01/2011
• Est. Priority Date: 06/09/2006
• Status: Active Grant

• Current Assignee: Garmin International, Inc. (Garmin Limited)
• Original Assignee: Garmin International, Inc. (Garmin Limited)
• Inventors: Sherwood, Charles Gregory, Komer, Joseph L., Gepner, Joseph E.
• Primary Examiner(s): Camby; Richard M.
• Application Number:
  US11/457,392
• Publication Number:
  US 20100030400A1
• Time in Patent Office: 1,664 Days
• Field of Search: 701 3- 14, 701/36, 244/75.1, 244220-222
• US Class Current: 701/3
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/065 Navigation or guidance aids, e.g. for taxiing or rolling
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A system and method which implement automatic speech recognition (ASR) and text-to-speech (TTS) programs to permit pilots, co-pilots, and other persons to more quickly and easily perform control and monitoring tasks on aircraft. The system may be used to automatically change the frequency of an aircraft radio when a pilot or co-pilot is instructed to do so by ATC.

Claims

1. A method of controlling functions of an aircraft, the method comprising the steps of:

initializing a speech recognition program;

receiving a keyword from a person on the aircraft;

providing a keyword confirmation if the keyword is recognized;

receiving a command from the person which relates to a request for a function;

using the speech recognition program to analyze at least a portion of the command to recognize a word or phrase corresponding to the function;

providing a command confirmation if the command is recognized; and

automatically performing the function.

2. The method as set forth in claim 1, wherein the person is a pilot of the aircraft and the function is selected from the group consisting of:

changing a frequency of a radio on the aircraft;

setting a heading of the aircraft;

setting an altitude of the aircraft;

setting a holding pattern of the aircraft;

alerting an Expect Further Clearance instruction;

configuring an auto pilot of the aircraft;

performing a checklist;

setting an altimeter setting of the aircraft;

setting an approach of the aircraft;

setting an air speed of the aircraft;

setting or changing a flight plan for the aircraft;

drawing a VFR approach of the aircraft;

setting a barometric pressure correction setting of the aircraft; and

changing a navigation setting of the aircraft.

3. The method as set forth in claim 1, further including the step of prompting the person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.

4. The method as set forth in claim 3, wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the person.

5. The method as set forth in claim 1, wherein the keyword and command are received with a microphone positioned in a cockpit of the aircraft.

6. The method as set forth in claim 5, wherein the providing steps are performed with a speaker associated specifically with the microphone.

7. The method as set forth in claim 6, wherein the microphone and speaker are part of a headset worn by a pilot of the aircraft.

8. The method as set forth in claim 1, wherein the initializing step is triggered by an audio panel of the aircraft breaking squelch.

9. The method as set forth in claim 8, wherein the audio panel delays the keyword while the audio panel is in the act of breaking squelch.

10. The method as set forth in claim 8, wherein the audio panel monitors a background noise before breaking squelch and subtracts the background noise after breaking squelch.

11. The method as set forth in claim 1, wherein before receiving the keyword, the speech recognition program operates with a limited grammar.

12. The method as set forth in claim 11, wherein after receiving the keyword and before receiving the command, the speech recognition program switches from the limited grammar to a fuller grammar.

13. The method as set forth in claim 1, wherein before receiving the keyword, the speech recognition program operates with a short trailing silence.

14. The method as set forth in claim 13, wherein after receiving the keyword and before receiving the command, the speech recognition program switches from the short trailing silence to a long trailing silence.

18. The method as set forth in claim 3, wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the person.

15. A method of controlling functions of an aircraft, the method comprising the steps of:

initializing a speech recognition program with a first grammar and a first trailing silence;

receiving a keyword from a person on the aircraft;

providing a keyword confirmation and reconfiguring the speech recognition program to operate with a second grammar and a second trailing silence if the keyword is recognized;

receiving a command from the person which relates to a request for a function;

using the speech recognition program to analyze at least a portion of the command to recognize a word or phrase corresponding to the function;

providing a command confirmation if the command is recognized; and

automatically performing the function.

16. The method as set forth in claim 15, wherein the person is a pilot of the aircraft and the function is selected from the group consisting of:

changing a frequency of a radio on the aircraft;

setting a heading of the aircraft;

setting an altitude of the aircraft;

setting a holding pattern of the aircraft;

alerting an Expect Further Clearance instruction;

configuring an auto pilot of the aircraft;

performing a checklist;

setting an altimeter setting of the aircraft;

setting an approach of the aircraft;

setting an air speed of the aircraft;

setting or changing a flight plan for the aircraft;

drawing a VFR approach of the aircraft;

setting a barometric pressure correction setting of the aircraft; and

changing a navigation setting of the aircraft.

17. The method as set forth in claim 15, further including the step of prompting the person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.

19. The method as set forth in claim 15, wherein the initializing step is triggered by an audio panel of the aircraft breaking squelch.

20. The method as set forth in claim 19, wherein the audio panel

before breaking squelch, monitors a background noise, and

after breaking squelch, subtracts the background noise and delays the keyword.