Automatic speech recognition system and method for aircraft

• US 7,415,326 B2
• Filed: 06/23/2006
• Issued: 08/19/2008
• Est. Priority Date: 06/09/2006
• Status: Active Grant

• Current Assignee: Garmin International, Inc. (Garmin Limited)
• Original Assignee: Garmin International, Inc. (Garmin Limited)
• Inventors: Sherwood, Charles Gregory, Komer, Joseph L., Gepner, Joseph E.
• Primary Examiner(s): Camby; Richard M.
• Application Number:
  US11/426,220
• Publication Number:
  US 20070288129A1
• Time in Patent Office: 788 Days
• Field of Search: 701/1, 701 3- 18, 701/23, 701/36, 701/27, 704/275, 704/235, 704/270, 704/240, 704/256, 727/91, 727/88, 728/34, 728/620.7
• US Class Current: 701/3
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/065 Navigation or guidance aids, e.g. for taxiing or rolling
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A system and method which implement automatic speech recognition (ASR) and text-to-speech (TTS) programs to permit pilots, co-pilots, and other persons to more quickly and easily perform control and monitoring tasks on aircraft. The system may be used to automatically change the frequency of an aircraft radio when a pilot or co-pilot is instructed to do so by ATC.

Claims

1. A method of controlling functions of an aircraft, the method comprising the steps of:

receiving a command from a first person on the aircraft which relates to a request for a first function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the first function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the first person has authority to request the first function; and

if the first person does have authority, automatically performing the first function.

2. The method as set forth in claim 1, further including the steps of:

receiving a command from a second person on the aircraft which relates to a request for a second function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the second function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the second person has authority to request the second function; and

if the second person does have authority, automatically performing the desired function.

3. The method as set forth in claim 1, wherein the first person is a pilot or co-pilot and the first function is selected from the group consisting of:

changing a frequency of a radio on the aircraft;

setting a heading of the aircraft;

setting an altitude of the aircraft;

setting a holding pattern of the aircraft;

alerting an Expect Further Clearance instruction;

configuring an auto pilot of the aircraft;

performing a checklist;

setting an altimeter setting of the aircraft;

setting an approach of the aircraft;

setting an air speed of the aircraft;

setting or changing a flight plan for the aircraft;

drawing a VFR approach of the aircraft;

setting a barometric pressure correction setting of the aircraft; and

changing a navigation setting of the aircraft.

4. The method as set forth in claim 2, wherein the second person is a passenger of the aircraft and the second function is selected from the group consisting of selecting an entertainment source;

requesting flight arrival information;

initiating a phone call;

changing a fan or temperature setting;

initiating a communication with another person on the aircraft; and

requesting information about the aircraft or the state of the aircraft.

5. The method as set forth in claim 1, further including the step of prompting the first person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.

6. The method as set forth in claim 5, wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the first person.

7. The method as set forth in claim 6, wherein the prompting step further includes the step of requiring the first person to confirm by operating a switch two times in succession.

8. A method of controlling functions of an aircraft, the method comprising the steps of:

receiving a command from a first person on the aircraft which relates to a request for a first function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the first function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the first person has authority to request the first function;

if the first person does have authority, automatically performing the first function;

receiving a command from a second person on the aircraft which relates to a request for a second function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the second function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the second person has authority to request the second function; and

if the second person does have authority, automatically performing the desired function.

9. The method as set forth in claim 8, wherein the first person is a pilot or co-pilot and the first function is selected from the group consisting of:

changing a frequency of a radio on the aircraft;

setting a heading of the aircraft;

setting an altitude of the aircraft;

setting a holding pattern of the aircraft;

alerting an Expect Further Clearance instruction;

configuring an auto pilot of the aircraft;

performing a checklist;

setting an altimeter setting of the aircraft;

setting an approach of the aircraft;

setting an air speed of the aircraft;

setting or changing a flight plan for the aircraft;

drawing a VFR approach of the aircraft;

setting a barometric pressure correction setting of the aircraft; and

changing a navigation setting of the aircraft.

10. The method as set forth in claim 8, wherein the second person is a passenger of the aircraft and the second function is selected from the group consisting of selecting an entertainment source;

requesting flight arrival information;

initiating a phone call;

changing a fan or temperature setting;

initiating a communication with another person on the aircraft; and

requesting information about the aircraft or the state of the aircraft.

11. The method as set forth in claim 8, further including the step of prompting the first person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function.

12. The method as set forth in claim 11, wherein the prompting step includes the steps of converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the first person.

13. The method as set forth in claim 12, wherein the prompting step further includes the step of requiring the first person to confirm by operating a switch two times in succession.

14. A method of controlling functions of an aircraft, the method comprising the steps of:

receiving a command from a first person on the aircraft which relates to a request for a first function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the first function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the first person has authority to request the first function;

prompting the first person to confirm that the word or phrase recognized by the speech recognition program does in fact correspond to the desired function, wherein the prompting includes converting the recognized word or phrase to speech with a text-to-speech program and delivering the speech to the first person and requiring the first person to confirm by operating a switch two times in succession; and

if the first person does have authority, automatically performing the first function.

15. The method as set forth in claim 14, further including the steps of:

receiving a command from a second person on the aircraft which relates to a request for a second function;

using a speech recognition program to analyze at least a portion of the verbal command to recognize a word or phrase corresponding to the second function;

comparing the recognized word or phrase to a database of known words or phrases to find a match;

determining if the second person has authority to request the second function; and

if the second person does have authority, automatically performing the desired function.

16. The method as set forth in claim 15, wherein the second person is a passenger of the aircraft and the second function is selected from the group consisting of selecting an entertainment source;

requesting flight arrival information;

initiating a phone call;

changing a fan or temperature setting;

initiating a communication with another person on the aircraft; and

requesting information about the aircraft or the state of the aircraft.

17. The method as set forth in claim 14, wherein the first person is a pilot or co-pilot and the first function is selected from the group consisting of:

changing a frequency of a radio on the aircraft;

setting a heading of the aircraft;

setting an altitude of the aircraft;

setting a holding pattern of the aircraft;

alerting an Expect Further Clearance instruction;

configuring an auto pilot of the aircraft;

performing a checklist;

setting an altimeter setting of the aircraft;

setting an approach of the aircraft;

setting an air speed of the aircraft;

setting or changing a flight plan for the aircraft;

drawing a VFR approach of the aircraft;

setting a barometric pressure correction setting of the aircraft; and

changing a navigation setting of the aircraft.