Methods and apparatus for post-processing speech recognition results of received radio voice messages onboard an aircraft

• US 10,157,616 B2
• Filed: 12/19/2016
• Issued: 12/18/2018
• Est. Priority Date: 12/19/2016
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Agarwal, Jitender Kumar, Paulraj, Vasantha Selvi, Krishna, Kiran Gopala, Garg, Chaya, Burgin, Roger W., De Mers, Robert E
• Primary Examiner(s): Zhu, Richard Z
• Application Number:
  US15/382,939
• Publication Number:
  US 20180174588A1
• Time in Patent Office: 729 Days
• Field of Search: None
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G10L 25/69 for evaluating synthetic or decoded voice signals

Abstract

A method for displaying received radio voice messages onboard an aircraft is provided. The method post-processes, by at least one processor onboard the aircraft, a set of speech recognition (SR) hypothetical data to increase accuracy of an associated SR system, by: obtaining, by the at least one processor, secondary source data from a plurality of secondary sources; comparing, by the at least one processor, the set of SR hypothetical data to the secondary source data; and identifying, by the at least one processor, an aircraft tail number using the set of SR hypothetical data and the secondary source data; identifies, by the at least one processor, a subset of the received radio voice messages including the tail number; and presents, via a display device onboard the aircraft, the subset using distinguishing visual characteristics.

Claims

1. A method for displaying received radio voice messages onboard an aircraft, the method comprising:

receiving, via a radio onboard the aircraft, a plurality of ground control messages comprising speech data; and

processing the speech data using a speech recognition (SR) device onboard the aircraft, to generate SR results, by at least one processor onboard the aircraft;

comparing a set of SR hypothetical data to stored identifying information associated with the aircraft, the set of SR hypothetical data comprising the SR results for the plurality of ground control messages received onboard the aircraft;

determining a confidence level associated with accuracy of the set of SR hypothetical data;

when the confidence level is not greater than a predetermined threshold,

determining that one of the plurality of ground control messages comprises a received radio communication including a partial identifier for the aircraft; and

post-processing the set of speech recognition (SR) hypothetical data to increase accuracy of the SR device, by the at least one processor, wherein the post-processing is performed by;

obtaining, by the at least one processor, secondary source data from a plurality of secondary sources, wherein the secondary source data comprises at least one of airline databases including an airline code mapped to a corresponding airline name, Aircraft Situation Display to Industry (ASDI) derived historic data, a regulatory registration database, a manufacturer database, ASDI real-time data feeds to the aircraft, Automatic Dependent Surveillance-Broadcast (ADS-B) data received by the aircraft, Traffic Information Service-Broadcast (TIS-B) data, Aircraft Communications Addressing and Reporting System (ACARS) data, Notices to Airmen (NOTAM) data, and Automatic Terminal Information Service (ATIS) data;

comparing the set of SR hypothetical data including the partial identifier to a plurality of aircraft identifiers found in the secondary source data, by the at least one processor;

identifying, by the at least one processor, one of the plurality of aircraft identifiers using the set of SR hypothetical data and the secondary source data;

determining that the set of SR hypothetical data including the partial identifier indicates the aircraft, by the at least one processor; and

correcting the set of SR hypothetical data corrects the set of SR hypothetical data including the partial identifier, based on the secondary source data, to generate a corrected set of SR hypothetical data;

presenting transcriptions of the plurality of ground control messages received onboard the aircraft, wherein the plurality of ground control messages are directed to a set of aircraft including at least the aircraft;

identifying, by the at least one processor, a subset of the plurality of ground control messages including the one of the plurality of aircraft identifiers that indicates the aircraft; and

presenting, via a display device onboard the aircraft, the subset using distinguishing visual characteristics, such that the subset of the plurality of ground control messages applicable to the aircraft are visually distinguishable from a remainder of the plurality of ground control messages directed to other aircraft of the set of aircraft.

2. The method of claim 1, further comprising:

establishing, via a wireless communication device, a communication connection to a server, wherein the plurality of secondary sources comprises the server; and

obtaining the secondary source data via the communication connection.

3. The method of claim 2, wherein the server stores at least one database including the secondary source data;

and

wherein the at least one database comprises at least one of an airline database, registration database, a manufacturer database, and an aircraft situation display to industry (ASDI) historical database.

4. The method of claim 1, wherein the plurality of secondary sources comprises at least an aircraft onboard transponder;

wherein the method further comprises obtaining current aircraft traffic information via the aircraft transponder; and

wherein the secondary source data comprises the current aircraft traffic information.

5. The method of claim 4, wherein the aircraft transponder comprises an Automatic Dependent Surveillance-Broadcast (ADS-B) device.

6. A system for displaying radio voice messages received onboard an aircraft, the system comprising:

system memory;

an aircraft onboard radio, configured to receive the radio voice messages onboard the aircraft;

a display device, configured to present transcriptions of the radio voice messages received onboard the aircraft; and

at least one processor, communicatively coupled to the system memory, the aircraft onboard radio, and the display device, the at least one processor configured to;

receive a plurality of ground control messages comprising speech data via the aircraft onboard radio, wherein the radio voice messages comprise the plurality of ground control messages;

process the speech data using a speech recognition (SR) device onboard the aircraft, to generate SR results;

compare a set of SR hypothetical data to stored identifying information associated with the aircraft, the set of SR hypothetical data comprising the SR results for the plurality of ground control messages received onboard the aircraft;

determine a confidence level associated with accuracy of the set of SR hypothetical data;

when the confidence level is not greater than a predetermined threshold,

determine that one of the plurality of ground control messages comprises a received radio communication including a partial identifier for the aircraft; and

perform post-processing for the set of speech recognition (SR) hypothetical data to increase accuracy of the SR device, by;

obtaining secondary source data from a plurality of secondary sources, wherein the secondary source data comprises at least one of airline databases including an airline code mapped to a corresponding airline name, Aircraft Situation Display to Industry (ASDI) derived historic data, a regulatory registration database, a manufacturer database, ASDI real-time data feeds to the aircraft, Automatic Dependent Surveillance-Broadcast (ADS-B) data received by the aircraft, Traffic Information Service-Broadcast (TIS-B) data, Aircraft Communications Addressing and Reporting System (ACARS) data, Notices to Airmen (NOTAM) data, and Automatic Terminal Information Service (ATIS) data;

comparing the set of SR hypothetical data including the partial identifier to a plurality of aircraft identifiers found in the secondary source data;

identifying one of the plurality of aircraft identifiers using the set of SR hypothetical data and the secondary source data;

determining that the set of SR hypothetical data including the partial identifier indicates the aircraft; and

correcting the set of SR hypothetical data including the partial identifier, based on the secondary source data, to generate a corrected set of SR hypothetical data;

present transcriptions of the plurality of ground control messages received onboard the aircraft, wherein the plurality of ground control messages are directed to a set of aircraft including at least the aircraft;

identify a subset of the plurality of ground control messages including the one of the plurality of aircraft identifiers that indicates the aircraft; and

initiate presentation, via the display device, of the subset using distinguishing visual characteristics, such that the subset of the plurality of ground control messages applicable to the aircraft are visually distinguishable from a remainder of the plurality of ground control messages directed to other aircraft of the set of aircraft.

7. The system of claim 6, further comprising a wireless communication device communicatively coupled to the at least one processor, the wireless communication device configured to:

establish a communication connection to a server, wherein the plurality of secondary sources comprises the server; and

obtain the secondary source data via the communication connection.

8. The system of claim 7, wherein the server stores at least one database including the secondary source data;

and

wherein the at least one database comprises at least one of an airline database, registration database, a manufacturer database, and an aircraft situation display to industry (ASDI) historical database.

9. The system of claim 6, wherein the plurality of secondary sources comprises at least an aircraft onboard transponder;

wherein the at least one processor is further configured to obtain current aircraft traffic information via the aircraft transponder; and

wherein the secondary source data comprises the current aircraft traffic information.

10. A non-transitory, computer-readable medium containing instructions thereon, which, when executed by a processor, perform a method comprising:

receiving a radio communication onboard a first aircraft, the radio communication comprising a set of speech recognition data;

comparing the set of speech recognition data to a stored identifier for the first aircraft;

determining a confidence level associated with accuracy of the set of SR hypothetical data; and

when the confidence level is not greater than a predetermined threshold,

determining that the radio communication includes a partial identifier for the first aircraft; and

performing post-processing of the set of speech recognition data to increase accuracy of a speech recognition device onboard the first aircraft, by;

obtaining secondary source data associated with a plurality of aircraft comprising at least the first aircraft, wherein the secondary source data comprises at least one of airline databases including an airline code mapped to a corresponding airline name, Aircraft Situation Display to Industry (ASDI) derived historic data, a regulatory registration database, a manufacturer database, ASDI real-time data feeds to the aircraft, Automatic Dependent Surveillance-Broadcast (ADS-B) data received by the aircraft, Traffic Information Service-Broadcast (TIS-B) data, Aircraft Communications Addressing and Reporting System (ACARS) data, Notices to Airmen (NOTAM) data, and Automatic Terminal Information Service (ATIS) data;

comparing the speech recognition data including the partial identifier to a plurality of aircraft identifiers in the secondary source data;

identifying one of the plurality of aircraft identifiers that includes the partial identifier, based on the comparing;

determining that the radio communication is associated with the first aircraft, based on identifying the partial identifier; and

correcting the speech recognition data including the partial identifier, based on the secondary source data, to generate a corrected set of speech recognition data;

presenting transcriptions of a plurality of radio communications received onboard the aircraft, wherein the plurality of radio communications are directed to a set of aircraft including at least the first aircraft, and wherein the plurality of radio communications comprises the radio communication;

identifying a subset of the plurality of radio communications including the one of the plurality of aircraft identifiers that indicates the first aircraft; and

presenting, via a display device onboard the aircraft, a subset of the plurality of radio communications associated with the first aircraft using distinguishing visual characteristics, such that the subset of the plurality of radio communications applicable to the first aircraft are visually distinguishable from a remainder of the plurality of radio communications directed to other aircraft of the set of aircraft.

11. The non-transitory, computer-readable medium of claim 10, wherein the method further comprises:

establishing, via a wireless communication device, a communication connection to a server, wherein the plurality of secondary sources comprises the server; and

obtaining the secondary source data via the communication connection.

12. The non-transitory, computer-readable medium of claim 11, wherein the server stores at least one database including the secondary source data;

and

wherein the at least one database comprises at least one of an airline database, registration database, a manufacturer database, and an aircraft situation display to industry (ASDI) historical database.

13. The non-transitory, computer-readable medium of claim 10, wherein the plurality of secondary sources comprises at least an aircraft onboard transponder;

wherein the method further comprises obtaining current aircraft traffic information via the aircraft transponder; and

wherein the secondary source data comprises the current aircraft traffic information.