Method and system for using combined voice and customized instructions to trigger vehicle reports

• US 9,947,315 B2
• Filed: 10/12/2015
• Issued: 04/17/2018
• Est. Priority Date: 10/12/2015
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Du, Homey, Zhang, Bin
• Primary Examiner(s): Thomas-Homescu, Anne L
• Application Number:
  US14/880,932
• Publication Number:
  US 20170103751A1
• Time in Patent Office: 918 Days
• CPC Class Codes: B64D 2045/0065 Black boxes, devices automatically broadcasting distress signals
• CPC Class Codes: G06F 16/635 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/02 Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/0816 Indicating performance data, e.g. occurrence of a malfunction
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/0056 in an emergency situation, e.g. hijacking
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 2015/088 Word spotting

Abstract

A method and system for an onboard reporting system capable of detecting keywords in voice data and considering the keywords in combination with respective predefined instructions is provided. The provided system uses, for each keyword, predefined instructions to validate the keyword prior to sending a report.

Claims

1. A method, executable by a processor, for sending a report, the method comprising:

receiving audio data from an audio input device;

converting the audio data into voice data;

obtaining keyword data from a database, wherein the keyword data comprises a plurality of keywords, each of the plurality of keywords being associated with respective instructions to validate the keyword;

processing the voice data and the keyword data to detect a first keyword in the voice data;

when the first keyword is detected, performing the steps of

(i) executing the associated instructions, wherein executing the associated instructions comprises polling avionics data and relevant sensors and subsystems,

(ii) responsive to executing the associated instructions, determining that the first keyword is validated, wherein validating the keyword is defined as determining, based on the polled avionics data, that an event corresponding to the keyword is happening at the time; and

(iii) responsive to determining that the first keyword is validated, automatically and without user input, sending the report.

2. The method of claim 1, further comprising:

obtaining the avionics data in accordance with the associated instructions, and the step of sending the report comprises sending the avionics data related to the keyword.

3. The method of claim 2, wherein determining whether the first keyword is validated comprises continuously repeating at least some of the associated instructions until a predetermined condition is met.

4. The method of claim 3, wherein the predetermined condition comprises a status of an avionics subsystem.

5. The method of claim 3, wherein the predetermined condition comprises a passage of an amount of time.

6. The method of claim 3, wherein the predetermined condition comprises completion of landing by the aircraft.

7. The method of claim 2, further comprising identifying the keyword as an immediate impact keyword or a continuous checking keyword.

8. The method of claim 7, wherein, when the keyword is identified as a continuous checking keyword, determining whether the keyword is validated comprises continuously repeating at least some of the associated instructions until a predetermined condition is met.

9. The method of claim 8, wherein the predetermined condition comprises a status of an avionics subsystem.

10. The method of claim 8, wherein the predetermined condition comprises a passage of an amount of time.

11. The method of claim 8, wherein the predetermined condition comprises completion of landing by the aircraft.

12. A system for sending a report from an aircraft to a ground station, the aircraft comprising an audio input device configured to provide audio data, the system comprising:

a database of keyword data, wherein the keyword data comprises a first keyword and associated instructions to validate the first keyword; and

a processor comprising a speech recognition product, coupled to the audio input device, and the database, the processor configured to

(i) receive audio data,

(ii) convert audio data into voice data,

(iii) obtain keyword data,

(iv) detect the first keyword in the voice data, and

in response to detecting the first keyword, (a) execute the associated instructions wherein executing the associated instructions comprises polling avionics data and relevant sensors and subsystems,

(b) responsive to executing the associated instructions, determine that the first keyword is validated, wherein determine that the first keyword is validated is defined as determining, based on the polled avionics data, that the an event corresponding to the keyword is happening at the time; and

(c) responsive to determining that the first keyword is validated automatically and without user input, send the report to the ground station.

13. The system of claim 12, wherein the first keyword is one of the set comprising:

hijack, stall, fire, ice, pull up, and altitude.

14. The system of claim 12,

wherein the processor is further configured to process the avionics data in accordance with the associated instructions.

15. The system of claim 14, wherein the source of avionics data comprises an onboard sensor or an aircraft subsystem.

16. The system of claim 12, wherein the processor is further configured to identify the first keyword as an immediate impact keyword or a continuous checking keyword.

17. The system of claim 16, wherein the processor is further configured to continuously repeat at least some of the associated instructions until a predetermined condition is met to determine whether the first keyword is validated, when the first keyword is identified as a continuous checking keyword.

18. The system of claim 12, wherein the first keyword is one of a plurality of keywords and wherein the keyword database comprises each of the plurality of keywords organized such that each keyword of the plurality of keywords is associated with a respective set of instructions sufficient to validate the keyword.