Speech recognition systems and methods for maintenance repair and overhaul

• US 10,199,041 B2
• Filed: 12/30/2014
• Issued: 02/05/2019
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Stepanski, Joe, Tussey, Lorene
• Primary Examiner(s): He, Jialong
• Application Number:
  US14/585,242
• Publication Number:
  US 20160189709A1
• Time in Patent Office: 1,498 Days
• Field of Search: None
• CPC Class Codes: B64F 5/40 Maintaining or repairing aircraft
• CPC Class Codes: B64F 5/60 Testing or inspecting aircraft components or systems
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

Methods and systems are provided for capturing information associated with a component of a system during a maintenance procedure. In one embodiment, a method includes: managing a dialog with a user via a wearable device based on a pre-defined dialog file, wherein the pre-defined dialog file is defined for at least one of a component and a procedure; receiving speech signals at the wearable device based on the dialog; processing the speech signals by the wearable device to identify component information; and transmitting the component information from the wearable device to a host component for use by a maintenance application. The managing, receiving, and transmitting are performed during a maintenance procedure.

Claims

1. A method of identifying information associated with one or more components of a system during a maintenance procedure, comprising:

using a wearable device by a user for management of a dialog wherein the dialog is managed based on a pre-defined dialog file which has been selected from a plurality of stored pre-defined dialog files wherein a selection of the pre-defined dialog is made by identifying information processed in the maintenance procedure performed by the user using the wearable device wherein a selected pre-defined dialog file is configured in first and second pre-defined file process flow wherein a first pre-defined file process flow according to a filling out of information of an information form during the maintenance procedure to identify information of a component, and in a second pre-defined file process flow to follow the accessibility of the information according to the maintenance procedure being performed on the component, the management of the dialog further comprising;

receiving speech signals at the wearable device from dialog of the user comprising;

information associated with one or more components for the maintenance procedure;

processing the speech signals of the dialog by speech recognition techniques at the wearable device to identify the information of a component comprising the steps of;

retrieving the pre-defined dialog file from the plurality of stored pre-defined dialog files based on the information of the component;

executing a set of instructions of the pre-defined dialog file to generate and process audio signals comprising the steps of;

requesting maintenance information from the user, confirming maintenance information spoken by the user, commanding an instruction to the user, and processing the maintenance information spoken which is in response by the user to generated audio signals;

transmitting the maintenance information from the wearable device to a host computer for use by a maintenance application;

receiving the maintenance information at the host computer;

providing the maintenance information to the maintenance application; and

populating fields of a form of the maintenance application with the maintenance information.

2. The method of claim 1, wherein the transmitting is performed automatically.

3. The method of claim 1, wherein the transmitting is performed upon completion of the dialog.

4. The method of claim 1, wherein the transmitting is performed upon receipt of a signal requesting to transmit.

5. A system of identifying information associated with a component of a system during a maintenance procedure, comprising:

a maintenance application of a host computer;

a wearable device in communication with the host computer, wherein the wearable device is configured to;

manage a dialog wherein the dialog is managed based on a pre-defined dialog file which has been selected from a plurality of stored pre-defined dialog files wherein a selection of the pre-defined dialog is made by identifying information processed in the maintenance procedure performed by a user using the wearable device wherein a selected pre-defined dialog file is configured in first and second pre-defined file process flow wherein a first pre-defined file process flow according to a filling out of information of an information form during the maintenance procedure to identify information of a component, and in a second pre-defined file process flow to follow the accessibility of the information according to the maintenance procedure being performed on the component, the wearable device to manage the dialog further configured to;

receive speech signals at the wearable device from dialog of the user comprising;

information associated with one or more components for the maintenance procedure;

process the speech signals of the dialog by speech recognition techniques at the wearable device based on information of the component comprising the steps to;

retrieve the pre-defined dialog file from the plurality of stored pre-defined dialog files based on the information of the component, and

execute a set of instructions of the pre-defined dialog file to generate and process audio signals comprising the steps of;

to request maintenance information from the user, to confirm maintenance information spoken by the user, to command an instruction to the user, and to process the maintenance information spoken which is in response by the user to generated audio signals; and

transmit the maintenance information to the host computer for use by the maintenance application;

wherein the maintenance application is configured to;

receive the maintenance information; and

populate fields of the information form of the maintenance application with the maintenance information.

6. The system of claim 5, wherein the wearable device transmits the maintenance information automatically.

7. The system of claim 5, the wearable device transmits the maintenance information upon completion of the dialog.

8. The system of claim 5, the wearable device transmits the maintenance information upon receipt of a signal requesting to transmit.