AUDIO COMMAND INTENT DETERMINATION SYSTEM AND METHOD

• US 20160004501A1
• Filed: 07/01/2014
• Published: 01/07/2016
• Est. Priority Date: 07/01/2014
• Status: Abandoned Application

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Kar, Satyanarayan, Mead, Stephen, Mazumdar, Anupam
• Application Number:
  US14/321,562
• Publication Number:
  US 20160004501A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B64D 11/00155 Individual entertainment or communication system remote controls therefor, located in or connected to seat components, e.g. to seat back or arm rest
• CPC Class Codes: B64D 11/0626 with individual temperature or ventilation control
• CPC Class Codes: B64D 2011/0053 Cabin passenger reading lights
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/27 characterised by the analysis technique
• CPC Class Codes: G10L 25/51 for comparison or discrimination

Abstract

Methods and apparatus are provided for generating aircraft cabin control commands from verbal speech onboard an aircraft. An audio command supplied to an audio input device is processed. Each word of the processed audio command is compared to words stored in a vocabulary map to determine a word type of each word. Each determined word type is processed to determine if an intent of the audio command is discernable. If the intent is discernable, an aircraft cabin control command is generated based on the discerned intent. If a partial intent is discernable, feedback is generated.

Claims

1. A method of generating aircraft cabin control commands from verbal speech onboard an aircraft, comprising the steps of:

processing an audio command supplied to an audio input device, the audio command including at least one word;

comparing each word of the processed audio command to words stored in a vocabulary map to determine a word type of each word, the vocabulary map comprising a predetermined set of word types; and

processing each determined word type to determine if an intent of the audio command is discernable;

if the intent is discernable, generating an aircraft cabin control command based on the discerned intent; and

generating feedback if no or only a partial intent of the audio command is discernable.

2. The method of claim 1, wherein the step of processing each determined word type to determine if the intent of the audio command is discernable comprises:

determining if the audio command includes at least a context word type and an action word type;

identifying an anchor node in a normalized intent rules tree structure that corresponds to the context word type;

determining if the action word type is associated with the anchor node and, if so, determining the intent therefrom.

3. The method of claim 2, wherein the normalized intent rules tree structure comprises:

a root node, the root node associated with the aircraft;

a plurality of context nodes, each context node corresponding to a context word type and serving as an anchor node that has a plurality of non-anchor nodes associated therewith,

wherein each non-anchor node corresponds to a word type that is not a context word type.

4. The method of claim 3, wherein each non-anchor node is one of at least an action node, a location node, a source node, a destination node, a unit node, and a value node.

5. The method of claim 3, wherein each anchor node and each non-anchor node comprises a set of attributes, each attribute representative of information present in words that correspond to each anchor node and each non-anchor node.

6. The method of claim 5, wherein the set of attributes comprises one or more of equivalent words, a command identification, a command mask value, a transform function, range values, and assistance media files.

7. The method of claim 1, wherein the step of processing the audio command comprises:

supplying the audio command to a speech recognizer;

implementing, in the speech recognizer, an N-best hypothesis algorithm to generate one or more words for each word of the audio command; and

hashing each of the one or more words generated by the N-best hypothesis generator to thereby generate a hash value for each of the one or more words.

8. The method of claim 1, further comprising:

generating an intent map for each word by representing each word as a plurality of bits, each bit representative of a different one of the predetermined number of word types.

9. The method of claim 1, wherein the predetermined set of word types comprises context words, action words, location words, source words, destination words, unit words, and value words.

10. A system for generating aircraft cabin control commands from verbal speech onboard an aircraft, the system comprising:

an audio input device adapted to receive an audio command and configured, upon receipt thereof, to supply speech signals representative thereof, the audio command including at least one word;

memory having a vocabulary map stored therein, the vocabulary map comprising a predetermined set of word types; and

a processor in operable communication with the audio input device and the memory, the processor coupled to receive the speech signals and configured, upon receipt thereof, to;

compare each word of the received audio command to words stored in the vocabulary map to determine a word type of each word,

determine, from each determined word type, if an intent of the audio command is discernable,

if the intent is discernable, generate an aircraft cabin control command based on the discerned intent, and

generate feedback if no or only a partial intent of the audio command is discernable.

11. The system of claim 10, wherein the processor is configured to determine if the intent of the audio command is discernable by:

determining if the audio command includes at least a context word type and an action word type;

identifying an anchor node in a normalized intent rules tree structure that corresponds to the context word type;

determining if the action word type is associated with the anchor node and, if so, determining the intent therefrom.

12. The system of claim 11, wherein the normalized intent rules tree structure comprises:

a root node, the root node associated with the aircraft;

a plurality of context nodes, each context node corresponding to a context word type and serving as an anchor node that has a plurality of non-anchor nodes associated therewith,

wherein each non-anchor node corresponds to a word type that is not a context word type.

13. system of claim 12, wherein each non-anchor node is one of at least an action node, a location node, a source node, a destination node, a unit node, and a value node.

14. The system of claim 12, wherein each anchor node and each non-anchor node comprises a set of attributes, each attribute representative of information present in words that correspond to each anchor node and each non-anchor node.

15. The system of claim 14, wherein the set of attributes comprises one or more of equivalent words, a command identification, a command mask value, a transform function, range values, and assistance media files.

16. The system of claim 10, wherein the processor comprises:

a speech recognizer adapted to receive the audio command, the speech recognizer configured to (i) supply implement an N-best hypothesis algorithm to generate one or more words for each word of the audio command and (ii) hash each of the one or more words generated by the N-best hypothesis generator to thereby generate a hash value for each of the one or more words.

17. The system of claim 10, wherein the processor is further configured to generate an intent map for each word by representing each word as a plurality of bits, each bit representative of a different one of the predetermined number of word types.

18. The system of claim 10, wherein the predetermined set of word types comprises context words, action words, location words, source words, destination words, unit words, and value words.