Methods and systems for managing speech recognition in a multi-speech system environment

• US 9,569,174 B2
• Filed: 07/08/2014
• Issued: 02/14/2017
• Est. Priority Date: 07/08/2014
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Rogers, William, Letsu-Dake, Emmanuel, Whitlow, Stephen
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US14/325,916
• Publication Number:
  US 20160011853A1
• Time in Patent Office: 952 Days
• Field of Search: 704/235, 704/246, 704/270, 704/270.1, 704/275
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology

Abstract

Methods and system are provided for managing speech processing in an environment having at least two speech enabled systems. In one embodiment, a method includes: recording first user data that indicates an action of a user; determining, by a processor, a selection of a first speech enabled system based on the recorded user data; and generating, by the processor, a signal to at least one of activate and deactivate speech processing based on the first speech enabled system.

Claims

1. A method performed by a computer processor for managing speech processing in an aircraft environment having at least two different speech enabled systems associated with the aircraft, comprising:

recording, by the computer processor, first user data that indicates an action of a user;

determining, by the computer processor, a selection of a vocabulary and a speech processing technique associated with a first speech enabled system of the at least two different speech enabled systems based on the recorded user data; and

generating, by the computer processor, a signal to at least one of activate and deactivate speech processing for the speech enabled system based on the vocabulary and the speech processing technique associated with the first speech enabled system.

2. The method of claim 1, wherein the action of the user includes a gesture of the user.

3. The method of claim 1, wherein the action of the user includes a gaze of the user.

4. The method of claim 1, wherein the action of the user includes a spoken command from the user.

5. The method of claim 1, wherein the signal activates speech processing by the first speech enabled system.

6. The method of claim 1, wherein the signal activates speech processing by a centralized speech processor using the vocabulary and the speech processing technique associated with the first speech enabled system.

7. The method of claim 1, further comprising recording second user data that indicates a second action of the user, and wherein the determining the selection is based on the first recorded user data and the second recorded user data.

8. The method of claim 7, wherein the action of the user indicates at least one of a gesture of the user, a gaze of the user, and a spoken command from the user, and wherein the second action of the user indicates at least one of a gesture of the user, a gaze of the user, and a spoken command from the user.

9. The method of claim 1, further comprising receiving user input data indicating to activate recording, and wherein the recording is performed based on the user input data.

10. The method of claim 1, wherein the recording is performed continuously.

11. A system for managing speech in an aircraft environment having at least two different speech enabled systems associated with the aircraft, comprising:

an input device that records first user data that indicates an action of a user; and

a computer processor that determines a selection of a vocabulary and a speech processing technique associated with a first speech enabled system of the at least two different speech enabled systems based on the recorded user data, and that generates a signal to at least one of activate and deactivate speech processing for the speech enabled system based on the vocabulary and the speech processing technique associated with the first speech enabled system.

12. The system of claim 11, wherein the action of the user includes a gesture of the user.

13. The system of claim 11, wherein the action of the user includes a gaze of the user.

14. The system of claim 11, wherein the action of the user includes a spoken command from the user.

15. The system of claim 11, wherein the signal activates speech processing by the speech enabled system.

16. The system of claim 11, wherein the signal activates speech processing by a centralized speech processor using the vocabulary and the speech processing technique associated with the speech enabled system.

17. The system of claim 11, further comprising a second input device that records second user data that indicates a second action of the user, and wherein the processor determines the selection based on the recorded user data and the recorded second user data.

18. The system of claim 17, wherein the action of the user indicates at least one of a gesture of the user, a gaze of the user, and a spoken command from the user, and wherein the second action of the user indicates at least one of a gesture of the user, a gaze of the user, and a spoken command from the user.

19. The system of claim 11, further comprising a third input device that generates user input data indicating to activate recording, and wherein the first input device records the user data based on the user input data.

20. The system of claim 11, wherein the input device records the user data continuously.