Intent managing system

• US 10,095,473 B2
• Filed: 11/03/2015
• Issued: 10/09/2018
• Est. Priority Date: 11/03/2015
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Lancaster, Jeff, De Mers, Robert E, Nelson, Erik T, Garg, Chaya
• Primary Examiner(s): LOWENBERGER, AARON J
• Application Number:
  US14/931,352
• Publication Number:
  US 20170123757A1
• Time in Patent Office: 1,071 Days
• CPC Class Codes: B60R 16/0373 Voice control in general G10L
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

An intent managing system and a method for operating the same are provided. The system, for example, may include, but is not limited to a processor communicatively coupled to an input system and a memory. The processor may be configured to receive a voice command, determine how many of a plurality of voice controllable systems utilize the voice command, automatically select one of the plurality of voice controllable systems, generate an indication of the selected one of the plurality of voice controllable systems, receive, from the at least one input system, confirmation of the selected one of the plurality of voice controllable systems, and execute the received voice command at the selected one of the plurality of voice controllable systems when the confirmation is received.

Claims

1. An intent managing system for an aircraft comprising a plurality of voice controllable systems, the intent managing system comprising:

at least one input system;

a memory configured to store valid voice commands for each of the plurality of voice controllable systems; and

a processor communicatively coupled to the at least one input system and the memory, the processor configured to;

receive a voice command from a user from the at least one input system;

determine how many of the plurality of voice controllable systems include the received voice command as a valid voice command;

select, when the received voice command is a valid voice command for only one of the plurality of voice controllable systems, the one of the plurality of voice controllable systems;

select, when the received voice command is a valid voice command for a plurality of the plurality of voice controllable systems, a most frequently selected one of the plurality of voice controllable systems by the user for a current phase of flight of the aircraft and a current status of the aircraft based upon a user profile and data from one or more of the plurality of voice controllable systems, the user profile indicating the most frequently selected one of the plurality of voice controllable systems for each phase of flight of the aircraft and the most frequently selected one of the plurality of voice controllable systems for each status of the aircraft;

generate at least one of a visual indication of the selected one of the plurality of voice controllable systems and an audio indication of the selected one of the plurality of voice controllable systems;

receive, from the at least one input system, confirmation of the selected one of the plurality of voice controllable systems; and

execute the received voice command at the selected one of the plurality of voice controllable systems when the confirmation is received.

2. The intent managing system of claim 1, wherein the at least one input system includes a camera, and the confirmation is a predetermined number of eye blinks.

3. The intent managing system of claim 1, wherein the at least one input system includes a camera, and the confirmation is a predetermined hand gesture.

4. The intent managing system of claim 1, wherein the at least one input system includes a camera, and the confirmation is a predetermined body shift.

5. The intent managing system of claim 1, wherein the at least one input system includes a camera, and the confirmation is a predetermined head shift.

6. The intent managing system of claim 1, wherein the at least one input system includes a camera, and the confirmation is a predetermined facial expression.

7. The intent managing system of claim 1, wherein the at least one input system includes at least one weight sensor, and the confirmation is a predetermined weight shift.

8. The intent managing system of claim 1, wherein the at least one input system includes at least one electromyography system, and the confirmation is a muscle movement.

9. The intent managing system of claim 1, wherein the user profile indicates a most frequently selected one of the plurality of voice controllable systems for each valid voice command, and the processor is further configured to select the one of the plurality of voice controllable systems based upon the most frequently selected one of the plurality of voice controllable systems for the received voice command.

10. The intent managing system of claim 9, wherein the data from one or more of the plurality of voice controllable systems includes one or more of the aircraft status, a navigation status, and voice controllable system activity and the user profile indicates a most frequently selected one of the plurality of voice controllable systems for each of the one or more of the aircraft status, the navigation status, and the voice controllable system activity.

11. A method for operating an intent managing system for an aircraft comprising a plurality of voice controllable systems, the method comprising:

receiving, by a processor, a voice command from a user from an input system;

determining, by the processor, how many of the plurality of voice controllable systems include the received voice command as a valid voice command;

selecting, by the processor, one of the plurality of voice controllable systems when the received voice command is a valid voice command for only the one of the plurality of voice controllable systems;

selecting, by the processor, a most frequently selected one of the plurality of voice controllable systems by the user for a current phase of flight of the aircraft and a current status of the aircraft based upon a user profile and data from one or more of the plurality of voice controllable systems when the received voice command is a valid voice command for a plurality of the plurality of voice controllable systems, the user profile indicating the most frequently selected one of the plurality of voice controllable systems for each phase of flight of the aircraft and the most frequently selected one of the plurality of voice controllable systems for each status of the aircraft;

generating, by the processor, at least one of a visual indication of the selected one of the plurality of voice controllable systems and an audio indication of the selected one of the plurality of voice controllable systems;

receiving, by the processor from the input system, confirmation of the selected one of the plurality of voice controllable systems; and

executing, by the processor, the received voice command at the selected one of the plurality of voice controllable systems when the confirmation is received.

12. The method of claim 11, wherein the input system includes a camera, and the confirmation is a predetermined number of eye blinks.

13. The method of claim 11, wherein the input system includes a camera, and the confirmation is a predetermined hand gesture.

14. The method of claim 11, wherein the input system includes a camera, and the confirmation is a predetermined body shift.

15. The method of claim 11, wherein the input system includes a camera, and the confirmation is a predetermined head shift.

16. The method of claim 11, wherein the input system includes a camera, and the confirmation is a predetermined facial expression.

17. The method of claim 11, wherein the input system includes at least one weight sensor, and the confirmation is a predetermined weight shift.

18. The method of claim 11, wherein the input system includes at least one electromyography system, and the confirmation is a muscle movement.

19. The method of claim 11, wherein the user profile indicates a most frequently selected one of the plurality of voice controllable systems for each valid voice command by a user, the method further comprising selecting, by the processor, the one of the plurality of voice controllable systems based upon the most frequently selected one of the plurality of voice controllable systems by the user for the received voice command.

20. The method of claim 19, wherein the data from one or more of the plurality of voice controllable systems includes one or more of the aircraft status, a navigation status, and voice controllable system activity, the method further comprising selecting, by the processor, the one of the plurality of voice controllable systems based upon the most frequently selected one of the plurality of voice controllable systems by the user for the aircraft status, the navigation status, and the voice controllable system activity.