Gaze triggered voice recognition incorporating device velocity

• US 10,228,904 B2
• Filed: 11/12/2014
• Issued: 03/12/2019
• Est. Priority Date: 11/12/2014
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Raux, Antoine Roland
• Primary Examiner(s): Kazeminezhad, Farzad
• Application Number:
  US14/539,495
• Publication Number:
  US 20160132290A1
• Time in Patent Office: 1,581 Days
• Field of Search: 345173, 345156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/1208 resulting in improved quality of the output result, e.g. print layout, colours, workflows, print preview
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology

Abstract

One embodiment provides a method, involving: detecting, at an electronic device, a location of user gaze; activating, based on the location of the user gaze, a voice input module, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device; detecting, at the electronic device, a voice input; evaluating, using the voice input module, the voice input, and performing, based on evaluation of the voice input, at least one action. Other aspects are described and claimed.

Claims

1. A method, comprising:

detecting, at a display device of an electronic device, a location of user gaze;

activating, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

detecting, at the electronic device and after activation of the voice input module, a voice input; and

performing, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.

2. The method of claim 1, wherein the voice input module activation is triggered by the location of user gaze being focused on a characteristic selected from a group consisting of:

a predetermined location, an icon, an anthropomorphic agent, a user selected image, and a third party created agent.

3. The method of claim 2, further comprising changing a visual state of the characteristic in response to the user gaze being focused on the characteristic.

4. The method of claim 2, wherein the location of the characteristic is determined based on a factor selected from a group consisting of:

user selection, third party application preference, and current device task.

5. The method of claim 1, wherein detecting a location of user gaze comprises:

using a sensor device to detect the user gaze.

6. The method of claim 5, wherein the sensor device is selected from a group consisting of:

an image capture device, a video capture device, a range imaging device, and a 3D scanning device.

7. The method of claim 1, wherein detecting a voice input comprises:

using an audio capture device to detect audio.

8. The method of claim 7, wherein the audio detected comprises voice commands from the user.

9. The method of claim 1, wherein the modality detects an input selected from a group consisting of:

facial manipulation, a change in velocity of the device, an electronic communication, a key phrase, and a button press.

10. An information handling device, comprising:

a display device;

a processor operatively coupled to the display device;

at least one sensor operatively coupled to the processor; and

a memory that stores instructions executable by the processor to;

detect a location of user gaze on the display device;

activate, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

detect, after activation of the voice input module, a voice input using the at least one sensor; and

perform, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.

11. The me information handling device of claim 10, wherein voice input module activation is triggered by the location of user gaze being focused on a characteristic selected from a group consisting of:

a predetermined location, an icon, an anthropomorphic agent, a user selected image, and a third party created agent.

12. The information handling device of claim 11, further comprising changing a visual state of the characteristic in response to the user gaze being focused on the characteristic.

13. The information handling device of claim 11, wherein the location of the characteristic is determined based on a factor selected from a group consisting of:

user selection, third party application preference, and current device task.

14. The information handling device of claim 10, wherein detecting a location of user gaze comprises:

using a sensor device selected from a group consisting of;

an image capture device, a video capture device, a range imaging device, and a 3D scanning device.

15. The information handling device of claim 10, wherein detecting a voice input comprises:

using an audio capture device to detect audio.

16. The information handling device of claim 15, wherein the audio detected comprises voice commands from the user.

17. The information handling device of claim 10, wherein the modality detects an input selected from a group consisting of:

facial manipulation, a change in velocity of the device, an electronic communication, a key phrase, and a button press.

18. A product, comprising:

a storage device having code stored therewith, the code being executable by the processor and comprising;

code that detects a location of a user gaze on a display device;

code that activates, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

code that detects, after activation of the voice input module, a voice input using a modality; and

code that performs, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.