DIRECTING VOICE INPUT BASED ON EYE TRACKING

• US 20150269943A1
• Filed: 03/24/2014
• Published: 09/24/2015
• Est. Priority Date: 03/24/2014
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: VanBlon, Russell Speight, Grimme, Jason, Bijjaragi, Manisha, Guy, Spencer Michael, McDaniel, Kyle Jared
• Granted Patent: US 9,966,079 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/226 using non-speech characteristics

Abstract

For directing voice input based on eye tracking, a method is disclosed that includes receiving, by use of a processor, an audio signal, the audio signal comprising voice input, selecting a location from the group consisting of a computing device and an application being displayed on a screen of the computing device, the location being detected where a user'"'"'s eyes are directed, and directing the voice input to the selected location.

Claims

1. An apparatus comprising:

a processor;

a screen accessible to the processor;

a memory that stores code executable by the processor, the code comprising;

code that receives an audio signal, the audio signal comprising voice input;

code that selects a location selected from the group consisting of the apparatus and an application being displayed on the screen, the location being detected where a user'"'"'s eyes are directed; and

code that directs the voice input to the selected location.

2. The apparatus of claim 1, further comprising code that selects the application based on the application being detected at the location on the screen.

3. The apparatus of claim 1, further comprising code that generates a command based on the voice input, the code directing the command to the location.

4. The apparatus of claim 1, wherein the code further discards the voice input in response to the location being off of the screen.

5. The apparatus of claim 1, wherein the code further transfers the audio signal to the location.

6. The apparatus of claim 1, wherein the code employs facial recognition to recognize the face of the user.

7. The apparatus of claim 1, wherein the code further transmits the location to the location.

14. The apparatus of claim 1, wherein directing the voice input to the selected location comprises transmitting the location to the location.

8. A method comprising:

receiving, by use of a processor, an audio signal, the audio signal comprising voice input;

selecting a location from the group consisting of a computing device and an application being displayed on a screen of the computing device, the location being detected where a user'"'"'s eyes are directed; and

directing the voice input to the selected location.

9. The method of claim 8, wherein selecting the application is based on the application being detected at the location on the screen.

10. The method of claim 9, further comprising discarding the voice input in response to failing to select an application.

11. The method of claim 8, further comprising converting the voice input to a command, and wherein directing the voice input comprises directing the command to the location, the command comprising the location.

12. The method of claim 8, wherein directing the voice input comprises transmitting the audio signal to the location.

13. The method of claim 8, wherein selecting the location comprises using facial recognition to identify the user.

15. A program product comprising a computer readable storage medium that stores code executable by a processor to perform:

receiving, by use of a processor, an audio signal, the audio signal comprising voice input;

selecting a location selected from the group consisting of a computing device and an application being displayed on a screen of the computing device, the location being detected where a user'"'"'s eyes are directed; and

directing the voice input to the selected location.

16. The program product of claim 15, wherein the code further selects the application based on the application being detected at the location on the screen.

17. The program product of claim 16, wherein the code further discards the voice input in response to failing to select an application.

18. The program product of claim 15, wherein the code further converts the voice input to a command, and wherein directing the voice input comprises directing the command to the location, the command comprising the location.

19. The program product of claim 15, wherein directing the voice input comprises transmitting the audio signal to the location.

20. The program product of claim 15, wherein selecting the location comprises using facial recognition to identify the user.