USER ATTENTION-BASED USER EXPERIENCE

• US 20200133382A1
• Filed: 12/27/2019
• Published: 04/30/2020
• Est. Priority Date: 12/27/2019
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Magi, Aleksander, Bui, Kathy, Diefenbaugh, Paul, Bartscherer, Marko
• Granted Patent: US 11,132,048 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 1/3278 Power saving in modem or I/O interface
• CPC Class Codes: G06F 1/3287 by switching off individual functional units in the computer system
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Various systems and methods for adapting a computer based on user attentiveness are described herein. A system for attention-based gesture recognition includes processing circuitry to: access an image of a user, the user proximate to a computing device; determine, based on the image, whether user is attentive to the computing device; and selectively enable or disable a function of the computing device depending on whether the user is attentive.

Claims

1. A system of attention-based gesture recognition comprising:

processing circuitry to;

access an image of a user, the user proximate to a computing device;

determine, based on the image, whether user is attentive to the computing device; and

selectively enable or disable a function of the computing device depending on whether the user is attentive.

2. The system of claim 1, wherein to determine whether the user is attentive, the processing circuitry is to:

determine a head pose of the user from the image;

determine a direction angle of the head pose with respect to the computing device; and

determine that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the computing device, and the second threshold angle is measured in a second direction with respect to the computing device, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

3. The system of claim 1, wherein to determine whether the user is attentive, the processing circuitry is to:

determine a direction angle of eye gaze of the user, with respect to the computing device based on the image; and

determine that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the computing device, and the second threshold angle is measured in a second direction with respect to the computing device, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

4. The system of claim 3, wherein the first and second thresholds angles are approximately 45°

from a centerline, the centerline defined by a ray from the user to the computing device.

5. The system of claim 3, wherein the first and second thresholds angles are different angles.

6. The system of claim 3, wherein the first and second thresholds angles positive and negative vertical angles measured from a horizon, the horizon defined by a horizontal plane including a centerline from the user to the computing device.

7. The system of claim 1, wherein the function of the computing device comprises gesture recognition, and wherein to selectively enable or disable the function of the computing device depending on whether the user is attentive, the processing circuitry is to:

supply power to a gesture recognition circuitry when the user is attentive; and

reduce power to the gesture recognition circuitry when the user is inattentive, the user considered inattentive when the direction angle of the head pose exceeds the first or second threshold angle.

8. The system of claim 1, wherein the function of the computing device comprises audio processing, and wherein to selectively enable or disable the function of the computing device depending on whether the user is attentive, the processing circuitry is to:

selectively configure a microphone array to track voice commands of the user based on head position of the user.

9. The system of claim 1, wherein the function of the computing device comprises sound output, and wherein to selectively enable or disable the function of the computing device depending on whether the user is attentive, the processing circuitry is to:

selectively configure a speaker array to provide an optimal soundstage based on head position of the user.

10. A method of attention-based gesture recognition comprising:

accessing an image of a user, the user proximate to a computing device;

determining, based on the image, whether user is attentive to the computing device; and

selectively enabling or disabling a function of the computing device depending on whether the user is attentive.

11. The method of claim 10, wherein determining whether the user is attentive comprises:

determining a head pose of the user from the image;

determining a direction angle of the head pose with respect to the computing device; and

determining that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the computing device, and the second threshold angle is measured in a second direction with respect to the computing device, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

12. The method of claim 10, wherein determining whether the user is attentive comprises:

determining a direction angle of eye gaze of the user, with respect to the computing device based on the image; and

determining that the user is attentive based on a first threshold angle and a second threshold angle, wherein the first threshold angle is measured in a first direction with respect to the computing device, and the second threshold angle is measured in a second direction with respect to the computing device, the second direction opposite of the first direction, and wherein the user is determined to be attentive if the direction angle is between the first threshold angle and the second threshold angle.

13. The method of claim 12, wherein the first and second thresholds angles are approximately 45°

from a centerline, the centerline defined by a ray from the user to the computing device.

14. The method of claim 12, wherein the first and second thresholds angles are different angles.

15. The method of claim 12, wherein the first and second thresholds angles positive and negative vertical angles measured from a horizon, the horizon defined by a horizontal plane including a centerline from the user to the computing device.

16. The method of claim 10, wherein the function of the computing device comprises gesture recognition, and wherein selectively enabling or disabling the function of the computing device depending on whether the user is attentive comprises:

supplying power to a gesture recognition circuitry when the user is attentive; and

reducing power to the gesture recognition circuitry when the user is inattentive, the user considered inattentive when the direction angle of the head pose exceeds the first or second threshold angle.

17. The method of claim 10, wherein the function of the computing device comprises audio processing, and wherein selectively enabling or disabling the function of the computing device depending on whether the user is attentive comprises:

selectively configuring a microphone array to track voice commands of the user based on head position of the user.

18. The method of claim 10, wherein the function of the computing device comprises sound output, and wherein selectively enabling or disabling the function of the computing device depending on whether the user is attentive comprises:

selectively configuring a speaker array to provide an optimal soundstage based on head position of the user.

19. At least one machine-readable medium including instructions for attention-based gesture recognition, which when executed by a machine, cause the machine to perform operations comprising:

accessing an image of a user, the user proximate to a computing device;

determining, based on the image, whether user is attentive to the computing device; and

selectively enabling or disabling a function of the computing device depending on whether the user is attentive.

20. The at least one machine-readable medium of claim 19, wherein the function of the computing device comprises gesture recognition, and wherein selectively enabling or disabling the function of the computing device depending on whether the user is attentive comprises:

supplying power to a gesture recognition circuitry when the user is attentive; and

reducing power to the gesture recognition circuitry when the user is inattentive, the user considered inattentive when the direction angle of the head pose exceeds the first or second threshold angle.