Cognitive graphical control element

• US 10,489,043 B2
• Filed: 12/15/2015
• Issued: 11/26/2019
• Est. Priority Date: 12/15/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Feris, Rogerio S., Kozloski, James R., Pickover, Clifford A., Vukovic, Maja
• Primary Examiner(s): Pitaro, Ryan F
• Application Number:
  US14/969,484
• Publication Number:
  US 20170168703A1
• Time in Patent Office: 1,442 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

Information relating to at least one of a user and a user environment is acquired. A user cognitive state is determined based on the acquired information. A graphical control element is automatically configured based on the user cognitive state. The graphical control element is automatically presented on a display interface of a user device to control viewing of content displayed on the user device.

Claims

1. A method, comprising steps of:

acquiring information relating to at least one of a user and a user environment, wherein at least a portion of the information is acquired via user input, and further wherein the acquiring information comprises capturing one or more user images by using one or more imaging components on a user device to estimate an age of the user to categorize the user;

determining a user cognitive state based on the acquired information, wherein the user cognitive state comprises at least a user demographic;

automatically configuring a graphical control element based on the user cognitive state, wherein the graphical control element comprises a scrollbar and further wherein automatically configuring the graphical control element comprises adjusting at least one of a shape and a texture of a slider of the scrollbar; and

automatically presenting the graphical control element on a display interface of a user device to control viewing of content displayed on the user device;

wherein the steps are performed by at least one processor device coupled to a memory implemented in the user device.

2. The method of claim 1, wherein the user cognitive state further comprises at least one of a user cohort, a user emotional state and a user distraction level.

3. The method of claim 2, wherein the user emotional state comprises at least one of fatigue, frustration, confusion and interest.

4. The method of claim 1, wherein determining the user cognitive state comprises analyzing the one or more images of the user utilizing at least one of a biometric technique, a facial expression analysis technique and a gaze tracking technique.

5. The method of claim 1, wherein the step of acquiring information further comprises acquiring information relating to the user environment.

6. The method of claim 1, wherein the step of acquiring information further comprises acquiring information relating to the user environment and capturing one or more audio streams of the user environment using one or more acoustic components on the user device.

7. The method of claim 1, wherein the step of acquiring information further comprises acquiring information relating to the user environment and acquiring user activity level based on at least one of a number of open windows on the user device and a user activity schedule from a calendar using one or more processors implemented in the user device.

8. The method of claim 1, wherein automatically configuring the graphical control element comprises adjusting a responsivity level of the scrollbar.

9. The method of claim 8, wherein adjusting the responsivity level of the scrollbar comprises changing a viscosity of scrolling based on a risk computation.

10. The method of claim 1, wherein the information is acquired from a database comprising characteristics of one or more cohorts, characteristics of one or more users and historical data associated with the one or more cohorts and one or more users.

11. The method of claim 10, further comprising learning the user cognitive state based on at least one of the characteristics and the historical data.

12. The method of claim 1, further comprising automatically configuring the graphical control element based on a user context.

13. The method of claim 1, further comprising repeating the acquiring step, monitoring the user cognitive state periodically.

14. The method of claim 13, further comprising automatically reconfiguring the graphical control element periodically.

15. The method of claim 1, wherein the automatically configuring the graphical control element further comprises adjusting a color.

16. A device comprising:

a memory and a processor operatively coupled to the memory and configured to implement the steps of;

acquiring information relating to at least one of a user and a user environment wherein at least a portion of the information is acquired via user input and further wherein the acquiring information comprises capturing one or more user images by using one or more imaging components on a user device to estimate an age of the user to categorize the user;

determining a user cognitive state based on the acquired information, wherein the user cognitive state comprises at least a user demographic;

automatically configuring a graphical control element based on the user cognitive state, wherein the graphical control element comprises a scrollbar and further wherein automatically configuring the graphical control element comprises adjusting at least one of a shape and a texture of a slider of the scrollbar; and

automatically presenting the graphical control element on a display interface of a user device to control viewing of content displayed on the user device.

17. The device of claim 16, wherein the automatically configuring the graphical control element further comprises adjusting a color.

18. The device of claim 16, further comprising automatically configuring the graphical control element based on a user context.

19. A computer program product comprising a computer readable storage medium for storing computer readable program code which, when executed, causes a computer to:

acquire information relating to at least one of a user and a user environment wherein at least a portion of the information is acquired via user input, and further wherein the acquiring information comprises capturing one or more user images by using one or more imaging components on a user device to estimate an age of the user to categorize the user;

determine a user cognitive state based on the acquired information, wherein the user cognitive state comprises at least a user demographic;

automatically configure a graphical control element based on the user cognitive state, wherein the graphical control element comprises a scrollbar and further wherein automatically configuring the graphical control element comprises adjusting at least one of a shape and a texture of a slider of the scrollbar; and

automatically present the graphical control element on a display interface of a user device to control viewing of content displayed on the user device.

20. The computer program product of claim 19, wherein the automatically configuring the graphical control element further comprises adjusting a color.