CURSOR AND CURSOR-HOVER BASED ON USER STATE OR SENTIMENT ANALYSIS

• US 20170269814A1
• Filed: 03/16/2016
• Published: 09/21/2017
• Est. Priority Date: 03/16/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kozloski, James R., Pickover, Clifford A., Vukovic, Maja
• Granted Patent: US 10,345,988 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/168 Evaluating attention deficit, hyperactivity
• CPC Class Codes: A61B 5/4088 Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
• CPC Class Codes: A61B 5/4266 sweat secretion
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop

Abstract

An embodiment of the invention provides a method for displaying a text box on a display screen of an electronic device, including determining a state of a user with an input device having a camera, a keyboard, and/or a mouse. A text box setting on the electronic device is modified with a processor connected to the input device based on the state of the user, the modifying of the text box setting includes modifying an amount of visual information in the text box, modifying an amount of audible information played with the text box, and/or modifying an amount of time required to display the text box. The text box is displayed on the display screen of the electronic device when a pointer is within a threshold degree of proximity to an item on the display screen for the amount of time required to display the text box.

Claims

1. A method for displaying a text box on a display screen of an electronic device, said method comprising:

determining a state of a user with an input device including at least one of a camera, a keyboard, and a mouse;

modifying a text box setting on the electronic device with a processor connected to the input device based on the state of the user, said modifying of the text box setting including modifying an amount of visual information in the text box, modifying an amount of audible information played with the text box, and modifying an amount of time required to display the text box; and

displaying the text box on the display screen of the electronic device when a pointer is within a threshold degree of proximity to an item on the display screen for the amount of time required to display the text box,

wherein the state of the user is determined from a facial expression of the user, a degree of multitasking of the user, information from a calendar of the user, brain waves of the user, and skin conductivity of the user.

2. The method according to claim 1, wherein the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder.

3. The method according to claim 1, wherein the state of the user is selected from a group consisting of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder.

4. The method according to claim 1, wherein said modifying of the text box setting on the electronic device includes decreasing the amount of visual information in the text box, increasing the amount of audible information in the text box, and decreasing the amount of time required to display the text box when the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder.

5. The method according to claim 1, further comprising determining the degree of multitasking of the user from a rate of switching between applications on the electronic device, a rate of switching between windows on the electronic device, a number of open applications on the electronic device, a number of open windows on the electronic device, and information from the calendar of the user.

6. The method according to claim 1, further comprising creating a composite text box when the user drags a first text box to a position proximate a second text box, the composite text box including:

information from the first text box;

information from the second text box; and

information describing how the first text box relates to the second text box.

7. The method according to claim 6, further comprising automatically displaying the composite text box on the display screen when one of display of the first text box is triggered and display of the second text box is triggered.

8. The method according to claim 1, further comprising:

identifying that a pop-up text box satisfies a threshold degree of importance based on the state of the user; and

displaying the pop-up text box on the display screen of the electronic device when the pointer is not within the threshold degree of proximity to the item on the display screen for the amount of time required to display the text box.

9. The method according to claim 1, further comprising modifying the text box setting on the electronic device based on a profile of the user, the profile of the user including a browsing history of the user, purchasing history of the user, application history of the user, text box history of the user, electronic bookmarks of the user, likes, and interests of the user.

10. The method according to claim 1, wherein said modifying of the text box setting on the electronic device includes selecting content to be displayed in the text box based on the emotional state of the user.

11. The method according to claim 1, wherein the input device includes a brain wave monitor.

12. A method for displaying a text box on a display screen of an electronic device, said method comprising:

determining a state of a user with an input device including at least one of a camera, a keyboard, and a mouse;

modifying a text box setting on the electronic device with a processor connected to the input device based on the state of the user, said modifying of the text box setting including at least one of modifying an amount of visual information in the text box, modifying an amount of audible information played with the text box, and modifying an amount of time required to display the text box; and

displaying the text box on the display screen of the electronic device when a pointer is within a threshold degree of proximity to an item on the display screen for the amount of time required to display the text box,

wherein the state of the user is determined from at least one of a facial expression of the user, a degree of multitasking of the user, information from a calendar of the user, and brain waves of the user.

13. The method according to claim 12, wherein the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder.

14. The method according to claim 12, wherein said modifying of the text box setting on the electronic device includes at least one of:

decreasing the amount of visual information in the text box when the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder;

increasing the amount of audible information in the text box when the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder; and

decreasing the amount of time required to display the text box when the state of the user includes at least one of fatigue, frustration, distracted, autistic, youth, Alzheimer'"'"'s, pre-Alzheimer'"'"'s, learning disability, and attention deficit hyperactivity disorder.

15. The method according to claim 12, further comprising determining the degree of multitasking of the user from at least one of a rate of switching between applications on the electronic device, a rate of switching between windows on the electronic device, a number of open applications on the electronic device, a number of open windows on the electronic device, and information from the calendar of the user.

16. The method according to claim 12, further comprising creating a composite text box when the user drags a first text box to a position proximate a second text box, the composite text box including at least one of:

information from the first text box and information from the second text box; and

information describing how the first text box relates to the second text box.

17. The method according to claim 16, further comprising automatically displaying the composite text box on the display screen when one of display of the first text box is triggered and display of the second text box is triggered.

18. The method according to claim 12, further comprising modifying the text box setting on the electronic device based on a profile of the user, the profile of the user including from at least one of a browsing history of the user, purchasing history of the user, application history of the user, text box history of the user, electronic bookmarks of the user, likes, and interests of the user.

19. The method according to claim 12, further comprising learning text box settings that are best for different groups of users.

20. A computer program product for displaying a text box on a display screen of an electronic device, said computer program product comprising:

a computer readable storage medium having stored thereon;

first program instructions executable by a device to cause the device to determine a state of a user;

second program instructions executable by the device to cause the device to modify a text box setting on the electronic device based on the state of the user, said second program instructions at least one of modifies an amount of visual information in the text box, modifies an amount of audible information played with the text box, and modifies an amount of time required to display the text box; and

third program instructions executable by the device to cause the device to display the text box when a pointer is within a threshold degree of proximity to an item on a display screen for the amount of time required to display the text box,

wherein the state of the user is determined from at least one of a facial expression of the user, a degree of multitasking of the user, information from a calendar of the user, and brain waves of the user.