Method and system for controlling presentation of information to a user based on the user's condition

• US 6,466,232 B1
• Filed: 12/18/1998
• Issued: 10/15/2002
• Est. Priority Date: 12/18/1998
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Tangis Corporation
• Inventors: Newell, Dan, Abbott, Kenneth H. III
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Hailu, Tadesse
• Application Number:
  US09/216,193
• Time in Patent Office: 1,397 Days
• Field of Search: 345/8, 345/169, 345/158, 345/2.1, 345/3.1, 345/700, 345/751, 345/762, 708/139, 704/270, 710/8, 705/27
• US Class Current: 715/700
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 21/606 by securing the transmission between two devices or processes
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 2221/032 Protect output to user by software means
• CPC Class Codes: G06F 2221/2149 Restricted operating environment
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A system for controlling presentation of information to a user based on the user'"'"'s current condition. In particular, the system monitors the user and the user'"'"'s environment, and creates and maintains an updated model of the current condition of the user. The user condition can include a variety of condition variables, including abstract concepts such as the user'"'"'s current cognitive load, desired level of privacy for output information, and desired scope of audience for output information. Upon receiving output information to be presented to the user (e.g., from an application program), the system determines an appropriate output device and an appropriate format with which to present the information to the user, and then presents the output information. The system can also receive description information about the output information that describes relevant factors for determining when and how to present the output information (e.g., the importance and urgency of the output information, the consequences of the user not receiving or ignoring the output information, etc.). Some versions of the system execute on a wearable computer having a variety of available output display devices.

Claims

1. A method for a computer to present information to a user on one of a plurality of available output devices, the method comprising:

(a) monitoring the user to collect information about a current state of the user;

(b) modeling a current user condition based on the collected information by,

determining a current level of privacy desired by the user, the level of privacy indicating a group of people allowed to perceive information presented by the computer;

determining a current scope of audience desired by the user, the scope of audience indicating how many people are intended to perceive information presented by the computer;

or

determining a current cognitive load of the user, the cognitive load indicating ability of the user to devote attention to the computer;

(c) receiving output information to be presented to the user; and

(d) presenting the output information in a manner consistent with the modeled current user condition by,

selecting one of the plurality of output devices such that information presentation capabilities of the selected output device support the determined current desired level of privacy, the determined current desired scope of audience, and the determined current cognitive load; and

presenting the output information to the user on the selected output device,

and wherein step (d) is deferred when the output information cannot be presented on any of the available output devices in a manner consistent with the modeled current user condition,

so that the presentation of information by the computer satisfies the modeled current user condition.

2. The method of claim 1 wherein the modeling of the current user condition is additionally based on collected information related to a surrounding environment.

3. The method of claim 1 wherein the monitoring of the user is performed by sensors worn by the user.

4. The method of claim 1 wherein the monitoring of the user is performed by sensors remote from the user.

5. The method of claim 1 wherein the collected information includes information about a current physiological state of the user.

6. The method of claim 1 wherein the collected information includes information about current activities of the user.

7. The method of claim 1 wherein the computer is a wearable computer.

8. The method of claim 1 wherein an operating system of the computer performs the method.

9. The method of claim 1 Wherein the output information is received from a distinct program executing on the computer.

10. The method of claim 1 wherein the output information is received from another computer.

11. The method of claim 1 wherein the output information is generated by the computer during the monitoring or the modeling.

12. The method of claim 1 wherein the available output devices include two display devices with different information presentation capabilities regarding level of privacy, scope of audience, and cognitive load, and wherein the selected output device is the display device whose information presentation capabilities best match the modeled current user condition.

13. The method of claim 1 wherein information can be presented with the available output devices to the user via at least two user senses, and wherein the selecting includes determining the user sense via which the output information will be presented.

14. A method for a computer to present information to a user on one of a plurality of available output devices, the method comprising:

(a) monitoring the user to collect information about a current state of the user;

(b) modeling a current user condition based on the collected information by,

determining a current level of privacy desired by the user, the level of privacy indicating a group of people allowed to perceive information presented by the computer;

determining a current scope of audience desired by the user, the scope of audience indicating how many people are intended to perceive information presented by the computer;

or

determining a current cognitive load of the user, the cognitive load indicating ability of the user to devote attention to the computer;

(c) receiving output information to be presented to the user;

receiving description information for the output information describing importance and deferability of the output information; and

(d) presenting the output information in a manner consistent with the modeled current user condition and in a manner consistent with the description information by,

selecting one of the plurality of output devices such that information presentation capabilities of the selected output device support the determined current desired level of privacy, the determined current desired scope of audience, and the determined current cognitive load; and

presenting the output information to the user on the selected output device,

so that the presentation of information by the computer satisfies the modeled current user condition.

15. A computer-implemented method for presenting output information to a user, the method comprising:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user;

receiving description information indicating importance or deferability of the output information, and presenting the output information on the selected output device in accordance with the modeled user property; and

when no selectable output device is capable of presenting the output information in accordance with the modeled user property, deferring the presenting of the output information.

16. The method of claim 15 wherein the received information includes information related to a current condition of the user, and including modeling the user property based on the received information.

17. The method of claim 16 including monitoring the user to collect the received information.

18. The method of claim 15 wherein the received information includes information related to a surrounding environment, and including modeling the user property based on the received information.

19. The method of claim 18 including monitoring the surrounding environment to collect the received information.

20. The method of claim 15 including before the presenting of the output information, receiving the output information.

21. The method of claim 20 wherein an information provider transmits information to various computers within a transmission range of the information provider, wherein the method is performed by a transportable computer transported by the user, wherein the user transports the transportable computer within the transmission range, and wherein the received output information is the transmitted information.

22. The method of claim 15 wherein the modeled user property is an indication of ability of the user to devote attention to the presenting of the output information.

23. The method of claim 22 wherein the ability of the user to devote attention is influenced by information being received by the user via one user sense, and wherein the presenting of the output information is selected to be via a distinct user sense.

24. The method of claim 22 including deferring the presenting of the output information when the ability of the user to devote attention is low.

25. The method of claim 22 wherein the indication of the ability of the user to devote attention is an estimate of an amount of attention devoted by the user to other current activities.

26. The method of claim 15 wherein the modeled user property is a preference of the user for an amount of people to perceive presented information.

27. The method of claim 26 wherein the selected output device includes a range of information presentation capabilities, wherein others can perceive information presented using some of the information presentation capabilities, and including selecting those information presentation capabilities to be used for the presenting when the modeled user property indicates that the others are within the amount of people to perceive the output information.

28. The method of claim 26 wherein the selected output device includes a range of information presentation capabilities, wherein others nearby cannot perceive information presented using some of the information presentation capabilities, and including selecting those information presentation capabilities to be used for the presenting when the modeled user property indicates that the others exceed the amount of people to perceive the output information.

29. The method of claim 15 wherein the modeled user property is a preference of the user for how to receive sensitive information.

30. The method of claim 29 wherein the selected output device includes a range of information presentation capabilities, wherein others can perceive information presented using some of the information presentation capabilities, and including selecting those information presentation capabilities to be used for the presenting when the modeled user property indicates that sensitivity of the output information allows the others to perceive the output information.

31. The method of claim 29 wherein the selected output device includes a range of information presentation capabilities, wherein others nearby cannot perceive information presented using some of the information presentation capabilities, and including selecting those information presentation capabilities to be used for the presenting when the output information is sufficiently sensitive that the modeled user property indicates that the others are not allowed to perceive the output information.

38. The method of claim 15 wherein a plurality of output devices are available to present information via distinct senses of the user, and wherein the selecting of the output device includes determining a user sense which is capable of presenting the output information in accordance with the modeled user property.

39. The method of claim 15 wherein the selected output device has only a single physical mechanism for presenting the output information to the user.

40. The method of claim 15 wherein the computer performing the method is transportable by the user, wherein fixed output devices become available to the computer when the user transports the computer near the fixed output devices, and wherein the selected output device is a fixed output device.

41. The method of claim 15 wherein a user computer performing the method is transportable by the user, and wherein the user computer can communicate with other devices within a transmission range of the user computer.

42. The method of claim 41 wherein the user computer communicates with another computer, and wherein the selected output device is an output device of the another computer.

43. The method of claim 41 wherein the received information is from one of the other devices.

44. The method of claim 41 wherein the output information to be presented is received from one of the other devices.

45. The method of claim 41 including after the presenting of the output information, revising the modeled user property based on the presenting.

46. The method of claim 15 wherein the modeled user property indicates capabilities of the user for receiving presented output information.

47. The method of claim 46 wherein the capabilities indicate that a physical disability of the user prevents the user from perceiving some types of presentations of information, and wherein the presenting of the output information is in a manner perceivable by the user.

48. The method of claim 15 including modeling properties of the user for use when presenting output information to the user by:

receiving first information about a current state of the user; and

for at least one of a plurality of properties of the user which affects appropriateness of presenting output information to the user, modeling the property by

determining whether the received first information relates to the property; and

when the received first information relates to the property, determining a current value for the property based at least in part on the received first information.

49. The method of claim 48 including:

receiving the output information, and wherein the presenting of the output information is to the user and is in accordance with the modeled user properties.

50. The method of claim 48 including when a program has output information to present to the user, supplying the determined current values of the modeled user properties to the program so that the output information can be presented to the user by the program in accordance with the modeled user properties.

51. The method of claim 48 including when determined current values of the modeled user properties change, automatically supplying the changed current values to the program so that the output information can be presented in accordance with the changed current values of the modeled user properties.

52. The method of claim 48 wherein the determining of the current value for the property is based on a plurality of modeling rules.

53. The method of claim 52 wherein when the user is in a specified class of users, using modeling rules specialized for the specified class.

54. The method of claim 52 wherein when the user is not in a pre-determined class of users, using default modeling rules.

55. The method of claim 52 including updating the modeling rules based on the received first information so as to better model the user.

56. The method of claim 52 wherein the computer can communicate with another computer, and including receiving from the another computer new modeling rules to be used for the determining of the current value.

57. The method of claim 48 wherein the computer can communicate with another computer, the another computer able to obtain information about the user via input devices of the another computer, and wherein the received first information is obtained information about the user from the another computer.

58. The method of claim 48 wherein the computer can communicate with another computer, and including receiving from the another computer information about properties of the user to be added to the modeled user properties, the added properties distinct from the modeled user properties.

59. The method of claim 48 wherein the computer can communicate with another computer, and including receiving from the another computer a value for one of the modeled user properties to be stored as the determined current value for the one property.

60. The method of claim 48 wherein the plurality of properties of the user are modeled based on received information to create a model of a user condition.

61. The method of claim 48 including monitoring the user to obtain the received first information.

62. The method of claim 48 wherein multiple pieces of information are received which relate to a property of the user, wherein the multiple pieces of information are inconsistent as to the current value for the property, and wherein the determining of the current value involves mediating the inconsistencies.

63. The method of claim 48 wherein a rating indicating quality of the received first information is received, and wherein the quality rating is reflected in the determined current values for the properties which relate to the received first information.

64. The method of claim 48 including:

determining that a current value for a user property is needed for presenting output information to the user; and

obtaining information related to the user property to allow determination of the current value.

84. The computer system of claim 30 wherein the user characterization module further monitors the user or the surrounding environment to obtain the collected information.

32. A computer-implemented method for presenting output information to a user, the method comprising:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user, the modeled user property being an indication of a degree of interruptibility of current activities of the user;

selecting an output device capable of presenting the output information in accordance with the modeled user property; and

presenting the output information on the selected output device in accordance with the modeled user property.

33. The method of claim 32 wherein the degree of interruptibility of the current activities is influenced by information being received by the user via one user sense in conjunction with the current activities, and wherein the presenting of the output information is selected to be via a distinct user sense.

65. The method of claim 32 including deferring the presenting of the output information when the degree of interruptibility of the current activities is low.

66. The method of claim 32 wherein the degree of interruptibility of the current activities is low when the current activities involve a risk of harm to the user.

34. A computer-implemented method for presenting output information to a user, the method comprising:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user, the modeled user property being a preference of the user for receiving information during current activities of the user;

selecting an output device capable of presenting the output information in accordance with the modeled user property; and

presenting the output information on the selected output device in accordance with the modeled user property.

35. The method of claim 34 including deferring the presenting of the output information when the preference of the user is to not receive the output information during the current activities.

36. The method of claim 34 including presenting the output information non-intrusively when the preference of the user is to not receive output information during the current activities.

37. A computer-implemented method for presenting output information to a user, the method comprising:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user;

selecting an output device capable of presenting the output information in accordance with the modeled user property, the selected output device including a range of information presentation capabilities;

formatting the output information to select information presentation capabilities of the selected output device to be used such that the selected information presentation capabilities are consistent with the modeled user property; and

after the formatting, presenting the output information on the selected output device in accordance with the modeled user property.

67. A computer-implemented method for presenting output information to a user, the method comprising:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user, the modeled user property being an indication of appropriateness of presenting the output information in a manner perceivable by others;

selecting an output device capable of presenting the output information in accordance with the modeled user property; and

presenting the output information on the selected output device in accordance with the modeled user property.

68. The method of claim 67 wherein the selected output device includes a range of information presentation capabilities, wherein others cannot perceive information presented using some of the information presentation capabilities, and including selecting those information presentation capabilities to be used for the presenting when the modeled user property indicates that presenting the output information in a manner perceivable by the others is not appropriate.

69. The method of claim 67 including deferring the presenting of the output information when the modeled user property indicates that presenting the output information in a manner perceivable by others is not appropriate and available output devices cannot present the output information in a manner not perceivable by the others.

70. A method for a wearable computer to present output information to a user wearing the wearable computer, the wearable computer having a plurality of output devices from which the user can receive information, the method comprising:

monitoring the user to collect information;

characterizing the user based on the collected information so as to identify an ability of the user to currently receive the output information and a desire of the user of how to currently receive the output information;

receiving description information indicating importance or deferability of the output information;

selecting one of the plurality of output devices such that information presentation capabilities of the selected output device support the identified ability and desire and such that the selecting is performed in accordance with the description information; and

presenting the output information to the user on the selected output device consistently with the identified ability and desire.

71. The method of claim 70 including receiving the output information from an application program executing on the wearable computer.

72. The method of claim 70 wherein the wearable computer has multiple display devices worn by the user, the multiple display devices having distinct information presentation capabilities, and wherein the selecting of one of the plurality of output devices selects one of the multiple display devices.

73. A computer-readable medium containing instructions for presenting output information to a user, by performing a method comprising:

receiving information about at least one modeled characteristic of the user which affects appropriateness of presenting output information to the user;

receiving the output information;

receiving description information indicating importance and/or deferability of the output information,

when a selectable output device is capable of presenting the output information in accordance with the modeled user characteristic and the description information, selecting the output device and presenting the output information on the selected output device in accordance with the modeled user characteristic; and

when no selectable output device is capable of presenting the output information in accordance with the modeled user characteristic deferring the presenting of the output information.

74. The computer-readable medium of claim 73 wherein the at least one modeled characteristic is based on collected information related to the user.

75. The computer-readable medium of claim 74 wherein the computer system is further controlled by monitoring the user to obtain the collected information.

77. The computer-readable medium of claim 73 wherein the instructions cause the presenting of the output information to the user when executed by a computing device.

78. The computer-readable medium of claim 77 wherein the computer-readable medium is a memory of the computing device.

79. The computer-readable medium of claim 73 wherein the computer-readable medium is a data transmission medium transmitting a generated data signal containing the instructions.

76. A computer-readable medium whose contents cause a computer to present output information to a user by:

receiving information about a modeled property of the user which affects appropriateness of presenting output information to the user;

selecting an output device capable of presenting the output information in accordance with the modeled user property, the selected output device including a range of information presentation capabilities;

formatting the output information, the formatting to select information presentation capabilities of the selected output device to be used such that the selected information presentation capabilities are consistent with the modeled user property; and

after the formatting, presenting the output information on the selected output device in accordance with the modeled user property.

80. A computer system for presenting output to a user, comprising:

an output device selector module that receives information about a modeled property of the user which affects appropriateness of presenting output to the user, that receives description information indicating importance or deferability of the output, that selects an output device capable of presenting the output in accordance with the modeled property and in accordance with the description information, and that presents the output on the selected output device in accordance with the modeled property.

81. The computer system of claim 80 further comprising the selected output device.

82. The computer system of claim 80 further comprising a model of a current condition of the user, the model including a plurality of user properties including the modeled property.

83. The computer system of claim 80 wherein the computer system further comprises a user characterization module that generates the modeled property based on collected information related to the user or to a surrounding environment.

85. The computer system of claim 80 wherein the selected output device includes a range of information presentation capabilities, and further including a format module that formats the output before the presenting, the formatting to select information presentation capabilities of the selected output device to be used such that the selected information presentation capabilities are consistent with the modeled property.

86. The computer system of claim 80 wherein the received information is current physiological information about the user indicating a health condition, and wherein the presenting of output is to another person to alert the another person of a health problem detected from the current physiological information.

87. The computer system of claim 80 wherein the received information is current physiological information about the user indicating a health condition, and wherein the presenting of output is to administer medical care for the health condition.

88. The computer system of claim 80 wherein the output device selector module is executing in memory of the computer system.