Logging and analyzing computer user's context data

• US 20050086243A1
• Filed: 11/08/2004
• Published: 04/21/2005
• Est. Priority Date: 12/18/1998
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Tangis Corporation
• Inventors: Newell, Dan, Robarts, Jim, Abbott, Ken, Freedman, Josh
• Granted Patent: US 7,779,015 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/901 Indexing; Data structures therefor; Storage structures for retrieval from the web G06F16/951
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: Y10S 707/921 Spatial
• CPC Class Codes: Y10S 707/941 Human sciences
• CPC Class Codes: Y10S 707/962 Entity-attribute-value

Abstract

A facility for logging context attributes is described. For each of a set of selected context attributes, the facility determines a target frequency with which values of the selected context attribute are to be logged. For each of the set of selected context attributes, the facility obtains values of the selected context attribute at a frequency approximating the target frequency determined for the selected context attribute. Then, for each obtained context attribute value, the facility writes the obtained value to a storage device in a manner that identifies its context attribute.

Claims

1-8. -8. (canceled)

9. A method in a computing device for specifying context attributes for logging, comprising:

displaying a list of context attributes available in the computing device;

receiving user input identifying a subset of the displayed available context attributes for logging; and

selecting the identified context attributes for logging.

10. The method of claim 9 wherein a proper subset of the displayed available context attributes is selected.

11. The method of claim 9 wherein a single displayed available context attributes is selected.

12. The method of claim 9, further comprising periodically storing values of the selected context attributes.

13. The method of claim 9, further comprising receiving user input identifying, for each of the selected context attributes, a log in which the selected context attribute is to be logged.

14. The method of claim 13, further comprising, for each of the selected context attributes, periodically storing values of the selected context attribute in the log identified for the selected context attribute.

15. The method of claim 9, further comprising associating with each selected context attribute a frequency at which the selected context attribute is to be logged.

16. The method of claim 15, further comprising, for a distinguished one of the selected context attributes, receiving user input specifying the frequency at which the distinguished context attribute is to be logged that is associated with the distinguished context attribute.

17. The method of claim 9 wherein a distinguished one of the selected context attributes is available from each of a plurality of sources, the method further comprising selecting one of the sources from which to obtain the distinguished context attribute that is to be logged.

18. The method of claim 17, further comprising receiving user input specifying the source from which to obtain the distinguished context attribute that is to be logged.

19. The method of claim 9 wherein values for context attributes may be cached, and wherein each cached context attribute value has an age, the method further comprising determining for a distinguished one of the selected context attributes a maximum age at which cached values of the distinguished context attribute may be logged.

20. The method of claim 19 wherein the determined maximum age is based upon user input.

21. The method of claim 9, further comprising determining for a distinguished one of the selected context attributes a processing technique to which the distinguished context attribute is to be subjected before logging.

22. The method of claim 21 wherein the determined processing technique is based upon user input.

23. The method of claim 9, further comprising determining for a distinguished one of the selected context attributes a processing technique to which the logged distinguished context attribute is to be subjected at a time subsequent to logging.

24. The method of claim 23 wherein the determined processing technique is based upon user input.

25. The method of claim 9, further comprising determining for a distinguished one of the selected context attributes an importance level reflecting the importance of retaining the logged distinguished context attribute.

26. The method of claim 25 wherein the determined importance level is based upon user input.

27. The method of claim 9, further comprising identifying for a distinguished one of the selected context attributes an alternative source from which the distinguished context attribute may become available at a future time.

28. The method of claim 27 wherein the identified alternative source is based upon user input.

86. The method of claim 9 wherein the computing device in which the method is performed is a mobile computer system.

87. The method of claim 9 wherein the computing device in which the method is performed is a body-supported computer system.

29. A computer-readable medium whose contents cause a computing device to specify context data items for logging by performing a method comprising:

displaying a list of available data items;

receiving user input identifying a subset of the displayed available data items for logging; and

selecting the identified data items for logging.

30. One or more computer memories that collectively contain a context attribute logging configuration data structure specifying how context attributes are to be logged, comprising entries each corresponding to a context attribute and indicating that the context attribute should be logged,

such that the data structure may be used to identify context attributes for logging.

31. The memories of claim 30 wherein each entry of the data structure is a record.

32. The memories of claim 30 wherein each entry of the data structure further specifies a frequency at which the context attribute to which the entry corresponds is to be logged.

33. The memories of claim 30 wherein one or more selected entries of the data structure which corresponds to a context attribute that may be available from more than one source further specifies a particular source from which to obtain the context attribute to which it corresponds.

34. The memories of claim 30 wherein values for context attributes may be cached, and wherein each cached context attribute value has an age, and wherein each of one or more selected entries of the data structure specifies a maximum age at which cached values of the context attribute to which the entry corresponds may be logged.

35. The memories of claim 30 wherein each of one or more selected entries of the data structure specifies a processing technique to which the corresponding context attribute is to be subjected before logging.

36. The memories of claim 30 wherein each of one or more selected entries of the data structure specifies a processing technique to which the corresponding context attribute is to be subjected at a time subsequent to logging.

37. The memories of claim 30 wherein each of one or more selected entries of the data structure specifies an importance level reflecting the importance of retaining information produced by logging the corresponding context attribute.

38. The memories of claim 30 wherein each of one or more selected entries of the data structure specifies an alternative source from which the corresponding context attribute may become available at a future time.

39. A method in a computing device for specifying context attributes for logging, comprising:

displaying a list of groups of context attributes available in the computing device;

receiving user input identifying a subset of the displayed groups of available context attributes for logging; and

selecting the context attributes of the identified groups for logging.

40. The method of claim 39 wherein one of the displayed groups of available context attributes contains context attributes relating to travel.

41. A method in a computing device for logging context attributes, comprising:

for each of a set of selected context attributes, determining a target frequency with which values of the selected context attribute are to be logged;

for each of the set of selected context attributes, obtaining values of the selected context attribute at a frequency approximating the target frequency determined for the selected context attribute; and

for each obtained context attribute value, writing the obtained value to a storage device in a manner that identifies its context attribute.

42. The method of claim 41 wherein the obtained values are written to a storage device in the computing device.

43. The method of claim 41 wherein the obtained values are written to a storage device external to the computing device

44. The method of claim 43 wherein values obtained in a plurality of computing devices are written to the storage device external to the computing device.

45. The method of claim 41 wherein the method utilizes a characterization module, and wherein, for each of the selected context attributes, a context server module is registered with the characterization module to provide the selected context attribute, and wherein the obtaining a value of a selected context attribute involves requesting, by the characterization module, a value of the selected context attribute from the context server module registered to provide the selected context attribute.

46. The method of claim 41, further comprising, for values of a distinguished one of the selected context attributes, applying a selected summarization technique to adapt the values of the distinguished context attribute before storing them.

47. The method of claim 41, further comprising, for values of a distinguished one of the selected context attributes, applying a selected abstraction technique to adapt the values of the distinguished context attribute before storing them.

48. The method of claim 41, further comprising, for values of a distinguished one of the selected context attributes, applying a selected compression technique to adapt the values of the distinguished context attribute before storing them.

88. The method of claim 41 wherein the computing device in which the method is performed is a mobile computer system.

89. The method of claim 41 wherein the computing device in which the method is performed is a wearable computer system.

49-53. -53. (canceled)

54. A method in a computing device for maintaining a log of context attributes, comprising:

accessing the log of context attributes, which contains values for each of a plurality of context attributes; and

applying to values of a selected one of the plurality of context attributes contained by the log a maintenance technique that has the effect of reducing the amount of storage space occupied by the log.

55. The method of claim 54 wherein the applied maintenance technique is a compression technique.

56. The method of claim 54 wherein the applied maintenance technique is a summarization technique.

57. The method of claim 54 wherein the applied maintenance technique is a thinning technique that discards a portion of the values of the selected context attribute while retaining others.

58. The method of claim 54 wherein the applied maintenance technique discards all values of the selected context attribute.

59. The method of claim 54 wherein the applied maintenance technique is an information abstraction technique.

60. The method of claim 54 wherein the applied maintenance technique is an archiving technique that removes values of the selected context attribute from the log and stores them outside the log.

61. The method of claim 54 wherein an importance level is specified for each of the context attributes whose values are contained by the log, the method further comprising:

comparing the importance levels specified for the context attributes; and

selecting a context attribute to which to apply a maintenance technique based upon the results of the comparison.

62. The method of claim 54, further comprising the steps of:

determining that values for a distinguished one of the context attributes whose values are contained by the log are available from an independent source; and

based upon the determination, selecting the distinguished context attribute to which to apply a maintenance technique.

90. The method of claim 54 wherein the computing device in which the method is performed is a mobile computer system.

91. The method of claim 54 wherein the computing device in which the method is performed is a body-supported computer system.

63. A method in a computing device for retroactively analyzing a log of context attribute values, each context attribute value contained by the log being stored with an indication of a corresponding data item and an indexing value, the method comprising:

receiving a specification for analyzing values among the stored values, the specification specifying one or more context attributes, a range of indexing values, and an analysis technique;

retrieving stored values for the specified context attributes within the specified range of indexing values; and

applying the specified analysis technique to the retrieved values to produce an analysis of the context attributes.

64. The method of claim 63 wherein the indexing values are effective times associated with the data items.

65. The method of claim 63 wherein a first portion of the retrieved values were produced by a first attribute value-producing computing device and a second portion of the retrieved values that is distinct from the first portion of the retrieved values were produced by a second attribute value-producing computing device.

66. The method of claim 63 wherein the specified analysis technique is a summarization technique.

67. The method of claim 63 wherein the specification specifies two or more context attributes and specifies an analysis technique that involves combining values of the specified context attributes.

68. The method of claim 63 wherein application of the specified analysis technique produces a new context attribute value.

69. The method of claim 63 wherein a rule designed for analyzing context attribute values in real-time to produce a result is available in the computing device, and wherein the specified analysis technique includes determining a result that would have been produced if the rule had been applied to analyze the specified context attribute values at the time they were generated.

70. The method of claim 69 wherein the available rule is obtained from a second, distinct computing device in which the available rule has already been adopted.

71. The method of claim 69, further comprising adopting the rule for future real-time application if it is determined that a successful result would have been produced if the rule had been applied to analyze the specified context attribute values at the time they were generated.

72. The method of claim 63 wherein the specified analysis technique identifies a recurring pattern in the retrieved context attribute values.

73. The method of claim 72, further comprising:

determining that the most recent pattern recurrence is identified in context attribute values having effective times only shortly preceding the present time;

determining that the retrieved context values include context values reflecting an action taken by a user subsequent and proximal to at least one earlier occurrence of the pattern; and

based upon both determinations, making preparations in anticipation of repetition of the action by the user.

74. The method of claim 72, further comprising:

determining that the most recent pattern recurrence is identified in context attribute values having effective times only shortly preceding the present time;

determining that the retrieved context values include context values reflecting commands issued by a user subsequent and proximal to at least one earlier occurrence of the pattern; and

based upon both determinations, presenting to the user an offer to repeat the issued commands.

75. The method of claim 63 wherein the specified analysis technique identifies in the retrieved context attribute values a pattern specified outside the log.

76. The method of claim 75 wherein the pattern specified outside the log characterizes a particular diagnosis of user condition, and wherein the specified analysis technique further attributes the diagnosis to the user condition reflected in the retrieved context attribute values.

77. The method of claim 76 wherein the diagnosis characterized by the pattern specified outside the log is a medical diagnosis.

92. The method of claim 63 wherein the computing device in which the method is performed is a mobile computer system.

93. The method of claim 63 wherein the computing device in which the method is performed is a wearable computer system.

78. A computing device for retroactively analyzing a log of context attribute values, each context attribute value contained by the log being stored with an indication of a corresponding data item and an indication of its effective time, comprising:

a specification receiver that receives a specification for analyzing values among the stored values, the specification specifying one or more context attributes, a range of effective times, and an analysis technique;

a value retrieval subsystem that retrieves stored values for the specified context attributes within the specified range of effective times; and

an analysis subsystem that applies the specified analysis technique to the retrieved values to produce an analysis of the context attributes.

79. The computing device of claim 78 wherein the computing device is a mobile computer system.

80. The computing device of claim 78 wherein the computing device is a wearable computer system.

81. A method in a computing device for specifying the simulation of selected earlier-occurring conditions, comprising:

displaying a list of context attributes available in the computing device;

receiving user input identifying a subset of the displayed available context attributes to include in a simulation; and

selecting the identified context attributes for inclusion in the simulation,

such that, when the simulation is initiated, earlier-recorded values of the selected context attributes will be substituted for current values of the selected context attributes.

82. The method of claim 81 wherein a sequence of values of each of the selected context attributes is to be recorded, the method further comprising receiving user input specifying a speed at which to substitute the values of each sequence for the current values of the selected context attributes relative to a speed at which the sequences of values are to be recorded.

83. A method in a computing device for conducting a simulation of selected earlier-occurring conditions for the benefit of a data consumer, comprising:

of a multiplicity of data items whose values are available in real-time in the computing device, selecting a subset of the available data items to include in the simulation;

during a simulation period, for each of the selected data items, making available a sequence of earlier-recorded values for the selected data item in place of the real-time values of the selected data item,

such that, during the simulation period, earlier-recorded values are available for the selected data items, while real-time values are available for data items other than the selected data items.

84. The method of claim 83 wherein data item values are provided by a characterization module in response to requests from data item consumers, the method further comprising, in the characterization module:

receiving a request for a data item from a requesting data item consumer;

determining whether the requested data item is among the selected data items;

if the requested data item is among the selected data items, providing the requesting data item consumer with an earlier-recorded value of the data item; and

if the requested data item is not among the selected data items, providing the requesting data item consumer with a real-time value of the data item.

85. The method of claim 84, further comprising, if the requested data item is not among the selected data items, obtaining the provided real-time value of the data item from a source associated with the data item.

94. The method of claim 83 wherein the computing device in which the method is performed is a mobile computer system.

95. The method of claim 83 wherein the computing device in which the method is performed is a body-supported computer system.

96. The method of claim 83, further comprising, before making available a sequence of earlier-recorded values for the selected data item in place of the real-time values of the selected data items, modifying at least one of the earlier-recorded values in the sequence.

97. The method of claim 83, further comprising receiving user input identifying data items to include in the simulation, and wherein the data items identified by the user input are selected to include in the simulation.

98. The method of claim 83, further comprising receiving user input specifying the simulation period.

99. A method in a computing device for retrospectively analyzing experiences of a human user of a general-purpose computing device, comprising:

of a multiplicity of data items relating to experiences of the human user, reiteratively obtaining and storing values of a selected plurality of the multiplicity, each stored value of a data item being stored with an indication of the data item and an indication of an effective time of the stored value;

after storing the values, receiving a specification for analyzing values among the stored values that specifies one or more data items, a range of effective times, and an analysis technique;

retrieving stored values for the specified data items within the specified range of effective times; and

applying the specified analysis technique to the retrieved values to produce an analysis of experiences of the human user.

100. The method of claim 99 wherein the computing device in which the method is performed is a general-purpose mobile computer system.

101. The method of claim 99 wherein the computing device in which the method is performed is a general-purpose wearable computer system.

102. The method of claim 99 wherein the computing device in which the method is performed is a body-supported general-purpose computer system.

103. The method of claim 99, further comprising storing in conjunction with the stored data item values the following additional units of information relating to the stored data item values:

data item name, uncertainty, units, source, and storage time.

104. The method of claim 99 wherein the stored values are stored in a sparse matrix.

105. One or more computer memories that collectively contain a context attribute log data structure, the data structure comprising multiple entries each corresponding to a context attribute value such that each entry contains information identifying a context attribute, an effective time, and a value produced for the context attribute having the effective time,

such that the data structure may be used to determine values produced for a context attribute having an effective time within a range of effective times.

106. The computer memories of claim 105 wherein each entry further specifies an uncertainty level characterizing the likely level of accuracy in the value of the entry.

107. The computer memories of claim 105 wherein each entry further specifies units in which the value of the entry is expressed.

108. The computer memories of claim 105 wherein each entry further identifies the time at which the entry was stored.

109. The computer memories of claim 105 wherein each entry further identifies the source of the value of the entry.