Logging and analyzing computer user's context data

• US 8,626,712 B2
• Filed: 06/28/2010
• Issued: 01/07/2014
• Est. Priority Date: 12/18/1998
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Abbott, Kenneth H., Freedman, Joshua M., Newell, Dan, Robarts, James O.
• Primary Examiner(s): OBISESAN, AUGUSTINE KUNLE
• Application Number:
  US12/824,508
• Publication Number:
  US 20100262573A1
• Time in Patent Office: 1,289 Days
• Field of Search: None
• US Class Current: 707/631
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/901 Indexing; Data structures therefor; Storage structures for retrieval from the web G06F16/951
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: Y10S 707/921 Spatial
• CPC Class Codes: Y10S 707/941 Human sciences
• CPC Class Codes: Y10S 707/962 Entity-attribute-value

Abstract

A facility for logging context attributes is described. For each of a set of selected context attributes, the facility, determines a target frequency with which values of the selected context attribute are to be logged. For each of the set of selected context attributes, the facility obtains values of the selected context attribute at a frequency approximating the target frequency determined for the selected context attribute. Then, for each obtained context attribute value, the facility writes the obtained value to a storage device in a manner that identifies its context attribute.

Claims

1. A method for retroactively analyzing a log of context attribute values associated with a user, each context attribute value contained by the log is stored with an indication of a corresponding data item and an indexing value, the method comprising:

receiving from at least one application a specification for analyzing values among the stored values, the specification specifying one or more context attributes, a range of indexing values that are effective times associated with data items, and an analysis technique applicable to the data items, the analysis technique includes at least one of summarization, combination, new value generation, ongoing analysis, pattern analysis, or retrospective application of rules, the retrospective application of rules includes a determination of a result that would have been produced had a rule been applied to analyze the specified context attribute values at the time the values were generated, the rule configured for analyzing context attribute values in real-time to produce a result and is adoptable for future real-time application when it is determined that a successful result would have been produced had the rule been applied to analyze the specified context attribute values at the time the values were generated;

retrieving stored values for the specified context attributes associated with the user of a computing device within the specified range of indexing values, a first subset of the stored values for one of the specified context attributes being associated with a first source device, and a second subset for the stored values for the one of the specified context attributes being associated with a second source device;

applying the specified analysis technique to the retrieved values to produce an analysis of the context attributes that infers information representing at least one of the user'"'"'s physical activity, emotional state, or cognitive load; and

operating the at least one application to receive and use the inferred information.

2. The method of claim 1, wherein:

the specified analysis technique is a summarization technique that summarizes values of one context attribute instance or values of a plurality of context attribute instances in a single log record.

3. The method of claim 1, wherein the first source device is a source of geographic information, and the second source device is a source of physiological information relating to the user of the computing device.

4. The method of claim 1, wherein:

the specified analysis technique identifies a recurring pattern in the retrieved context attribute values; and

the method further comprises;

determining that a most recent pattern recurrence is identified in context attribute values having effective times only shortly preceding the present time;

determining that the retrieved context values include context values reflecting an action taken by a user subsequent and proximal to at least one earlier occurrence of the pattern; and

based upon both determinations, making preparations in anticipation of repetition of the action by the user.

5. A computing device comprising:

a memory; and

a processor that retroactively analyzes a log of context attribute values, each context attribute value contained by the log being stored with an indication of a corresponding data item, a specification specifying one or more context attributes associated with the context attribute values of the log, a range of effective times associated with the data items, and an analysis technique applicable to the data items, the analysis technique includes an identification of a recurring pattern in the one or more context attribute values, a first determination that a most recent pattern recurrence is identified in the one or more context attribute values having effective times only shortly before a present time, a second determination that the one or more context attribute values include context attribute values reflecting an action taken by a user subsequent and proximal to at least one earlier occurrence of the pattern, and a making of preparations in anticipation of repetition of the action by the user based on the first and the second determinations, the processor configured to act as;

a value retrieval subsystem that, based on the specification, retrieves stored values from the memory for one or more specified context attributes, wherein a first subset of the retrieved values associated with one of the specified context attributes is associated with a first data source providing geographic information, and a second subset of the retrieved values associated with a second data source providing physiological information about a user; and

an analysis subsystem that applies the specified analysis technique to the retrieved values to determine a status of the user based on the geographic information and the physiological information.

6. The computing device of claim 5, wherein the computing device is a mobile computer system.

7. The computing device of claim 5, wherein the computing device in which the method is performed is a body-supported computer system.

8. The computing device of claim 5, wherein the analysis subsystem determines that the status of the user relates to embarking on a mode of transportation.

9. The computing device of claim 5, wherein:

the value retrieval subsystem retrieves stored values from the memory for the one or more specified context attributes based on the specification; and

the analysis subsystem applies the analysis technique selected based on the specification.

10. The computing device of claim 5, wherein the analysis subsystem determines a cognitive load of the user.

11. The computing device of claim 5, wherein the analysis technique further includes at least one of summarization, combination, retrospective application of rules, or ongoing analysis.

12. A computer-readable storage device having computer-executable instructions stored thereon, which when executed perform acts, comprising:

for each of a set of data items relating to experiences of a human user of a computing device, enabling at least one processor to iteratively obtain and store values of a selected subset of the set of data items, each stored value of a data item being stored with an indication of the data item and an indication of an effective time of the stored value, at least one data item obtaining values from a plurality of data sources, the data sources comprising at least one of a source of geographic information and physiological information;

enabling the at least one processor to receive, from at least one application that performs logged context attribute analysis, a specification for analyzing values among the stored values that specifies one or more data items, a range of effective times, and an analysis technique applicable to the data items, the analysis technique includes determining a result that would have been produced had a rule been applied to analyze the specified context attribute values at the time the values were generated, the rule configured for analyzing context attribute values in real-time to produce a result, the rule adopted for future real-time application when it is determined that a successful result would have been produced had the rule been applied to analyze the specified context attribute values at the time the values were generated;

enabling the at least one processor to retrieve stored values for the specified data items within the specified range of effective times and retrieving the real time values for the remaining non-specified data items;

enabling the at least one processor to apply the specified analysis technique to the retrieved values using the specified one or more context attributes to produce an analysis of experiences of the human user; and

enabling the at least one processor to select an operating characteristic of the computing device based on inferring a current or future status of the human user based on the analysis of experiences of the human user.

13. The computer-readable storage device of claim 12, wherein said enabling the at least one processor to select the operating characteristic of the computing device comprises enabling the at least one processor to select an output behavior for the computing device.

14. The computer-readable storage device of claim 13, wherein said enabling the at least one processor to select the output behavior comprises presenting information in a format that restricts access to the information.

15. The computer-readable storage device of claim 12, further comprising:

enabling the at least one processor to receive a specification of a user-selected mediation technique.

16. The computer-readable storage device of claim 12, wherein said enabling the at least one processor to store values of the selected subset of the set of data items comprises:

enabling the at least one processor to store the values in a sparse matrix.

17. The computer-readable storage device of claim 12, further comprising, enabling the at least one processor to:

receive a user specification of a user-selected mediation technique; and

employ the user-selected mediation technique to select which one of the plurality of data sources will supply values for the analysis.

18. The computer-readable storage device of claim 12, wherein the computing device is a general-purpose mobile computer system.

19. The computer-readable storage device of claim 12, wherein the analysis technique further includes at least one of summarization, combination, pattern analysis, or ongoing analysis.

20. The computer-readable storage device of claim 12, wherein the experiences of the human user include a physical activity, an emotional state, or a cognitive load of the human user.