Collecting, aggregating, and presenting activity data

• US 9,317,390 B2
• Filed: 06/03/2011
• Issued: 04/19/2016
• Est. Priority Date: 06/03/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Chisa, Ellen Lizabeth, Ramanathan, Rajesh, Hoof, Hubert Van
• Primary Examiner(s): Sax, Steven
• Assistant Examiner(s): Varga, Wilson
• Application Number:
  US13/152,330
• Publication Number:
  US 20120311447A1
• Time in Patent Office: 1,782 Days
• Field of Search: 715/963, 715/863, 715/719
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3082 the data filtering being achieved by aggregating or compressing the monitored data
• CPC Class Codes: G06F 11/32 with visual or acoustical indication of the functioning of the machine
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 2201/865 Monitoring of software

Abstract

Activity data generated during a day or other time period on one or more computing devices is collected and aggregated. The aggregated data is then presented through an activity review user interface. The activity review user interface can be presented on a large format display device, such as a projector or television. The activity review user interface can also be navigated using natural input methods, such as gesture and voice input.

Claims

1. A computer-implemented method comprising performing computer-implemented operations for:

collecting activity data generated by two or more application programs executing on two or more computing devices during a time period for a user of the two or more computing devices;

aggregating the collected activity data to generate aggregated activity data for the time period,

wherein the aggregated activity data comprises an activity overview video that summarizes the activity data collected during the time period and a user interface to allow the review of the aggregated activity data, wherein the activity overview video comprises a multimedia file and

wherein the aggregated activity data further comprises one or more of calendar data, location data, notes data, message data, audio data, video data, or a document utilized on or generated by the computing device during the time period;

providing the aggregated data to the two or more computing devices, wherein at least one of the two or more devices is a portable device; and

providing the user interface for reviewing the aggregated activity data on the two or more computing devices, at least one of the two or more computing devices configured to provide the user interface on a large format display device.

2. The computer-implemented method of claim 1, wherein the two or more computing devices are configured to aggregate the collected activity data to generate the aggregated activity data.

3. The computer-implemented method of claim 1, wherein the two or more computing devices and a server computer are configured to aggregate the collected activity data to generate the aggregated activity data.

4. The computer-implemented method of claim 1, wherein the user interface for reviewing the aggregated activity data is provided by any of the two or more computing devices.

5. The computer-implemented method of claim 4, wherein at least one of the two or more computing devices is connected to the large format display device and configured to display the user interface on the large format display device.

6. The computer-implemented method of claim 1, wherein the user interface for reviewing the aggregated activity data can be navigated using gesture input.

7. The computer-implemented method of claim 6, wherein the user interface for reviewing the aggregated activity data can further be navigated using voice input.

8. The computer-implemented method of claim 1, wherein the aggregated activity data presented in the user interface is organized chronologically.

9. The computer-implemented method of claim 1, wherein the aggregated activity data presented in the user interface is organized according to one or more projects.

10. The computer-implemented method of claim 1, wherein the aggregated activity data presented in user interface is organized according to one or more tasks created during a meeting.

11. The computer-implemented method of claim 1, wherein the aggregated activity data presented in the user interface is organized according to one or more people associated with the activity data.

12. The computer-implemented method of claim 1, wherein the aggregated activity data presented in the user interface is organized according to a location of one of the two or more computing devices.

13. The computer-implemented method of claim 1, wherein the aggregated activity data presented in the user interface is organized according to an event.

14. A computer-readable storage medium having computer-executable instructions stored thereupon which, when executed by a computer, cause the computer to:

collect activity data generated on two or more application programs executing on two or more devices during a time period for a user of the two or more computing devices, wherein at least one of the two or more devices is a portable device;

aggregate the collected activity data to generate aggregated activity data for the time period,

wherein the aggregated activity data comprises an activity overview video that summarizes the activity data collected during the time period and a user interface to allow the review of the aggregated activity data, wherein the activity overview video comprises a multimedia file and

wherein the aggregated activity data further comprises one or more of calendar data, location data, notes data, message data, audio data, video data, or a document utilized on or generated by the two or more computing devices during the time period;

provide the aggregated data to the two or more devices; and

provide the user interface for reviewing the aggregated activity data on the two or more devices, at least one of the two or more devices configured to provide the user interface on a large format display device.

15. The computer-readable storage medium of claim 14, wherein the user interface comprises an interface for navigating the activity data that can be navigated using gesture and voice input.

16. The computer-readable storage medium of claim 15, wherein the collected activity data is aggregated at one or more of the two or more devices or a server computer.

17. The computer-readable storage medium of claim 16, wherein the user interface provides functionality for transmitting an e-mail message to one or more meeting attendees and to generate and display a task list containing tasks generated during a meeting.

18. An apparatus comprising:

a processor; and

a computer-readable storage media having executable instructions stored thereupon which, when executed by the processor, cause the apparatus to

collect activity data generated by two or more applications executing on two or more computing devices during a day, wherein at least one of the two or more devices is a portable device;

provide the collected activity data to the two or more computing devices;

aggregate the collected activity data to generate an activity overview video that summarizes the activity data collected during the day by one or more of chronologically, by event, according to projects or tasks, by people associated with the activity data and a geographical location of the computing devices when the activity data was collected;

provide a user interface for reviewing the aggregated activity data on the two or more computing devices, at least one of the two or more computing devices configured to provide the user interface on a large format display device for viewing the activity overview video, the activity overview video comprises a multimedia file; and

to enable the use of gesture input to navigate the activity overview video shown on the large format display device.

19. The apparatus of claim 18, wherein the aggregated activity data presented in the user interface is organized according to a location of one of the two or more computing devices.

20. The apparatus of claim 18, wherein the aggregated activity data presented in the user interface is organized according to an event.