Digital life recording and playback

• US 8,014,573 B2
• Filed: 01/03/2008
• Issued: 09/06/2011
• Est. Priority Date: 01/03/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Boomer, David Inman, Wilson, John David, Grim, Clifton E. III, Ward, Gary A., Marzke, Rex Edward
• Primary Examiner(s): DWIVEDI, MAHESH H
• Application Number:
  US11/968,772
• Publication Number:
  US 20090177679A1
• Time in Patent Office: 1,342 Days
• Field of Search: 382/115, 382/118
• US Class Current: 382/118
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

The illustrative embodiments described herein provide a computer implemented method, apparatus, and computer program product for managing data. A plurality of devices dynamically capture data associated with the daily activities of a person. The data is transmitted to a mobile device associated with the person. The data is processed and then stored into a cache of the mobile device. The data stored in the cache of the mobile device is uploaded into a repository mass store in response to interfacing the mobile device with the repository mass store. A selected data segment stored in the repository mass store is presented in response to receiving a request for the selected data segment.

Claims

1. A computer implemented method for managing digital life recording data, the computer implemented method comprising:

capturing data associated with daily activities of a first person using a plurality of data capturing devices associated with a first mobile digital life recording device associated with the first person to form captured data, wherein the captured data includes sound data, and video data;

processing the captured data using the first mobile digital life recording device wherein processing the captured data comprises;

organizing the sound data and the video data into a plurality of data segments; and

tagging each data segment within the plurality of data segments with a global positioning system location identifier and a timestamp;

storing the plurality of data segments into a cache of the first mobile digital life recording device; and

sending a portion of the plurality of data segments to a second mobile digital life recording device associated with a second person that is authorized by the first person to receive the portion of the plurality of data segments via a wireless network, wherein the plurality of data segments stored in the cache of the mobile device further comprises data retrieved from an information source over a wireless network, and wherein the information source is the second mobile digital life recording device associated with the second person;

responsive to interfacing the first mobile digital life recording device with a repository mass store, uploading and storing the plurality of data segments stored in the cache of the first mobile digital life recording device and data segments received from the second person of the second mobile digital life recording device into the repository mass store to form a plurality of uploaded data segments;

processing the plurality of uploaded data segments stored at the repository mass store, wherein processing the plurality of uploaded data segments comprises;

generating a text transcript of the sound data and a plurality of thumbnail images for the video data for each data segment within the plurality of uploaded data segments;

generating metadata associated with terms in the text transcript;

indexing each data segment within the plurality of uploaded data segments based on the global positioning system location identifier, the timestamp, and the text transcript; and

indexing the sound data in the plurality of uploaded data segments based on the metadata from the text transcript; and

responsive to receiving a request to view data within a selected period of time, presenting the sound data, the video data, the plurality of thumbnail images, and the text transcript for each data segment within the plurality of uploaded data segments stored at the repository mass store within the selected period of time using a user interface.

2. The computer implemented method of claim 1, wherein indexing each data segment within the plurality uploaded of data segments further comprises:

indexing additional metadata associated with a data segment of the plurality of uploaded data segments into an indexing database, wherein the additional metadata describes the content, quality, condition, and origin of the data segment.

3. The computer implemented method of claim 1, wherein the plurality of data capturing devices comprises of a set of video capturing devices, a set of audio capturing devices, a set of biometric capturing devices, a set of global positioning devices, and a set of environmental sensor devices.

4. The computer implemented method of claim 1, wherein processing the plurality of uploaded data segments comprises:

identifying at least one known human contact other than the first person in a number of uploaded data segments of the plurality of uploaded data segments;

wherein indexing each data segment within the plurality of uploaded data segments further comprises;

indexing each data segment within the plurality of uploaded data segments based on the at least one known human contact other than the first person in the number of uploaded data segments of the plurality of uploaded data segments.

5. The computer implemented method of claim 4, further comprising:

extracting a voice command from the plurality of data segments using a speech recognition filter; and

executing a function associated with the voice command.

6. The computer implemented method of claim 5, wherein the voice command specifies a tagging operation and a text index that is associated with a data segment within the plurality of data segments.

7. The computer implemented method of claim 1, further comprising:

responsive to storing the plurality of data segments into the cache of the mobile device to form collected data, presenting the plurality of data segments to the person using a monitoring device.

8. The computer implemented method of claim 1, wherein uploading the plurality of data segments comprises:

processing the plurality of data segments stored in the cache of the mobile device prior to storing the plurality of data segments into the repository mass store.

9. The computer implemented method of claim 1, further comprising:

extracting a command from a script; and

executing functions associated with the command.

10. The computer implemented method of claim 1, wherein the plurality of data capturing devices captures a 360 degree field of view around the person.

11. The computer implemented method of claim 1, wherein at least one of the plurality of data capturing devices is embedded in the person.

12. The computer implemented method of claim 1, wherein the information source is an internet source.

13. A computer program product comprising:

a computer recordable storage medium including computer usable program code for managing digital life recording data, said computer program product comprising;

computer usable program code for capturing data associated with daily activities of a first person using a plurality of data capturing devices associated with a first mobile digital life recording device associated with the first person to form captured data, wherein the captured data includes sound data, and video data;

computer usable program code for processing the captured data using the first mobile digital life recording device, wherein the computer usable program code for processing the captured data comprises;

computer usable program code for organizing the sound data and the video data into a plurality of data segments;

computer usable program code for tagging each data segment within the plurality of data segments with a global positioning system location identifier and a timestamp;

computer usable program code for storing the plurality of data segments into a cache of the first mobile digital life recording device;

computer usable program code for sending a portion of the plurality of data segments to a second mobile digital life recording device associated with a second person that is authorized by the first person to receive the portion of the plurality of data segments via a wireless network, wherein the plurality of data segments stored in the cache of the mobile device further comprises data retrieved from an information source over a wireless network, and wherein the information source is the second mobile digital life recording device associated with the second person;

computer usable program code for uploading and storing the plurality of data segments stored in the cache of the first mobile digital life recording device and data segments received from the second person of the second mobile digital life recording device into a repository mass store to form a plurality of uploaded data segments in response to interfacing the first mobile digital life recording device with the repository mass store;

computer usable program code for processing the plurality of uploaded data segments stored at the repository mass store, wherein the computer usable program code for processing the plurality of uploaded data segments comprises;

computer usable program code for generating a text transcript of the sound data a plurality of thumbnail images for and the video data for each data segment within the plurality of uploaded data segments;

computer usable program code for generating metadata associated with terms in the text transcript;

computer usable program code for indexing each data segment within the plurality of uploaded data segments based on the global positioning system location identifier, the timestamp, and the text transcript; and

computer usable program code for indexing the sound data in the plurality of uploaded data segments based on the metadata from the text transcript; and

computer usable program code for presenting the sound data, the video data, the plurality of thumbnail images, and the text transcript for each data segment within the plurality of uploaded data segments stored at the repository mass store within a selected period of time using a user interface in response to receiving a request to view data within the selected period of time.

14. The computer program product of claim 13, wherein the computer usable program code for indexing each data segment within the plurality of uploaded data segments further comprises:

computer usable program code for indexing additional metadata associated with a data segment of the plurality of uploaded data segments into an indexing database, wherein the additional metadata describes the content, quality, condition, and origin of the data segment.

15. The computer program product of claim 13, wherein the plurality of data capturing devices comprises of a set of video capturing devices, a set of audio capturing devices, a set of biometric capturing devices, a set of global positioning devices, and a set of environmental sensor devices.

16. A digital life recording system comprising:

a plurality of data capturing devices associated with a first mobile digital life recording device associated with a first person, the plurality of data capturing devices configured to capture data associated with daily activities of a first person to form captured data, wherein the captured data includes sound data, and video data;

a first mobile digital life recording device associated with the first person configured to process and store the captured data to form stored data, wherein the first mobile digital life recording device organizes the sound data and the video data into a plurality of data segments;

tags each data segment within the plurality of data segments with a global positioning system location identifier and a timestamp;

store the plurality of data segments into a cache of the first mobile digital life recording device; and

send a portion of the plurality of data segments to a second mobile digital life recording device associated with a second person that is authorized by the first person to receive the portion of the plurality of data segments via a wireless network, wherein the plurality of data segments stored in the cache of the mobile device further comprises data retrieved from an information source over a wireless network, and wherein the information source is the second mobile digital life recording device associated with the second person;

a storage device configured to receive and store the plurality of data segments stored in the cache of the first mobile digital life recording device and data segments received from the second person of the second mobile digital life recording device into the repository mass store to form a plurality of uploaded data segments in response to interfacing the first mobile digital life recording device with the storage device;

a data processing system configured to process the plurality of uploaded data segments stored at the storage device;

generate a text transcript of the sound data and a plurality of thumbnail images for the video data for each data segment within the plurality of data segments;

generate metadata associated with terms in the text transcript;

index each data segment within the plurality of uploaded data segments based on the global positioning system location identifier, the timestamp, and the text transcript;

index the sound data in the plurality of uploaded data segments based on the metadata from the text transcript; and

retrieve and present the sound data, the video data, the plurality of thumbnail images, and the text transcript for each data segment within the plurality of uploaded data segments stored on the storage device within the selected period of time to a user in response to receiving a request to view data within a selected period of time.

17. An apparatus comprising:

a bus system;

a communications system connected to the bus system;

a memory connected to the bus system, wherein the memory includes computer usable program code; and

a process unit connected to the bus system, wherein the process unit executes the computer usable program code to capture data associated with daily activities of a first person using a plurality of data capturing devices associated with a first mobile digital life recording device associated with the first person to form captured data, wherein the captured data includes sound data, and video data;

process the captured data using the first mobile digital life recording device, wherein processing the captured data comprises;

organizing the sound data and the video data into a plurality of data segments;

tagging each data segment within the plurality of data segments with a global positioning system location identifier and a timestamp;

storing the plurality of data segments into a cache of the first mobile digital life recording device; and

sending a portion of the plurality of data segments to a second mobile digital life recording device associated with a second person that is authorized by the first person to receive the portion of the plurality of data segments via a wireless network, wherein the plurality of data segments stored in the cache of the mobile device further comprises data retrieved from an information source over a wireless network, and wherein the information source is the second mobile digital life recording device associated with the second person;

upload and store the plurality of data segments stored in the cache of the first mobile digital life recording device and data segments received from the second person of the second mobile digital life recording device into the repository mass store to form a plurality of uploaded data segments in response to interfacing the first mobile digital life recording device with a repository mass store;

process the plurality of uploaded data segments stored at the repository mass store, wherein processing the plurality of uploaded data segments comprises;

generating a text transcript of the sound data and a plurality of thumbnail images for the video data for each data segment within the plurality of uploaded data segments;

generating metadata associated with terms in the text transcript;

indexing each data segment within the plurality of uploaded data segments based on the global positioning system location identifier, the timestamp, and the text transcript; and

indexing the sound data in the plurality of uploaded data segments based on the metadata from the text transcript; and

present the sound data, the video data, the plurality of thumbnail images, and the text transcript for each data segment within the plurality of uploaded data segments stored at the repository mass store within a selected period of time using a user interface in response to receiving a request to view data within the selected period of time.