METHOD AND SYSTEM FOR GENERATING USER LIFELOG

• US 20150169659A1
• Filed: 11/06/2014
• Published: 06/18/2015
• Est. Priority Date: 12/13/2013
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Ho Dong, Roh, Yo Han, Yoo, Sang Hyun, Lee, Ji Hyun, Hong, Seok Jin
• Application Number:
  US14/534,832
• Publication Number:
  US 20150169659A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A method of generating a user lifelog includes dividing detection data into data units; recognizing a plurality of user activities from arrangements of the data units; generating a plurality of user activity logs by time-sequentially linking the plurality of the recognized user activities; and generating a user lifelog by hierarchically structuring the plurality of user activity logs based on a correlation between the user activity logs.

Claims

1. A method of generating a user lifelog, the method comprising:

dividing detection data into data units based on a predetermined condition;

recognizing a plurality of user activities from arrangements of the data units;

generating a plurality of user activity logs by time-sequentially linking the plurality of user activities; and

generating a user lifelog by hierarchically structuring the plurality of user activity logs based on a correlation between the user activity logs.

2. The method of claim 1, wherein the detection data is generated periodically at a predetermined interval of time or whenever a predetermined event occurs.

3. The method of claim 1, wherein the recognizing of the plurality of user activities comprises:

combining the data units into an arrangement of data units based on a semantic correlation of each of the data units using description logic;

comparing the arrangement of data units with a predetermined activity condition;

determining whether the arrangement of data units corresponds to the predetermined activity condition based on a result of the comparing; and

recognizing the arrangement of data units as an activity corresponding to the predetermined activity condition in response to a result of the determining being that the arrangement of data units corresponds to the predetermined activity condition.

4. The method of claim 1, the generating of the plurality of user activity logs comprises:

combining the plurality of user activities into an arrangement thereof based on a semantic correlation of each of the plurality of user activities using description logic;

comparing the arrangement of user activities with a predetermined activity log condition;

determining whether the arrangement of user activities corresponds to the predetermined activity log condition based on a result of the comparing; and

recognizing the arrangement of user activities as an activity log corresponding to the predetermined activity log condition in response to a result of the determining being that the arrangement of user activities corresponds to the predetermined activity log condition.

5. The method of claim 1, wherein the generating of the user lifelog comprises:

combining the plurality of user activity logs into an arrangement thereof based on a semantic correlation of each of the plurality of user activity logs using description logic;

comparing the arrangement of user activity logs with a predetermined lifelog condition;

determining whether the arrangement of user activity logs corresponds to the predetermined lifelog condition based on a result of the comparing; and

recognizing the arrangement of user activity logs as a lifelog corresponding to the predetermined lifelog condition in response to a result of the determining being that the arrangement of user activity logs corresponds to the predetermined lifelog condition.

6. The method of claim 1, further comprising processing data included in the user lifelog using a predetermined daily task summary template.

7. The method of claim 1, further comprising generating a natural language summary with respect to the user lifelog using template-based natural language generation technology.

8. The method of claim 1, further comprising:

adding at least one piece of data among weather information, a call history, and SNS activity information to the user lifelog as journal data; and

generating a journal written in a natural language from the journal data.

9. A system for generating a user lifelog, the system comprising:

a detector configured to generate detection data;

a preprocessor configured to divide the detection data into data units based on a predetermined condition;

an activity recognizer configured to recognize a plurality of user activities from arrangements of the data units;

an activity log generator configured to generate a plurality of user activity logs by time-sequentially linking the plurality of user activities recognized by the activity recognizer; and

a lifelog generator configured to generate a user lifelog by hierarchically structuring the plurality of user activity logs generated by the activity log generator based on a correlation between the plurality of user activity logs.

10. The system of claim 9, wherein the detector is further configured to generate the detection data periodically at a predetermined interval of time or whenever a predetermined event occurs.

11. The system of claim 9, wherein the activity recognizer comprises an inference engine configured to:

combine the data units into an arrangement of data units based on a semantic correlation of each of the data units using description logic;

compare the arrangement of data units with a predetermined activity condition;

determine whether the arrangement of data units corresponds to the predetermined activity condition based on a result of the comparing; and

recognize the arrangement of data units as an activity corresponding to the predetermined activity condition in response to a result of the determining being that the arrangement of data units corresponds to the predetermined activity condition.

12. The system of claim 9, wherein the activity log generator comprises an inference logic configured to:

combine the plurality of user activities into an arrangement of user activities based on a semantic correlation of each of the plurality of user activities using description logic;

compare the arrangement of user activities with a predetermined activity log condition;

determine whether the arrangement of user activities corresponds to the predetermined activity log condition based on a result of the comparing; and

recognize the arrangement of user activities as an activity log corresponding to the predetermined activity log condition in response to a result of the determining being that the arrangement of user activities corresponds to the predetermined activity log condition.

13. The system of claim 9, wherein the lifelog generator comprises an inference logic configured to:

combine the plurality of user activity logs into an arrangement of user activity logs based on a semantic correlation of each of the plurality of user activity logs using description logic;

compare the arrangement of user activity logs with a predetermined lifelog condition;

determine whether the arrangement of user activity logs corresponds to the predetermined lifelog condition based on a result of the comparing; and

recognize the arrangement of user activity logs as a lifelog corresponding to the predetermined lifelog condition in response to a result of the determining being that the arrangement of user activity logs corresponds to the predetermined lifelog condition.

14. The system of claim 9, further comprising a lifelog service provider configured to perform additional processing on the user lifelog generated by the lifelog generator and output the processed user lifelog to a user'"'"'s mobile computing device.

15. The system of claim 14, wherein the lifelog service provider is further configured to provide any one of or any combination of:

a service for processing data included in the user lifelog using a predetermined daily task summary template;

a service for generating a natural language summary with respect to the user lifelog using template-based natural language generation technology; and

a service for adding at least one piece of information among weather information, a call history, and SNS activity information as journal data, and generating a journal written in a natural language using template-based natural language generation technology from the journal data.

16. A method of generating a user lifelog, the method comprising:

collecting data about a user'"'"'s activities;

dividing the data into data units; and

generating a user lifelog of the user'"'"'s activities based on arrangements of the data units.

17. The method of claim 16, wherein the generating of the user lifelog comprises:

recognizing user activities from the arrangements of the data units based on predetermined activity conditions;

recognizing user activity logs from arrangements of the user activities based on predetermined activity log conditions; and

generating the user lifelog from the user activity logs based on a correlation between the user activity logs.

18. The method of claim 16, wherein the user lifelog comprises a plurality of user activity logs arranged in a hierarchical structure based on a correlation between the user activity logs.

19. The method of claim 18, wherein the user activity logs comprise a user activity log of user activities constituting a user activity in a user activity log higher in the hierarchical structure.

20. The method of claim 18, wherein the user activity logs comprise a user activity log of user activities occurring during other user activities in a user activity log higher in the hierarchical structure.

21. A mobile computing device comprising:

a detector configured to generate data about a user'"'"'s activities; and

a display configured to display a user lifelog of the user'"'"'s activities generated based on arrangements of data units obtained by dividing the data into the data units.

22. The mobile computing device of claim 21, wherein the user lifelog is generated by:

recognizing user activities from the arrangements of the data units based on predetermined activity conditions;

recognizing user activity logs from arrangements of the user activities based on predetermined activity log conditions; and

generating the user lifelog from the user activity logs based on a correlation between the user activity logs.

23. The mobile computing device of claim 21, wherein the user lifelog comprises a plurality of user activity logs arranged in a hierarchical structure based on a correlation between the user activity logs.

24. The mobile computing device of claim 23, wherein the user activity logs comprise a user activity log of user activities constituting a user activity in a user activity log higher in the hierarchical structure.

25. The mobile computing device of claim 23, wherein the user activity logs comprise a user activity log of user activities occurring during other user activities in a user activity log higher in the hierarchical structure.