METHOD AND SYSTEM FOR GENERATING HISTORY OF BEHAVIOR

• US 20110137836A1
• Filed: 08/12/2009
• Published: 06/09/2011
• Est. Priority Date: 09/19/2008
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Shintani, Takahiko, Motobayashi, Masahiro, Kuriyama, Hiroyuki
• Application Number:
  US13/058,596
• Publication Number:
  US 20110137836A1
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/002 Monitoring the patient using a local or closed circuit, e.g. in a room or building A61B5/0017 takes precedence
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/6824 Arm or wrist
• CPC Class Codes: A61B 5/6831 Straps, bands or harnesses
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Disclosed are method and system for generating history of behavior that is capable of simplifying input of a behavior content of a human behavior pattern determined from data measured by a sensor. A computer obtains biological information measured by a sensor which is mounted to a person and accumulates the biological information, obtains motion frequencies from the accumulated biological information, obtains time-series change points of the motion frequencies, extracts a period between the change points as a scene which is a period of being in the state of an identical motion, compares the motion frequencies with a preset condition for each extracted scene and identifies the action contents in the scene, estimates the behavior content performed by the person in the scene on the basis of the appearance sequence of the action contents, and generates the history of the behaviors on the basis of the estimated behavior contents.

Claims

1. An activity history generating method of generating an activity history with a sensor, which is worn by a person to measure living organism information, and a computer, which obtains the living organism information from the sensor to identify an action state of the person, comprising the steps of:

obtaining the living organism information by the computer and accumulating the living organism information on the computer;

obtaining, by the computer, an action count from the accumulated living organism information;

extracting, by the computer, a plurality of points of change in time series in the action count;

extracting, by the computer, a period between the points of change as a scene in which the same action state is maintained;

comparing, by the computer, the action count of each extracted scene against conditions set in advance to identify action details of the scene;

estimating, by the computer, details of an activity that is done by the person during the scene based on an appearance order of the action details; and

generating an activity history based on the estimated activity details.

2. The activity history generating method according to claim 1,

wherein the step of estimating details of an activity that is done by the person during the scene based on an appearance order of the action details comprises the step of comparing preset relations between activity details and action detail appearance orders with the appearance order of the action details of the scene to estimate, as candidates for activity details of the scene, activity details to which the appearance order of the action details of the scene is a match, and

wherein the step of generating an activity history based on the estimated activity details comprises the steps of:

choosing an activity detail candidate for the scene from among the estimated activity detail candidates; and

generating an activity history that contains the chosen activity detail candidate as the activity details of the scene.

3. The activity history generating method according to claim 1,

wherein the step of estimating details of an activity that is done by the person during the scene based on an appearance order of the action details comprises the steps of:

comparing preset relations between activity details and action detail appearance orders with the appearance order of the action details of the scene to estimate, as candidates for activity details of the scene, activity details to which the appearance order of the action details of the scene is a match; and

prioritizing the estimated activity detail candidates,

wherein the step of generating an activity history based on the estimated activity details comprises the steps of;

choosing an activity detail candidate for the scene from among the estimated activity detail candidates in the order of priority; and

generating an activity history that contains the chosen activity detail candidate as the activity details of the scene, and

wherein a place in the priority order is a value calculated based on a ratio of a frequency at which the estimated activity details become a candidate and a frequency at which the activity details are chosen as the activity history.

4. The activity history generating method according to claim 1, wherein the step of comparing, by the computer, the action count of each extracted scene against conditions set in advance to identify action details of the scene comprises the steps of:

determining from the action count of the scene whether or not the action details of the scene are “

walking”

;

determining from the action count of the scene whether or not the action details of the scene are “

sleeping”

; and

when the action details of the scene are neither “

walking”

nor “

sleeping”

, setting, to the scene, preset action details in accordance with a value of the action count of the scene.

5. The activity history generating method according to claim 1, further comprising the step of combining the scenes for which action details have been identified,

wherein the step of combining the scenes for which action details have been identified comprises combining a first scene, a second scene, and a third scene which are successive in time series when the action details of the first scene and the action details of the third scene are the same and the second scene satisfies a given condition.

6. The activity history generating method according to claim 1,

wherein the sensor comprises an acceleration sensor for detecting acceleration of an arm as the living organism information, and

wherein the step of obtaining, by the computer, an action count from the accumulated living organism information comprises obtaining a number of times the acceleration crosses a given threshold within a given time interval as the action count.

7. An activity history generating system, comprising:

a sensor worn by a person to measure living organism information;

a network for transferring the living organism information measured by the sensor to a computer; and

a computer which obtains the living organism information from the network to identify an action state of the person and, based on the action state, generates a history of activities done by the person,

wherein the computer comprises;

a data storing unit for accumulating the living organism information;

a scene splitting module for obtaining an action count from the living organism information accumulated in the data storing unit, and for obtaining a plurality of points of change in time series in the action count to extract a period between the points of change as a scene in which the same action state is maintained;

an activity detail analyzing module for comparing the action count of each extracted scene against conditions set in advance to identify action details of the scene, and for estimating details of an activity done by the person during the scene based on an appearance order of the action details; and

an activity history establishing module for generating an activity history based on the estimated activity details.

8. The activity history generating system according to claim 7,

wherein the activity detail analyzing module compares the preset relations between activity details and action detail appearance orders with the appearance order of the action details of the scene to estimate, as candidates for activity details of the scene, activity details to which the appearance order of the action details of the scene is a match, and

wherein the activity history establishing module receives a result of choosing an activity detail candidate for the scene from among the estimated activity detail candidates, and generates an activity history that contains the chosen activity detail candidate as the activity details of the scene.

9. The activity history generating system according to claim 7,

wherein the activity detail analyzing module compares the preset relations between activity details and action detail appearance orders with the appearance order of the action details of the scene to estimate, as candidates for activity details of the scene, activity details to which the appearance order of the action details of the scene is a match, and prioritizes the estimated activity detail candidates,

wherein the activity history establishing module receives a result of choosing an activity detail candidate for the scene from among the estimated activity detail candidates in the order of priority, and generates an activity history that contains the chosen activity detail candidate as the activity details of the scene, and

wherein a place in the priority order is a value calculated based on a ratio of a frequency at which the estimated activity details become a candidate and a frequency at which the activity details are chosen as the activity history.

10. The activity history generating system according to claim 7, wherein the activity detail analyzing module determines from the action count of the scene whether or not the action details of the scene are “

walking”

or “

sleeping” and

, when the action details of the scene are neither “

walking”

nor “

sleeping”

, sets, to the scene, preset action details in accordance with a value of the action count of the scene.

11. The activity history generating system according to claim 7, wherein the activity detail analyzing module combines a first scene, a second scene, and a third scene which are successive in time series when the action details of the first scene and the action details of the third scene are the same and the second scene satisfies a given condition.

12. The activity history generating system according to claim 7,

wherein the sensor comprises an acceleration sensor for detecting acceleration of an arm as the living organism information, and

wherein the scene splitting module obtains, as the action count, a number of times the acceleration crosses a given threshold within a given time interval.