MONITORING ASSISTANCE SYSTEM, CONTROL METHOD THEREOF, AND PROGRAM

• US 20190313948A1
• Filed: 11/28/2017
• Published: 10/17/2019
• Est. Priority Date: 03/02/2017
• Status: Active Grant

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Matsunaga, Jumpei, Tanaka, Kiyoaki, Takahashi, Shinji, Murakami, Tatsuya
• Granted Patent: US 10,786,183 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1113 Local tracking of patients, e.g. in a hospital or private home
• CPC Class Codes: A61B 5/1117 Fall detection
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: A61G 12/00 Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food service or tea-tables, trolleys or wagons A47B31/00; Prescription lists
• CPC Class Codes: A61G 7/05 Parts, details or accessories of beds devices for prevention against falling out A47C21/08, A47D7/00 ; mattresses A47C27/00
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/22 responsive to presence or absence of persons
• CPC Class Codes: H04N 2201/0079 Medical imaging device
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A watching assistance system that assists watching over a subject on a bed includes an image acquisition unit configured to acquire an image captured by an imaging device, a criterion storage in which a criterion for determining a dangerous state are previously set for each of a plurality of determination regions set based on a region of the bed in the image, a detector configured to detect the subject from the image acquired by the image acquisition unit, a state recognition unit configured to recognize a state of the subject detected by the detector, a determination unit configured to determine a danger degree of the state of the subject recognized by the state recognition unit using the criterion for the determination region corresponding to a position at which the subject is detected by the detector, and an output unit configured to provide notification according to the danger degree determined by the determination unit.

Claims

1. A watching assistance system that assists watching over a subject on a bed, the watching assistance system comprising:

an image acquisition unit configured to acquire an image captured by an imaging device;

a criterion storage in which a criterion for determining a dangerous state is previously set for each of a plurality of determination regions set based on a region of the bed in the image;

a detector configured to detect the subject from the image acquired by the image acquisition unit;

a state recognition unit configured to recognize a state of a head of the subject including a head orientation of the subject detected by the detector;

a determination unit configured to determine a danger degree of the state of the head of the subject recognized by the state recognition unit using the criterion for the determination region corresponding to a position at which the subject is detected by the detector; and

an output unit configured to provide notification according to the danger degree determined by the determination unit.

4. The watching assistance system according to claim 1, wherein

the state of the head includes a plurality of items including at least one of a head moving speed, a head moving direction, and a head moving vector in addition to the head orientation, and

the determination unit determines the danger degrees relating to the plurality of items and determines the danger degree of the state of the head by integrating the danger degrees relating to the plurality of items.

5. The watching assistance system according to claim 1, wherein the output unit does not provide notification when the determined danger degree is smaller than a threshold.

8. The watching assistance system according to claim 4, wherein the output unit does not provide notification when the determined danger degree is smaller than a threshold.

2-3. -3. (canceled)

6. A method for controlling a watching assistance system that assists watching over a subject on a bed, the watching assistance system control method comprising:

a step of acquiring an image captured by an imaging device;

a step of previously setting a criterion for determining a dangerous state for each of a plurality of determination regions set based on a region of the bed in the image;

a step of detecting the subject from the acquired image;

a step of recognizing a state of a head of the subject including a head orientation of the detected subject;

a step of determining a danger degree of the state of the head of the recognized subject using the criterion for the determination region corresponding to the position at which the subject is detected; and

a step of providing notification according to the determined danger degree.

7. A program causing a computer to perform each step of the watching assistance system control method according to claim 6.