METHODS AND SYSTEMS FOR DETECTING PROHIBITED OBJECTS IN A PATIENT ROOM

• US 20180137340A1
• Filed: 12/20/2017
• Published: 05/17/2018
• Est. Priority Date: 12/31/2015
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: KUSENS, MICHAEL, KUSENS, NEIL
• Granted Patent: US 10,303,924 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1176 Recognition of faces
• CPC Class Codes: A61B 5/4064 Evaluating the brain A61B5/031, A61B5/369, A61B5/14553 take precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/292 : Multi-camera tracking
• CPC Class Codes: G06V 20/52 : Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/647 : by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 40/161 : Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/196 : using television cameras
• CPC Class Codes: G08B 13/19639 : Details of the system layout
• CPC Class Codes: G08B 21/0476 : Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/182 : Level alarms, e.g. alarms responsive to variables exceeding a threshold
• CPC Class Codes: G08B 25/009 : Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: G08B 5/22 : using electric transmission; using electromagnetic transmission
• CPC Class Codes: G16H 10/60 : for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 : ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 20/10 : relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/20 : for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: G16H 50/30 : for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 80/00 : ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: H04N 13/204 : using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/207 : using a single 2D image sensor
• CPC Class Codes: H04N 2013/0085 : Motion estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A prohibited object detection system detects prohibited objects in a patient room. An image of an object detected in a room of a patient is initially collected. The system identifies reference points on the object, for example, points along the contours of the object. The system may compare the reference points to reference points of images associated with prohibited objects. The system then determines, based on the comparison, if the object is a prohibited object. One or more designated recipients may be alerted if the object is a prohibited object. The system may also register the object in a database of prohibited objects.

Claims

1. A system for detecting a prohibited object in a patient room, the system comprising:

one or more motion sensors located to provide the one or more motion sensors with a view of an object detected in a room of a patient, the motion sensors configured to collect a series of images of the room of the patient;

a computerized monitoring system communicatively coupled to the one or more motion sensors, a processor of the computerized monitoring system utilizing information received from the one or more 3D motion sensors to determine if the object is a prohibited object based on limitations for the patient, wherein determining if the object is a prohibited object comprises determining a plurality of reference points related to features of the object and comparing the plurality of reference points to a database comprising prohibited objects that include a plurality of reference points related to features of the prohibited objects; and

a computerized monitoring system communicatively coupled to the one or more motion sensors, the computerized monitoring system configured to send an initial alert to the patient being monitored, the initial alert providing the patient being monitored an opportunity to respond before an alert is sent to one or more designated recipients.

2. The system of claim 1, further comprising a computerized communication system communicatively coupled to the computerized monitoring system, the computerized communication system configured to send the alert to one or more designated recipients if the patient being monitored does not respond to the initial alert.

3. The system of claim 2, further comprising a central monitoring station communicatively coupled to the computerized communication system, the central monitoring station configured to display at least a portion of the series of images of the person, wherein the central monitoring station comprises a primary display and an alert display.

4. The system of claim 3, wherein the alert display is a dedicated portion of the primary display.

5. The system of claim 3, wherein the alert display is a separate display or series of displays from the primary display.

6. The system of claim 1, wherein the computerized monitoring system analyzes sound data for recognizable words that indicate a response from the patient.

7. A method for detecting prohibited objects in a patient room, the method comprising:

receiving from a motion sensor an image of an object detected in a room of a patient;

determining, by a processor, the object is a prohibited object based on limitations for the patient, wherein determining the object is a prohibited object comprises determining, utilizing information received from the motion sensor, a plurality of reference points related to features of the object and comparing the plurality of reference points to a database comprising prohibited objects that include a plurality of reference points related to features of prohibited objects;

communicating an initial alert to the patient being monitored if a prohibited object is detected, the initial alert providing the patient being monitored an opportunity to respond before an alert is sent to one or more designated recipients;

interpreting a response from the patient to the initial alert; and

communicating an alert, based on the interpreting, to the one or more designated recipients if the response does not indicate the patient will take corrective action.

8. The method of claim 7, further comprising receiving a response from the patient being monitored, the response comprising a verbal response by the patient.

9. The method of claim 7, further comprising receiving a response from the patient being monitored, the response comprising at least one of a physical gesture or moving the prohibited object out of a patient identification zone.

10. The method of claim 9, further comprising, if no response is received from the patient being monitored, alerting a central monitoring station and communicating an image of the prohibited object to the central monitoring station.

11. The method of claim 7, further comprising suppressing the initial alert if the prohibited object is in proximity to the patient for less than a configurable duration of time.

12. The method of claim 7, wherein the alert communicated to the one or more designated recipients includes an image of the prohibited object.

13. The method of claim 7, wherein images of objects for a plurality of people being monitored are displayed on a primary display at the central monitoring station.

14. The method of claim 11, wherein on receiving the image of the prohibited object, displaying the image on a central monitoring station alert display.

15. Non-transitory computer readable storage media having embodied thereon instructions which, when executed by one or more computer processors, causes the processors to:

receive from a motion sensor a series of two or more images of an object detected in a room of a patient;

determine a plurality of reference points related to features of the object;

compare, utilizing information received from the motion sensor, the plurality of reference points to a database comprising prohibited objects that include a plurality of reference points related to features of the prohibited objects;

determine the object is a prohibited object based on limitations for the patient; and

communicate an initial alert to the patient being monitored, the initial alert providing the patient being monitored an opportunity to respond before an alert is sent to one or more designated recipients.

16. The computer-readable storage media of claim 15, wherein the instructions further cause the one or more computer processors to determine the prohibited object is in proximity to the patient being monitored.

17. The computer-readable storage media of claim 16, further comprising receiving a response from the patient being monitored, the response comprising at least one of a verbal response, a physical gesture, or moving the prohibited object out of a patient identification zone.

18. The computer-readable storage media of claim 15, wherein the instructions further cause the one or more computer processors to alert a designated recipient of the prohibited object if no response to the initial alert is received from the patient being monitored.

19. The computer-readable storage media of claim 18, wherein the instructions further cause the one or more computer processors to display series of images for a plurality of people being monitored on a primary display at a central monitoring station.

20. The computer-readable storage media of claim 19, wherein the instructions further cause the one or more computer processors to alert the central monitoring station if the prohibited object is identified and, upon receiving an alert, cause the central monitoring station to duplicate the display of the series of images associated with the alert on a central monitoring station alert display.