Medical environment monitoring system

• US 10,229,489 B1
• Filed: 03/04/2016
• Issued: 03/12/2019
• Est. Priority Date: 10/16/2012
• Status: Active Grant

• Current Assignee: Ocuvera LLC
• Original Assignee: Ocuvera LLC
• Inventors: Rush, Benjamin D., Brown-Kramer, Joshua M., Sabalka, Lucas A., Gansemer, Brian S., Upton, Clay T., Bauer, Paul B., Unterseher, Andrew R., Origas, Benjamin J., Durham, Douglas W.
• Primary Examiner(s): Dang, Duy M
• Application Number:
  US15/061,323
• Time in Patent Office: 1,103 Days
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths

Abstract

A system and a method are described for monitoring a medical care environment. In one or more implementations, a method includes identifying a first subset of pixels within a field of view of a camera as representing a bed. The method also includes identifying a second subset of pixels within the field of view of the camera as representing an object (e.g., a subject, such as a patient, medical personnel; bed; chair; patient tray; medical equipment; etc.) proximal to the bed. The method also includes determining an orientation of the object within the bed. In implementations, the method further includes issuing an electronic communication alert based upon the orientation of the object, and determining whether to issue future alerts based upon feedback to the alert.

Claims

1. A system for monitoring a medical care environment, the system comprising:

an imaging device having an image plane, the imaging device configured to receive at least one of a depth frame image or a color frame image representing a three-dimensional environment corresponding to a physical space;

at least one computing device in communication with the imaging device, the at least one computing device including;

a memory configured to store one or more modules;

a processor coupled to the memory, the processor is configured to execute the one or more modules to cause the processor to;

receive at least one of the depth frame image or the color frame image associated with a body part of a subject;

process, via a first processing technique, the at least one of the depth frame image or the color frame image to generate a first possible orientation signal of the body part with respect to the image plane;

process, via a second processing technique, the at least one of the depth frame image or the color frame image to generate a second possible orientation signal of the body part with respect to the image plane;

determine a state of the subject based upon the first possible orientation signal and the second possible orientation signal;

generate an electronic communication alert based upon the determined state of the subject;

receive feedback from an electronic device indicative of a validity of the electronic communication alert;

adjust an electronic communication alert sensitivity level for the determined state of the subject based upon the feedback; and

determine whether to generate future electronic communication alerts for the determined state of the subject based upon the electronic communication alert sensitivity level.

2. The system as recited in claim 1, wherein the processor is further configured to execute the one or more modules to cause the processor to process, via another processing technique, the at least one of the depth frame image or the color frame image to generate another possible orientation signal of the body part with respect to the image plane;

determine a probability distribution based upon at least the possible orientation signal and the another possible orientation signal via a fusion engine; and

determine at least one state of the subject based upon the probability distribution.

3. The system as recited in claim 1, wherein the processor is further configured to filter noise from the depth frame image.

4. The system as recited in claim 1, wherein the processor is further configured to execute the one or more modules to cause the processor to determine whether the subject is at least one of transitioning from a bed or transitioning within the bed.

5. The system as recited in claim 1, wherein the processor is further configured to execute the one or more modules to cause the processor to determine at least one state comprises determining an orientation of the subject within a seating platform.

6. The system as recited in claim 1, wherein the processor is further configured to execute the one or more modules to cause the processor to process the at least one of the depth frame image or the color frame image to detect at least one of a presence or an absence of a gesture;

and provide an indication associated with the at least one of the presence or the absence of the gesture, wherein the feedback is based upon the at least one of the presence or the absence of the gesture.

7. The system as recited in claim 1, wherein the processor is further configured to determine an electronic communication alert sensitivity level associated with the subject.

8. A method for monitoring a subject within a medical care environment, the method comprising:

identifying, by a processor, a first subset of pixels within a field of view of an imaging device as representing an object of interest, the first subset of pixels representing a portion of a three-dimensional environment;

identifying a second subset of pixels within the field of view of the imaging device as representing the subject within the field of view, the second subset of pixels representing a portion of the three-dimensional environment;

determining, by the processor via a first processing technique and a second processing technique, state of the subject based upon the first subset of pixels and the second subset of pixels;

generating an electronic communication alert based upon the determined state of the subject;

receiving feedback from an electronic device indicative of a validity of the electronic communication alert;

adjusting an electronic communication alert sensitivity level for the determined state of the subject based upon the feedback; and

determining whether to generate future electronic communication alerts for the determined state of the subject based upon the electronic communication alert sensitivity level.

9. The method as recited in claim 8, further comprising filtering noise from the identified pixels.

10. The method as recited in claim 8, further comprising identifying at least one of a presence or an absence of a gesture based upon the second subset of pixels;

and providing an indication associated with the at least one of the presence or the absence of the gesture, wherein the feedback is based upon the at least one of the presence or the absence of the gesture.

11. The method as recited in claim 8, further comprising determining an electronic communication alert sensitivity level associated with the subject.

12. A method for monitoring a medical care environment, the method comprising:

receiving at least one of a depth frame image or a color frame image associated with a body part of a subject, the at least one of the depth frame image of the color frame image captured by an imaging device having an image plane;

processing, via a first processing technique, the at least one of the depth frame image or the color frame image to generate a first possible orientation signal of the body part with respect to the image plane;

processing, via a second processing technique, the at least one of the depth frame image or the color frame image to generate a second possible orientation signal of the body part with respect to the image plane;

determining a state of the subject based upon the first possible orientation signal and the second possible orientation signal;

generating an electronic communication alert based upon the determined state of the subject;

receiving feedback from an electronic device associated with medical personnel indicative of a validity of the electronic communication alert;

adjusting an electronic communication alert sensitivity level for the determined state of the subject based upon the feedback; and

determining whether to generate future electronic communication alerts for the determined stale of the subject based upon the electronic communication alert sensitivity level.

13. The method as recited in claim 12, further comprising:

processing, via a third processing technique, the at least one of the depth frame image or the color frame image to generate a third possible orientation signal of the body part with respect to the image plane,

determining a probability distribution based upon at least the first possible orientation signal the second possible orientation signal, and the third possible orientation signal via a fusion engine;

determining at least one state of the subject based upon the probability distribution.

14. The method as recited in claim 12, further comprising filtering noise from the depth frame image.

15. The method as recited in claim 12, further comprising identifying a position of at least one of a second subject or an object relative to the subject.

16. The method as recited in claim 15, further comprising suppressing the generation of the electronic communication alert based on the identification of the at least one of a second subject or an object relative to the subject.

17. The method as recited in claim 12, further comprising determining an electronic communication alert sensitivity level associated with the subject.