SYSTEMS AND METHODS FOR THREE-DIMENSIONAL INTERACTION MONITORING IN AN EMS ENVIRONMENT

• US 20140096091A1
• Filed: 09/27/2013
• Published: 04/03/2014
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Original Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Inventors: REID, C. Shane, ASHMORE, Chad, GOTSCHALL, Robert H., BURES, Martin
• Granted Patent: US 9,911,166 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/13 delivered from dispensers
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A method for tracking interactions in an emergency response environment according to embodiments of the present invention includes receiving color images and depth information from within a field of view of a sensor array; maintaining an emergency encounter record; monitoring one or both of a position of an object and movement of the object in the emergency response environment based on the color images and depth information received by the sensor array; and recording an occurrence of a condition in the emergency encounter record, wherein the condition is based on the one or both of the position of the object and the movement of the object.

Claims

1. A method for gesture recognition in an emergency response environment, the method comprising:

receiving visual information about at least a portion of a human body from at least one sensor;

maintaining an emergency encounter record;

monitoring the visual information to determine movements of the at least the portion of the human body;

recognizing an occurrence of a gesture based on the movements of the at least the portion of the human body; and

recording an entry in the emergency encounter record based on the occurrence of the gesture.

2. The method of claim 1, wherein the gesture is an artificial gesture.

3. The method of claim 1, wherein the gesture is a natural gesture.

4. The method of claim 1, wherein the at least the portion of the human body is a hand of the human body.

5. The method of claim 4, wherein the at least the portion of the human body comprises one or more digits of the hand of the human body.

6. The method of claim 1, wherein the at least the portion of the human body is a head of the human body.

7. The method of claim 1, wherein the entry comprises a time of the occurrence of the gesture.

8. The method of claim 7, wherein the entry further comprises an identification of the gesture.

9. The method of claim 1, wherein the entry comprises the visual information received corresponding to a time of the occurrence of the gesture.

10. The method of claim 9, the method further comprising receiving audio information, wherein the entry comprises the audio information received corresponding to the time of the occurrence of the gesture.

11. The method of claim 1, further comprising:

determining an occurrence of a condition other than the gesture; and

recording the entry in the emergency encounter record only when the occurrence of the condition coincides with the occurrence of the gesture.

12. The method of claim 11, wherein the gesture is a first gesture, and wherein the condition is a second gesture.

13. The method of claim 11, wherein the condition is a position or location of the human body with respect to the emergency response environment.

14. The method of claim 1, wherein the at least the portion of the human body is a first portion of the human body, wherein the gesture is a first gesture, the method further comprising:

receiving visual information about a second portion of the human body from the at least one sensor;

monitoring the visual information to determine movements of the second portion of the human body;

recognizing an occurrence of a second gesture based on the movements of the second portion of the human body; and

recording the entry in the emergency encounter record based on the occurrence of the first gesture and the occurrence of the second gesture.

15. The method of claim 14, wherein recording the entry comprises recording the entry in the emergency encounter record only when the first and second gestures coincide.

16. The method of claim 14, wherein the first portion of the human body is a hand, and wherein the second portion of the human body is a head.

17. The method of claim 14, wherein the first portion of the human body is a first hand, and wherein the second portion of the human body is a second hand.

18. The method of claim 1, wherein the human body is a patient being treated in the emergency response environment.

19. The method of claim 1, wherein the human body is a caregiver who is treating a patient in the emergency response environment.

20. A system for gesture recognition in an emergency response environment, the system comprising:

at least one sensor configured to receive visual information about at least a portion of a human body; and

a control system communicably coupled to the at least one sensor, the control system configured to;

maintain an emergency encounter record;

monitor the visual information to determine movements of the at least the portion of the human body;

recognize an occurrence of a gesture based on the movements of the at least the portion of the human body; and

record an entry in the emergency encounter record based on the occurrence of the gesture.