Systems and methods for three-dimensional interaction monitoring in an EMS environment

• US 9,911,166 B2
• Filed: 09/27/2013
• Issued: 03/06/2018
• Est. Priority Date: 09/28/2012
• Status: Active Grant

• Current Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Original Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Inventors: Reid, C. Shane, Ashmore, Chad, Gotschall, Robert H., Bures, Martin
• Primary Examiner(s): Choi, David
• Application Number:
  US14/040,147
• Publication Number:
  US 20140096091A1
• Time in Patent Office: 1,621 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/13 delivered from dispensers
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A method for tracking interactions in an emergency response environment according to embodiments of the present invention includes receiving color images and depth information from within a field of view of a sensor array; maintaining an emergency encounter record; monitoring one or both of a position of an object and movement of the object in the emergency response environment based on the color images and depth information received by the sensor array; and recording an occurrence of a condition in the emergency encounter record, wherein the condition is based on the one or both of the position of the object and the movement of the object.

Claims

1. A method for gesture recognition in an emergency response environment, the method comprising:

receiving visual information about at least a portion of a body of a caregiver providing care for a patient from at least one sensor, wherein the caregiver is an emergency medical services provider;

maintaining or creating an emergency encounter record for the patient;

monitoring the visual information to determine movements of the at least the portion of the body of the caregiver;

recognizing an occurrence of a gesture based on the movements of the at least the portion of the body of the caregiver;

determining that the gesture belongs to one gesture type of a plurality of gesture types; and

recording an entry comprising a physiological parameter of the patient in the emergency encounter record based on the occurrence of the gesture, wherein the entry recorded depends on the determined gesture type, and the entry comprises at least one of a heart rate, a blood pressure, an electrocardiograph (ECG), a temperature, a respiration rate, a blood oxygen level, an end-tidal carbon dioxide level, a pulmonary function, a blood glucose level, and a weight;

wherein the emergency response environment is an emergency response vehicle.

2. The method of claim 1, wherein the gesture is an artificial gesture.

3. The method of claim 1, wherein the gesture is a natural gesture.

4. The method of claim 1, wherein the at least the portion of the body of the caregiver is a hand of the caregiver.

5. The method of claim 4, wherein the at least the portion of the body of the caregiver comprises one or more digits of the hand of the caregiver.

6. The method of claim 1, wherein the at least the portion of the body of the caregiver is a head of the caregiver.

7. The method of claim 1, wherein the entry comprises a time of the occurrence of the gesture.

8. The method of claim 7, wherein the entry further comprises an identification of the gesture.

9. The method of claim 1, wherein the entry comprises the visual information received corresponding to a time of the occurrence of the gesture.

10. The method of claim 9, the method further comprising receiving audio information, wherein the entry comprises the audio information received corresponding to the time of the occurrence of the gesture.

11. The method of claim 1, further comprising:

determining an occurrence of a condition other than the gesture; and

recording the entry in the emergency encounter record only when the occurrence of the condition coincides with the occurrence of the gesture.

12. The method of claim 11, wherein the gesture is a first gesture, and wherein the condition is a second gesture.

13. The method of claim 11, wherein the condition is a position or location of the body of the caregiver with respect to the emergency response environment.

14. The method of claim 1, wherein the at least the portion of the body of the caregiver is a first portion of the body of the caregiver, wherein the gesture is a first gesture, the method further comprising:

receiving visual information about a second portion of the body of the caregiver from the at least one sensor;

monitoring the visual information to determine movements of the second portion of the body of the caregiver;

recognizing an occurrence of a second gesture based on the movements of the second portion of the body of the caregiver; and

recording the entry in the emergency encounter record based on the occurrence of the first gesture and the occurrence of the second gesture.

15. The method of claim 14, wherein recording the entry comprises recording the entry in the emergency encounter record only when the first and second gestures coincide.

16. The method of claim 14, wherein the first portion of the body of the caregiver is a hand, and wherein the second portion of the body of the caregiver is a head.

17. The method of claim 14, wherein the first portion of the body of the caregiver is a first hand, and wherein the second portion of the body of the caregiver is a second hand.

19. The method of claim 1, wherein the emergency encounter record is a patient charting record comprising at least one of a treatment applied to the patient, medication administered to the patient, and vital sign information of the patient.

20. The method of claim 1, wherein the caregiver is an emergency medical services technician.

23. The method of claim 1, wherein the physiological parameter of the patient comprises at least one of a blood pressure and an ECG waveform.

18. A system for gesture recognition in an emergency response environment, the system comprising:

at least one sensor configured to receive visual information about at least a portion of a body of a caregiver providing care to a patient, wherein the caregiver is an emergency medical services provider; and

a control system communicably coupled to the at least one sensor, the control system configured to;

maintain or create an emergency encounter record for the patient;

monitor the visual information to determine movements of the at least the portion of the body of the caregiver;

recognize an occurrence of a gesture based on the movements of the at least the portion of the body of the caregiver;

determine that the gesture belongs to one gesture type of a plurality of gesture types; and

record an entry comprising a physiological parameter of the patient in the emergency encounter record based on the occurrence of the gesture, wherein the entry recorded depends on the determined gesture type, and the entry comprises at least one of a heart rate, a blood pressure, an electrocardiograph (ECG), a temperature, a respiration rate, a blood oxygen level, an end-tidal carbon dioxide level, a pulmonary function, a blood glucose level, and a weight;

wherein the emergency response environment is an emergency response vehicle.

21. The system of claim 18, wherein the emergency encounter record is a patient charting record comprising at least one of a treatment applied to the patient, medication administered to the patient, and vital sign information of the patient.

22. The system of claim 18, wherein the caregiver is an emergency medical services technician.

24. The system of claim 18, wherein the physiological parameter of the patient comprises at least one of a blood pressure and an ECG waveform.