Cameras for emergency rescue

• US 10,420,701 B2
• Filed: 11/08/2013
• Issued: 09/24/2019
• Est. Priority Date: 05/17/2013
• Status: Active Grant

• Current Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Original Assignee: Zoll Medical Corporation (Asahi Kasei Corporation)
• Inventors: Freeman, Gary A.
• Primary Examiner(s): Musselman, Timothy A
• Application Number:
  US14/075,741
• Publication Number:
  US 20140342331A1
• Time in Patent Office: 2,146 Days
• CPC Class Codes: A61H 31/005 with feedback for the user
• CPC Class Codes: A61N 1/3993 User interfaces for automatic external defibrillators
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 2207/10052 Images from lightfield camera
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G09B 23/288 for artificial respiration or heart massage
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A system includes a processor coupled to a memory. The processor and memory are configured to receive, from one or more cameras, multiple images of a victim undergoing a resuscitation event at a rescue scene; generate a representation of the rescue scene based on the received images; and determine a characteristic associated with the resuscitation event based on an analysis of the of the rescue scene.

Claims

1. A medical system for guiding one or more rescuer(s) in providing treatment to a victim, the system comprising:

at least one camera configured to capture images of at least one of the victim and rescuer(s) as the victim is undergoing a resuscitation event at the rescue scene;

a feedback device for providing guidance to the rescuer(s) about performance of activities related to the rescue event; and

a processor coupled to a memory and in electronic communication with the at least one camera and the feedback device, the processor and memory configured to;

receive, from at least one camera, multiple images of the victim undergoing the resuscitation event at the rescue scene and image(s) of the rescuer(s);

receive from the same or other camera(s) at the rescue scene multiple images of object(s) and/or rescuer(s) at the rescue scene;

generate a visual representation of the rescue scene based on the received images at least of the victim and the rescuer(s), the visual representation comprising at least the victim and rescuer(s) at the rescue scene;

determine a characteristic associated with the resuscitation event based on an analysis of the generated visual representation of the rescue scene, wherein the analysis of the visual representation comprises;

detection of the victim, rescuer(s), and/or object(s) in the visual representation,

comparison of the detected victim, rescuer(s), and/or object(s) to predetermined characteristics for the victim, rescuer(s), and/or object(s) stored in the memory, and

determination of one or more task(s) to be performed by the one or more rescuer(s) based on the comparison; and

provide by the feedback device one or more message(s) to the one or more rescuer(s) regarding the one or more task(s) to be performed by the one or more rescuer(s) based on the determined characteristic associated with the resuscitation event.

2. The system of claim 1, wherein the visual representation of the rescue scene is a three-dimensional visual representation.

3. The system of claim 1, wherein generating the visual representation of the rescue scene includes removing information sufficient to identify the victim from the visual representation, and wherein removing information sufficient to identify the victim comprises identifying a face associated with the victim in the visual representation of the rescue scene and one or more of blurring facial features associated with the face of the victim, removing facial features associated with the victim, and replacing a portion of the face associated with the victim with an anonymous representation of the victim.

4. The system of claim 1, wherein the processor and the memory are configured to detect a face of the victim in the visual representation based on at least one of an analysis of the images and an analysis of the visual representation of the rescue scene.

5. The system of claim 1, wherein the processor and the memory are configured to identify the object(s) and/or rescuer(s) at the rescue scene based on at least one of an analysis of one or more of the images and an analysis of the visual representation of the rescue scene.

6. The system of claim 1, wherein the visual representation includes an animated representation of the rescue scene.

7. The system of claim 1, wherein the one or more message(s) include information indicative of at least one of a medical status of the victim and a performance of one or more of the rescuer(s).

8. The system of claim 1, wherein the one or more message(s) are for a particular one of the rescuer(s), and are based on the determined one or more task(s) associated with the particular one of the rescuer(s).

9. The system of claim 1, wherein determining a characteristic associated with the resuscitation event includes determining the characteristic while the victim is undergoing the resuscitation event.

10. The system of claim 1, wherein determining a characteristic associated with the resuscitation event includes determining a characteristic after the resuscitation event is finished.

11. The system of claim 1, wherein determining a characteristic associated with the resuscitation event includes determining a relative position of the victim and the one or more rescuer(s) at the rescue scene.

12. The system of claim 1, wherein determining a characteristic associated with the resuscitation event includes determining at least one of a rate and a depth of compressions delivered to the victim by one of the rescuer(s).

13. The system of claim 1, wherein determining a characteristic associated with the resuscitation event includes determining a metric indicative of at least one of an accuracy and an efficiency of one or more of the rescuer(s) at the rescue scene.

14. The system of claim 1, wherein at least one of the at least one camera is mounted on one of the rescuer(s) at the rescue scene.

15. The system of claim 1, further comprising a wearable computing device that includes the at least one camera.

16. The system of claim 1, wherein the at least one camera is mounted on a medical device at the rescue scene.

17. The system of claim 1, wherein the one or more task(s) comprises at least one of a ventilator task, a chest compression task, and an infusion task.

18. The system of claim 1, wherein the one or more message(s) comprises at least one of instructions to adjust a rate of chest compressions, instructions to adjust a depth of chest compressions, instructions to adjust a rate of ventilation, instructions regarding a location for delivery of an infusion, and instructions for the one or more rescuer(s) to change positions.

19. The system of claim 1, wherein the analysis of the visual representation comprises association of a particular task of the one or more task(s) with a particular rescuer of the one or more rescuer(s),

wherein the one or more message(s) comprise an instruction provided by the feedback device to the particular rescuer to switch from performing the particular task associated with the particular rescuer to a different task to be performed by the particular rescuer, and

wherein analysis of the visual representation further comprises determination of when the particular rescuer switches to the different task.

20. The system of claim 1, comprising multiple feedback devices, each of which provides guidance to a particular rescuer of the one or more rescuer(s),

wherein analysis of the visual representation comprises determination of a particular task of the one or more task(s) associated with each of the one or more rescuer(s), and

wherein the processor is configured to provide a particular message to each of the one or more rescuer(s) about the particular task associated with the particular rescuer by the feedback device of the particular rescuer.

21. A method for guiding one or more rescuer(s) in providing treatment to a victim, comprising:

receiving, with a computer processor, from one or more cameras configured to capture images of a rescue event at a rescue scene, multiple images of a victim undergoing the resuscitation event at the rescue scene and images of one or more rescuer(s) at the rescue scene;

receiving, with the computer processor, from the same or other camera(s) at the rescue scene multiple images of object(s) and/or rescuer(s) at the rescue scene;

generating, with the computer processor, a visual representation of the rescue scene based on the received images at least of the victim and rescuer(s), the visual representation comprising at least the victim and rescuer(s) at the rescue scene;

determining, with the computer processor, a characteristic associated with the resuscitation event based on an analysis of the generated visual representation of the rescue scene, wherein the analysis of the visual representation comprises;

detection of the victim, rescuer(s), and/or object(s) in the visual representation,

comparison of the detected victim, rescuer(s), and/or object(s) to predetermined characteristics for the victim, rescuer(s), and/or object(s) stored in the memory, and

determination of one or more task(s) to be performed by the one or more rescuer(s) based on the comparison; and

providing by a feedback device one or more message(s) to the one or more rescuer(s) regarding the task to be performed by the one or more rescuer(s) based on the determined characteristic associated with the resuscitation event.

22. The method of claim 21, wherein the visual representation of the rescue scene is a three-dimensional representation.

23. The method of claim 22, wherein the analysis of the visual representation comprises association of a particular task of the one or more task(s) with a particular rescuer of the one or more rescuer(s),

wherein the one or more message(s) comprise an instruction provided by the feedback device to the particular rescuer to switch from performing the particular task associated with the rescuer to a different task to be performed by the rescuer, and

wherein analysis of the visual representation further comprises determination of when the rescuer switches to the different task.

24. The method of claim 22, wherein analysis of the visual representation comprises determination of a particular task of the one or more task(s) associated with each of multiple rescuers, and

wherein providing the one or more messages(s) by the feedback device comprises providing a particular message of the one or more message(s) to each of the multiple rescuers about the particular task associated with the rescuer by a particular feedback device associated with the rescuer.

25. The method of claim 21, wherein generating the visual representation of the rescue scene includes removing information sufficient to identify the victim from the visual representation, wherein removing information sufficient to identify the victim comprises identifying a face associated with the victim in the visual representation of the rescue scene and one or more of blurring facial features associated with the victim, removing facial features associated with the victim, and replacing a portion of a face associated with the victim with an anonymous representation of the victim.

26. The method of claim 21, wherein the message is for a particular one of the rescuer(s) and is based on the determined one or more task(s) associated with the particular one of the rescuer(s).

27. The method of claim 21, wherein determining a characteristic associated with the resuscitation event includes determining a relative position of the victim and the one or more rescuer(s) at the rescue scene.

28. The method of claim 21, wherein determining a characteristic associated with the resuscitation event includes determining at least one of a rate and a depth of compressions delivered to the victim by one of the rescuer(s).

29. The method of claim 21, wherein determining a characteristic associated with the resuscitation event includes determining a metric indicative of at least one of an accuracy and an efficiency of the one or more rescuer(s) at the rescue scene.

30. The method of claim 21, wherein the one or more task(s) comprises at least one of a ventilator task, a chest compression task, and an infusion task.

31. The method of claim 21, wherein the one or more message(s) comprises at least one of instructions to adjust a rate of chest compressions, instructions to adjust a depth of chest compressions, instructions to adjust a rate of ventilation, instructions regarding a location for delivery of an infusion, and instructions for the one or more rescuer(s) to change positions.

32. A computer readable medium storing instructions for causing a computing device to:

receive, from one or more cameras, multiple images of a victim undergoing a resuscitation event at a rescue scene and image(s) of one or more rescuer(s) at the rescue scene;

receive from the same or other camera(s) at the rescue scene multiple images of object(s) and/or rescuer(s) at the rescue scene;

generate a visual representation of the rescue scene based on the received images at least of the victim and rescuer(s), the visual representation comprising at least the victim and rescuer(s) at the rescue scene;

determine a characteristic associated with the resuscitation event based on an analysis of the generated visual representation of the rescue scene, wherein the analysis of the visual representation comprises;

detection of the victim, rescuer(s), and/or object(s) in the visual representation,

comparison of the detected victim, rescuer(s), and/or object(s) to predetermined characteristics for the object(s) and/or person(s) stored in the memory, and

determination of one or more task(s) to be performed by the one or more rescuer(s) based on the comparison; and

provide by a feedback device one or more message(s) to the one or more rescuer(s) regarding the task to be performed by the one or more rescuer(s) based on the determined characteristic associated with the resuscitation event.

33. The computer readable medium of claim 32, wherein the one or more task(s) comprises at least one of a ventilator task, a chest compression task, and an infusion task.

34. The computer readable medium of claim 32, wherein the one or more message(s) comprises at least one of instructions to adjust a rate of chest compressions, instructions to adjust a depth of chest compressions, instructions to adjust a rate of ventilation, instructions regarding a location for delivery of an infusion, and instructions for the one or more rescuer(s) to change positions.

35. The computer readable medium of claim 32, wherein the analysis of the visual representation comprises association of a particular task of the one or more task(s) with a particular rescuer of the one or more rescuer(s),

wherein the one or more message(s) comprise an instruction provided by the feedback device to the particular rescuer to switch from performing the particular task associated with the rescuer to a different task to be performed by the rescuer, and

wherein analysis of the visual representation further comprises determination of when the rescuer switches to the different task.

36. The computer readable medium of claim 32, wherein analysis of the visual representation comprises determination of a particular task of the one or more task(s) associated with each of multiple rescuers, and

wherein providing the one or more messages(s) by the feedback device comprises providing a particular message of the one or more message(s) to each of the multiple rescuers about the particular task associated with the rescuer by a particular feedback device associated with the rescuer.