Automated emergency response

• US 10,533,858 B2
• Filed: 11/06/2017
• Issued: 01/14/2020
• Est. Priority Date: 11/06/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Anders, Kelley L., Fox, Jeremy R., Miller, Grant D.
• Primary Examiner(s): Cass, Jean Paul
• Application Number:
  US15/804,000
• Publication Number:
  US 20190137279A1
• Time in Patent Office: 799 Days
• Field of Search: None
• CPC Class Codes: A62B 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01J 5/0025 Living bodies ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00
• CPC Class Codes: G01S 13/86 Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
• CPC Class Codes: G01S 13/885 for ground probing prospecting or detecting using electromagnetic waves G01V3/12
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/102 specially adapted for vertical take-off of aircraft
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A method and system for automatically detecting a location is provided. The method includes receiving by a vehicle, data describing a specified geographical area of a collapsed structure. A received control signal enables control of the vehicle such that the vehicle initiates motion and navigates in a specified direction towards the specified geographical area and upon arriving at the specified geographical area, a size and a magnitude of the collapsed structure is determined via sensors of the vehicle. A center location of the collapsed structure is determined and the vehicle hovers above the center location. Geographical coordinates of the location above the center location are transmitted to a search and rescue system and the center location is scanned via ground penetrating radar. Open spaces within the collapsed structure are determined and scanned to locate living entities within the open spaces.

Claims

1. A location detection method comprising:

receiving, by a processor of a first vehicle, data describing a specified geographical area of a collapsed structure;

receiving, by said processor, a control signal enabling control of said first vehicle such that said first vehicle initiates motion and navigates in a specified direction towards said specified geographical area;

upon arriving at said specified geographical area, determining by said processor via a plurality of sensors of said first vehicle, a size, shape, and a magnitude of said collapsed structure;

determining, by said processor, a center location of said collapsed structure;

maintaining, by said processor, said first vehicle at a location above said center location of said collapsed structure;

transmitting, by said processor to a search and rescue system, geographical coordinates of said location above said center location of said collapsed structure;

first scanning, by said processor via a ground penetrating radar device of said first vehicle, said center location of said collapsed structure;

determining, by said processor in response to results of said first scanning, open spaces within said collapsed structure;

differentiating, by said processor in response to said first results, between living entities and inanimate objects located within said collapsed structure;

second scanning, by said processor via a thermal imaging device of said first vehicle, said open spaces within said collapsed structure;

determining, by said processor in response to results of said second scanning, a body temperature of said living entities located within said open spaces of said collapsed structure;

presenting, by said processor via a two dimensional image of a graphical user interface, heat map images identifying a visual topology of said collapsed structure, and wherein said heat map images present open spaces within said collapsed structure, said living entities located within said open spaces of said collapsed structure; and

a pathway within said collapsed structure; and

presenting, by said processor via said graphical user interface, a vehicle deployment map presenting said first vehicle and a group vehicles, a ground penetrating radar map illustrating differences between said living entities and said inanimate objects, a thermal imaging map to determine trapped entities, a number of survivors per each determined rescue route, and optimal rescue routes for extracting said living entities.

2. The method of claim 1, further comprising:

third scanning, by said processor via optical sensors and vibrational sensors and of said first vehicle, said collapsed structure;

determining, by said processor in response to results of said third scanning, stable pathways for accessing said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said living entities located within said open spaces of said collapsed structure and geographical coordinates of said stable pathways.

3. The method of claim 2, further comprising:

determining, by said processor in response to results of said third scanning, a first pathway of said stable pathways, wherein said first pathway is associated with a shortest timeframe, with respect to all other pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said first pathway.

4. The method of claim 3, further comprising:

determining, by said processor in response to results of said third scanning, multiple additional pathways of said stable pathways, wherein said multiple additional pathways are associated with shortest timeframes, with respect to all further pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said multiple additional pathways, wherein said search and rescue system further presents images of said multiple additional pathways via said two dimensional image of said graphical user interface.

5. The method of claim 3, further comprising:

transmitting, by said processor to a plurality of additional vehicles, said geographical coordinates of said location above said center location of said collapsed structure;

directing, by said processor, said plurality of additional vehicles in a specified direction towards said location above said center location of said collapsed structure;

directing, by said processor, said plurality of additional vehicles to locations surrounding said location above said center location of said collapsed structure;

maintaining, by said processor, said plurality of additional vehicles at said locations surrounding said location above said center location of said collapsed structure;

fourth scanning, by said processor via ground penetrating radar devices of said plurality of additional vehicles, said locations surrounding said location above said center location of said collapsed structure;

determining, by said processor in response to results of said fourth scanning, said open spaces within said collapsed structure;

fifth scanning, by said processor via thermal imaging devices of said additional vehicles, said open spaces within said collapsed structure; and

determining, by said processor in response to results of said fifth scanning, said living entities located within said open spaces of said collapsed structure

sixth scanning, by said processor via optical sensors and vibrational sensors and of said additional vehicles, said collapsed structure;

determining, by said processor in response to results of said sixth scanning, said stable pathways for accessing said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, data indicating said living entities located within said open spaces of said collapsed structure and said stable pathways.

6. The method of claim 3, wherein said search and rescue system presents images of:

said open spaces within said collapsed structure, said living entities located within said open spaces of said collapsed structure; and

stable pathways via a three dimensional image of said graphical user interface.

7. The method of claim 1, further comprising:

providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in the control hardware, said code being executed by the computer processor to implement;

said receiving said data, said retrieving said control signal, said determining said size and said magnitude, said determining said center location, said maintaining, said transmitting, said first scanning, said determining said open spaces, and said determining said living entities.

8. A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a processor of a first vehicle implements a location detection method, said method comprising:

receiving, by said processor, data describing a specified geographical area of a collapsed structure;

receiving, by said processor, a control signal enabling control of said first vehicle such that said first vehicle initiates motion and navigates in a specified direction towards said specified geographical area;

upon arriving at said specified geographical area, determining by said processor via a plurality of sensors of said first vehicle, a size, shape, and a magnitude of said collapsed structure;

determining, by said processor, a center location of said collapsed structure;

maintaining, by said processor, said first vehicle at a location above said center location of said collapsed structure;

transmitting, by said processor to a search and rescue system, geographical coordinates of said location above said center location of said collapsed structure;

first scanning, by said processor via a ground penetrating radar device of said first vehicle, said center location of said collapsed structure;

determining, by said processor in response to results of said first scanning, open spaces within said collapsed structure;

differentiating, by said processor in response to said first results, between living entities and inanimate object located within said collapsed structure;

second scanning, by said processor via a thermal imaging device of said first vehicle, said open spaces within said collapsed structure;

determining, by said processor in response to results of said second scanning, a body temperature of said living entities located within said open spaces of said collapsed structure;

presenting, by said processor via a two dimensional image of a graphical user interface, heat map images identifying a visual topology of said collapsed structure, and wherein said heat map images present open spaces within said collapsed structure, said living entities located within said open spaces of said collapsed structure; and

a pathway within said collapsed structure; and

presenting, by said processor via said graphical user interface, a vehicle deployment map presenting said first vehicle and a group vehicles, a ground penetrating radar map illustrating differences between said living entities and said inanimate objects, a thermal imaging map to determine trapped entities, a number of survivors per each determined rescue route, and optimal rescue routes for extracting said living entities.

9. The computer program product of claim 8, wherein said method further comprises:

third scanning, by said processor via optical sensors and vibrational sensors and of said first vehicle, said collapsed structure;

determining, by said processor in response to results of said third scanning, stable pathways for accessing said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said living entities located within said open spaces of said collapsed structure and geographical coordinates of said stable pathways.

10. The computer program product of claim 9, wherein said method further comprises:

determining, by said processor in response to results of said third scanning, a first pathway of said stable pathways, wherein said first pathway is associated with a shortest timeframe, with respect to all other pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said first pathway.

11. The computer program product of claim 10, wherein said method further comprises:

determining, by said processor in response to results of said third scanning, multiple additional pathways of said stable pathways, wherein said multiple additional pathways are associated with shortest timeframes, with respect to all further pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said multiple additional pathways, wherein said search and rescue system further presents images of said multiple additional pathways via said two dimensional image of said graphical user interface.

12. The computer program product of claim 10, wherein said method further comprises:

transmitting, by said processor to a plurality of additional vehicles, said geographical coordinates of said location above said center location of said collapsed structure;

directing, by said processor, said plurality of additional vehicles in a specified direction towards said location above said center location of said collapsed structure;

directing, by said processor, said plurality of additional vehicles to locations surrounding said location above said center location of said collapsed structure;

maintaining, by said processor, said plurality of additional vehicles at said locations surrounding said location above said center location of said collapsed structure;

fourth scanning, by said processor via ground penetrating radar devices of said plurality of additional vehicles, said locations surrounding said location above said center location of said collapsed structure;

determining, by said processor in response to results of said fourth scanning, said open spaces within said collapsed structure;

fifth scanning, by said processor via thermal imaging devices of said additional vehicles, said open spaces within said collapsed structure; and

determining, by said processor in response to results of said fifth scanning, said living entities located within said open spaces of said collapsed structure

sixth scanning, by said processor via optical sensors and vibrational sensors and of said additional vehicles, said collapsed structure;

determining, by said processor in response to results of said sixth scanning, said stable pathways for accessing said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, data indicating said living entities located within said open spaces of said collapsed structure and said stable pathways.

13. The computer program product of claim 10, wherein said method further comprises:

wherein said search and rescue system presents images of;

said open spaces within said collapsed structure, said living entities located within said open spaces of said collapsed structure; and

stable pathways via a three dimensional image of said graphical user interface.

14. A first vehicle comprising a processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the processor executes a location detection method comprising:

receiving, by said processor, data describing a specified geographical area of a collapsed structure;

receiving, by said processor, a control signal enabling control of said first vehicle such that said first vehicle initiates motion and navigates in a specified direction towards said specified geographical area;

upon arriving at said specified geographical area, determining by said processor via a plurality of sensors of said first vehicle, a size, shape, and a magnitude of said collapsed structure;

determining, by said processor, a center location of said collapsed structure;

maintaining, by said processor, said first vehicle at a location above said center location of said collapsed structure;

transmitting, by said processor to a search and rescue system, geographical coordinates of said location above said center location of said collapsed structure;

first scanning, by said processor via a ground penetrating radar device of said first vehicle, said center location of said collapsed structure;

determining, by said processor in response to results of said first scanning, open spaces within said collapsed structure;

differentiating, by said processor in response to said first results, between living entities and inanimate object located within said collapsed structure;

second scanning, by said processor via a thermal imaging device of said first vehicle, said open spaces within said collapsed structure;

determining, by said processor in response to results of said second scanning, a body temperature of said living entities located within said open spaces of said collapsed structure;

presenting, by said processor via a two dimensional image of a graphical user interface, heat map images identifying a visual topology of said collapsed structure, and wherein said heat map images present open spaces within said collapsed structure, said living entities located within said open spaces of said collapsed structure; and

a pathway within said collapsed structure; and

presenting, by said processor via said graphical user interface, a vehicle deployment map presenting said first vehicle and a group vehicles, a ground penetrating radar map illustrating differences between said living entities and said inanimate objects, a thermal imaging map to determine trapped entities, a number of survivors per each determined rescue route, and optimal rescue routes for extracting said living entities.

15. The first vehicle of claim 14, wherein said method further comprises:

third scanning, by said processor via optical sensors and vibrational sensors and of said first vehicle, said collapsed structure;

determining, by said processor in response to results of said third scanning, stable pathways for accessing said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said living entities located within said open spaces of said collapsed structure and geographical coordinates of said stable pathways.

16. The first vehicle of claim 15, wherein said method further comprises:

determining, by said processor in response to results of said third scanning, a first pathway of said stable pathways, wherein said first pathway is associated with a shortest timeframe, with respect to all other pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said first pathway.

17. The first vehicle of claim 16, wherein said method further comprises:

determining, by said processor in response to results of said third scanning, multiple additional pathways of said stable pathways, wherein said multiple additional pathways are associated with shortest timeframes, with respect to all further pathways of said stable pathways, for accessing said living entities located within said open spaces within said collapsed structure; and

transmitting, by said processor to said search and rescue system, geographical coordinates of said multiple additional pathways, wherein said search and rescue system further presents images of said multiple additional pathways via said two dimensional image of said graphical user interface.