REAL TIME EXPLOSIVE HAZARD INFORMATION SENSING, PROCESSING, AND COMMUNICATION FOR AUTONOMOUS OPERATION

• US 20120239191A1
• Filed: 03/16/2011
• Published: 09/20/2012
• Est. Priority Date: 07/05/2006
• Status: Active Grant

• Current Assignee: Battelle Energy Alliance LLC (Battelle Memorial Institute)
• Original Assignee: Battelle Energy Alliance LLC (Battelle Memorial Institute)
• Inventors: Few, Douglas A., Kinoshita, Robert A., Versteeg, Roelof J., Johnson, Doug, Linda, Ondrej
• Granted Patent: US 8,965,578 B2
• Time in Patent Office: Days
• US Class Current: 700/246
• CPC Class Codes: F41H 11/13 Systems specially adapted for detection of landmines
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life

Abstract

Methods, computer readable media, and apparatuses provide robotic explosive hazard detection. A robot intelligence kernel (RIK) includes a dynamic autonomy structure with two or more autonomy levels between operator intervention and robot initiative A mine sensor and processing module (ESPM) operating separately from the RIK perceives environmental variables indicative of a mine using subsurface perceptors. The ESPM processes mine information to determine a likelihood of a presence of a mine. A robot can autonomously modify behavior responsive to an indication of a detected mine. The behavior is modified between detection of mines, detailed scanning and characterization of the mine, developing mine indication parameters, and resuming detection. Real time messages are passed between the RIK and the ESPM. A combination of ESPM bound messages and RIK bound messages cause the robot platform to switch between modes including a calibration mode, the mine detection mode, and the mine characterization mode.

Claims

1. A method of explosive hazard detection, comprising:

providing a robot intelligence kernel (RIK) including a dynamic autonomy structure with two or more autonomy levels between operator intervention in a teleoperation mode and robot initiative in an autonomous mode and for controlling operation of one or more locomotors and one or more subsurface perceptors;

providing an explosive hazard sensor and processing module (ESPM) operating separately from the robot intelligence kernel and for;

perceiving environmental variables indicative of a presence of an explosive hazard using the one or more subsurface perceptors;

processing information from the perceiving to determine a likelihood of a presence of the explosive hazard; and

communicating with the robot intelligence kernel to exchange information and commands;

autonomously modifying behavior of the robot, responsive to an indication of a detected explosive hazard from the explosive hazard sensor and processing module, between;

detection of explosive hazards as part of achievement of a goal assigned by the operator;

detailed scanning and characterization of the detected explosive hazard by adjusting operation of the one or more locomotors and the one or more subsurface perceptors and processing sensed information to develop explosive hazard indication parameters; and

resuming the detection of explosive hazards after the detailed scanning and characterization.

2. The method of claim 1, wherein autonomously modifying behavior of the robot further comprises marking a location of the detected explosive hazard between the detailed scanning and characterization and the resuming the searching for explosive hazards.

3. The method of claim 1, wherein processing sensed information to develop explosive hazard indication parameters further comprises determining a centroid location of the explosive hazard, determining a perimeter of the explosive hazard, and determining a confidence level that the explosive hazard has been detected.

4. The method of claim 1, wherein communicating with the robot intelligence kernel to exchange information further comprises:

sending a map value message including a first location estimate and a sensed intensity estimate;

sending a suspected explosive hazard message including a second location estimate and a sensed intensity estimate responsive to a detection process by the ESPM of the suspected explosive hazard; and

sending an explosive hazard location message including a third location estimate and a confidence level estimate responsive to a characterization process by the ESPM of detailed explosive hazard information.

5. The method of claim 1, communicating with the robot intelligence kernel to exchange information and commands comprises:

sending ESPM bound messages from the RIK to the ESPM to set parameters of the ESPM, request operations to be performed by the ESPM, and acknowledge at least some messages from the RIK; and

sending RIK bound messages from the ESPM to the RIK to request operations to be performed by the RIK, send explosive hazard information, and acknowledge at least some messages from the ESPM.

6. A robot platform, comprising:

one or more subsurface perceptors configured for perceiving environmental variables indicative of a presence of an explosive hazard;

one or more locomotors configured for providing mobility to the robot platform; and

one or more controllers configured for executing;

a robot intelligence kernel including a dynamic autonomy structure with two or more autonomy levels between operator intervention in a teleoperation mode and robot initiative in an autonomous mode and for controlling operation of one or more locomotors and one or more subsurface perceptors; and

an explosive hazard sensor and processing module operating separately from the robot intelligence kernel and for;

perceiving environmental variables indicative of a presence of an explosive hazard using the one or more subsurface perceptors;

processing information from the perceiving to determine a likelihood of a presence of the explosive hazard; and

communicating with the robot intelligence kernel to exchange information and commands;

autonomous behavior modifications of the robot platform, responsive to an indication of a detected explosive hazard from the explosive hazard sensor and processing module, between;

detection of explosive hazards as part of achievement of a goal assigned by the operator;

detailed scanning and characterization of the detected explosive hazard by adjusting operation of the one or more locomotors and the one or more subsurface perceptors and processing sensed information to develop explosive hazard indication parameters; and

resuming the detection of explosive hazards after the detailed scanning and characterization.

7. The robot platform of claim 6, wherein the one or more controllers include at least a first controller for the robot intelligence kernel and a second controller for the explosive hazard sensor and processing module.

8. The robot platform of claim 6, wherein the one or more controllers include a single controller for the robot intelligence kernel and the explosive hazard sensor and processing module.

9. The robot platform of claim 6, wherein the one or more controllers are further configured for executing a process for marking a location of the detected explosive hazard between the detailed scanning and characterization and the resuming the searching for explosive hazards.

10. The robot platform of claim 6, wherein the one or more controllers are further configured for processing sensed information to develop the explosive hazard indication parameters by determining a centroid location of the explosive hazard, determining a perimeter of the explosive hazard, and determining a confidence level that the explosive hazard has been detected.

11. The robot platform of claim 6, wherein the one or more controllers are further configured for communicating with the robot intelligence kernel to exchange information by:

Sending a map value message including a first location estimate and a sensed intensity estimate;

sending a suspected explosive hazard message including a second location estimate and a sensed intensity estimate responsive to a detection process by the ESPM of the suspected explosive hazard; and

sending an explosive hazard location message including a third location estimate and a confidence level estimate responsive to a characterization process by the ESPM of detailed explosive hazard information.

12. The robot platform of claim 6, wherein the one or more controllers are further configured for communicating between the ESPM and the RIK by:

sending ESPM bound messages from the RIK to the ESPM to set parameters of the ESPM, request operations to be performed by the ESPM, and acknowledge at least some messages from the RIK; and

sending RIK bound messages from the ESPM to the RIK to request operations to be performed by the RIK, send explosive hazard information, and acknowledge at least some messages from the ESPM.

13. A method of communicating real time messages between a robot intelligence kernel (RIK) and an explosive hazard sensor and processing module (ESPM), comprising:

sending ESPM bound messages from the RIK to the ESPM to set parameters of the ESPM, request operations to be performed by the ESPM, and acknowledge at least some messages from the RIK; and

sending RIK bound messages from the ESPM to the RIK to request operations to be performed by the RIK, send explosive hazard information, and acknowledge at least some messages from the ESPM;

wherein a combination of the ESPM bound messages and the RIK bound messages cause a robot platform to perform explosive hazard detection by switching between modes comprising;

a calibration mode for calibrating one or more subsurface perceptors;

an explosive hazard detection mode for operating one or more locomotors and the one or more subsurface perceptors in a detection configuration to determine an indication of an explosive hazard; and

an explosive hazard characterization mode for real time processing of detailed explosive hazard information responsive to the indication of the explosive hazard by operating the one or more locomotors and the one or more subsurface perceptors in a characterization configuration to develop the detailed explosive hazard information.

14. The method of claim 13, further comprising a map value mode for surveying subsurface features and communicating map information about the subsurface features as RIK bound messages.

15. The method of claim 13, wherein sending the explosive hazard information in the explosive hazard detection mode comprises sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

a suspected explosive hazard message including an additional location estimate and a sensed intensity estimate responsive to a determination by the ESPM of a suspected explosive hazard in the explosive hazard detection mode.

16. The method of claim 13, wherein sending the explosive hazard information in the explosive hazard characterization mode comprises sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

an explosive hazard location message including an additional location estimate and a confidence level estimate responsive to processing of the detailed explosive hazard information in the explosive hazard characterization mode.

17. The method of claim 16, wherein the additional location estimate comprises a centroid estimate of the explosive hazard and a perimeter estimate of the explosive hazard.

18. The method of claim 13, wherein sending the ESPM bound messages includes messages to control entering and leaving the explosive hazard detection mode and messages to control entering and leaving the explosive hazard characterization mode.

19. A robot platform for communicating real time messages between a robot intelligence kernel (RIK) and an explosive hazard sensor and processing module (ESPM), comprising:

one or more subsurface perceptors configured for perceiving environmental variables indicative of a presence of the explosive hazard;

one or more locomotors configured for providing mobility to the robot platform; and

one or more controllers configured for;

sending ESPM bound messages from the RIK to the ESPM to set parameters of the ESPM, request operations to be performed by the ESPM, and acknowledge at least some messages from the RIK; and

sending RIK bound messages from the ESPM to the RIK to request operations to be performed by the RIK, send explosive hazard information, and acknowledge at least some messages from the ESPM;

wherein a combination of the ESPM bound messages and the RIK bound messages cause the robot platform to perform explosive hazard detection by switching between modes comprising;

a calibration mode for calibrating the one or more subsurface perceptors;

an explosive hazard detection mode for operating the one or more locomotors and the one or more subsurface perceptors in a detection configuration to determine an indication of an explosive hazard; and

an explosive hazard characterization mode for real time processing of detailed explosive hazard information responsive to the indication of the explosive hazard by operating the one or more locomotors and the one or more subsurface perceptors in a characterization configuration to develop the detailed explosive hazard information.

20. The robot platform of claim 19, wherein the one or more controllers include at least a first controller for the robot intelligence kernel and a second controller for the explosive hazard sensor and processing module.

21. The robot platform of claim 19, wherein the one or more controllers include a single controller for the robot intelligence kernel and the explosive hazard sensor and processing module.

22. The robot platform of claim 19, further comprising a map value mode for surveying subsurface features and communicating map information about the subsurface features as RIK bound messages.

23. The robot platform of claim 19, wherein the one or more controllers configured for sending the explosive hazard information in the explosive hazard detection mode are further configured for sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

a suspected explosive hazard message including an additional location estimate and a sensed intensity estimate responsive to a determination by the ESPM of the suspected explosive hazard in the explosive hazard detection mode.

24. The robot platform of claim 19, wherein the one or more controllers configured for sending the explosive hazard information in the explosive hazard characterization mode are further configured for sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

an explosive hazard location message including an additional location estimate and a confidence level estimate responsive to processing of the detailed explosive hazard information in the explosive hazard characterization mode.

25. The robot platform of claim 24, wherein the other location estimate comprises a centroid estimate of the explosive hazard and a perimeter estimate of the explosive hazard.

26. The robot platform of claim 19, wherein the one or more controllers configured for sending the ESPM bound messages includes messages to control entering and leaving the explosive hazard detection mode and messages to control entering and leaving the explosive hazard characterization mode.

27. Computer readable media including computer executable instructions, which when executed on a processor provide communication of real time messages between a robot intelligence kernel (RIK) and an explosive hazard sensor and processing module (ESPM) to:

send ESPM bound messages from the RIK to the ESPM to set parameters of the ESPM, request operations to be performed by the ESPM, and acknowledge at least some messages from the RIK; and

send RIK bound messages from the ESPM to the RIK to request operations to be performed by the RIK, send explosive hazard information, and acknowledge at least some messages from the ESPM;

wherein a combination of the ESPM bound messages and the RIK bound messages cause a robot platform to perform explosive hazard detection by switching between modes comprising;

a calibration mode for calibrating one or more subsurface perceptors;

an explosive hazard detection mode for operating one or more locomotors and the one or more subsurface perceptors in a detection configuration to determine an indication of an explosive hazard; and

an explosive hazard characterization mode for real time processing of detailed explosive hazard information responsive to the indication of the explosive hazard by operating the one or more locomotors and the one or more subsurface perceptors in a characterization configuration to develop the detailed explosive hazard information.

28. The computer readable media of claim 27, wherein the computer executable instructions executed on the processor include instructions for include a map value mode for surveying subsurface features and communicating map information about the subsurface features as RIK bound messages.

29. The computer readable media of claim 27, wherein the computer executable instructions executed on the processor include instructions to send the explosive hazard information in the explosive hazard detection mode by sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

a suspected explosive hazard message including an additional location estimate and a sensed intensity estimate responsive to a determination by the ESPM of the suspected explosive hazard in the explosive hazard detection mode.

30. The computer readable media of claim 27, wherein the computer executable instructions executed on the processor include instructions to send the explosive hazard information in the explosive hazard characterization mode by sending the RIK bound messages including one or more of:

a map value message including a location estimate and a sensed intensity estimate; and

an explosive hazard location message including an additional location estimate and a confidence level estimate responsive to processing of the detailed explosive hazard information in the explosive hazard characterization mode.

31. The computer readable media of claim 30, wherein the computer executable instructions executed on the processor for the additional location estimate include instructions for a centroid estimate of the explosive hazard and a perimeter estimate of the explosive hazard.

32. The computer readable media of claim 27, wherein the computer executable instructions executed on the processor to send the ESPM bound messages include instructions for messages to control entering and leaving the explosive hazard detection mode and messages to control entering and leaving the explosive hazard characterization mode.

33. The robot platform of claim 27, wherein the computer executable instructions for the ESPM bound messages are configured to operate on a first processor and the computer executable instructions for the RIK bound messages are configured to operate on a second processor.

34. The robot platform of claim 27, wherein the computer executable instructions for the ESPM bound messages and the computer executable instructions for the RIK bound messages are configured to operate on a single processor.