APPARATUS AND METHOD FOR UNMANNED SURVEILLANCE, AND ROBOT CONTROL DEVICE FOR UNMANNED SURVEILLANCE

• US 20130197718A1
• Filed: 12/06/2012
• Published: 08/01/2013
• Est. Priority Date: 01/30/2012
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: LEE, Chang Eun, CHO, Hyun Kyu, KIM, Sung Hoon, SEO, Beom-Su
• Granted Patent: US 8,977,409 B2
• Time in Patent Office: Days
• US Class Current: 701/2
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: Y10S 901/01 Mobile robot

Abstract

An unmanned surveillance device includes a robot control terminal configured to be loaded within a remote control robot under a surveillance environment, collect state information and surrounding circumstance information, operate the remote control robot in driving mode or surveillance mode according to a remote control command corresponding to the state information and surrounding circumstance information. Further, the unmanned surveillance device includes a remote control system configured to receive the state information and the surrounding circumstance information of the remote control robot from the robot control terminal, output the received state information and surrounding circumstance information of the remote control robot, and provide the remote control command to the robot control terminal.

Claims

1. An unmanned surveillance device, comprising:

a robot control terminal configured to be loaded within a remote control robot under a surveillance environment, collect state information and surrounding circumstance information, operate the remote control robot in driving mode or surveillance mode according to a remote control command corresponding to the state information and surrounding circumstance information; and

a remote control system configured to receive the state information and the surrounding circumstance information of the remote control robot from the robot control terminal, output the received state information and surrounding circumstance information of the remote control robot, and provide the remote control command to the robot control terminal.

2. The unmanned surveillance device of claim 1, wherein the driving mode includes one of standby mode, semi-autonomous driving mode, autonomous driving mode, return mode, manual control mode, or emergency stop mode.

3. A robot control terminal for unmanned surveillance, comprising:

a robot state information processor unit configured to perform a function of creating space infrastructure for driving of a robot, and collect and process the state information of the robot;

a robot autonomous driving unit configured to provide location awareness information for autonomous driving of the robot according to a result of processing the state information processed by the robot state information processing unit, provide an optimal path for the autonomous driving of the robot;

a remote control command processor unit configured to process surveillance information for remote control of the robot while being connected with the robot autonomous driving unit, process behavior control of the robot based on the remote control; and

a user mission performance support unit configured to process image information for the remote control of a user while being connected to the remote control command processor unit, transmit situation awareness sensor information to an operation system.

4. The robot control terminal of claim 3, wherein the robot autonomous driving unit provides a function of reasoning and searching for the autonomous driving of the robot.

5. The robot control terminal of claim 3, wherein the robot autonomous driving unit provide a function of modeling and awareness of an environment.

6. The robot control terminal of claim 3, wherein the robot control terminal includes a function of image-based context awareness.

7. A method for unmanned surveillance using a remote control system, the method comprising:

a robot control terminal loaded in a robot under unmanned surveillance environment tracking an adaptive object based on a human context;

the robot control terminal detecting an object based on fusion of features after tracking the adaptive object;

controlling a three-dimensional camera for extracting geometric object information after detecting the object based on the fusion of the features;

analyzing and perceiving an abnormal situation context according to the result of the controlling the three-dimensional camera; and

alarming and monitoring an abnormal situation according to the result of analyzing and perceiving the situation context.

8. The method of claim 7, wherein said tracking an adaptive object includes:

tracking the object based on complex features; and

modeling backgrounds based on entropy for changing a background such as lighting.

9. The method of claim 7, wherein said detecting the object based on fusion of features includes:

modeling and matching based on the complex features; and

performing segmentation based on adaptive morphology.

10. The method of claim 7, wherein said controlling a three-dimensional camera includes:

managing a three-dimensional multi-object profile; and

extracting three-dimensional feature for extracting geometric information.

11. The method of claim 7, wherein said analyzing and perceiving a situation context includes:

fusing and analyzing multiple objects feature information and a statistics-based prediction model for dynamic emergency events modeling; and

perceiving abnormal behavior context.

12. The method of claim 8, wherein the complex features includes at least one of correction filter, color, context and edge.