Remote-controlled robot and robot self-position identification method

• US 20050071047A1
• Filed: 11/02/2004
• Published: 03/31/2005
• Est. Priority Date: 05/31/2002
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Shimizu, Katsutoshi, Okabayashi, Miwa, Okabayashi, Keiju, Murase, Yuichi, Iwashita, Sumihisa, Sawasaki, Naoyuki
• Granted Patent: US 7,120,519 B2
• Time in Patent Office: Days
• US Class Current: 700/245
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0229 in combination with fixed guiding means
• CPC Class Codes: G05D 1/0242 using non-visible light signals, e.g. IR or UV signals
• CPC Class Codes: G05D 1/0251 extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593
• CPC Class Codes: G05D 1/0272 comprising means for registering the travel distance, e.g. revolutions of wheels measuring distance traversed on the ground by vehicles, e.g. using odometers G01C22/00
• CPC Class Codes: G05D 1/0274 using mapping information stored in a memory device navigation using map-matching G01C21/30
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

A remotely controlled robot comprises a unit storing the layout plan of a building, a unit receiving a position remotely designated in the layout plan from a remote location and a unit controlling the travel of the robot to the designated position. A self-position identification method is implemented by a robot with a camera whose shooting direction can be changed. The robot takes in advance a panoramic picture of a room where the robot may travel, generates a reference picture by extracting a plurality of block pictures from the panoramic picture and identifies a room where the robot is located, by applying correlation and DP matching, using both a picture taken in the room where the robot is located and the reference picture.

Claims

1. A robot that can be remotely controlled, comprising:

a layout storage unit for storing a layout plan of a building;

a communication unit for receiving designation of a position designated in the layout plan from a remote terminal; and

a travel control unit for controlling travel of a robot to the designated position.

2. The remotely controlled robot according to claim 1, further comprising

a step getting over unit for getting over steps in a building, based on the result of step detection by an obstacle detecting sensor.

3. The remotely controlled robot according to claim 1, further comprising

a self-position identification unit for identifying the current position and direction of the robot in the building, wherein

said travel control unit controls the travel of the robot to the designated position, based on the result of the identification.

4. A robot that can be remotely controlled, comprising:

a layout storage unit for storing a layout plan of a building;

a communication unit for receiving designation of a room designated in the layout plan from a remote terminal; and

a travel control unit for controlling the travel of a robot to the designated room.

5. A robot that can be remotely controlled, comprising:

a picture taking unit for taking an inside picture of a building;

a communication unit for transmitting the picture taken by the picture taking unit when the robot regularly/irregularly patrols inside a building, to a computer with memory accessible from the outside through a network.

6. The remotely controlled robot according to claim 5, further comprising

a step getting over unit for getting over steps in a building, based on the result of step detection by an obstacle detecting sensor.

7. The remotely controlled robot according to claim 5, further comprising

a rotation unit for changing the shooting direction of the picture taking unit;

and

an infrared ray emission/reception unit for emitting/receiving an infrared ray in parallel to the shooting direction of the picture taking unit.

8. The remotely controlled robot according to claim 5, wherein

the computer to which said communication unit transmits the picture is a Web server connected to the Internet.

9. A robot that can be remotely controlled, comprising:

a picture taking unit for taking an inside picture of a building;

a communication unit for transmitting the picture taken by the picture taking unit when the robot regularly/irregularly patrols inside a building, to a computer with memory accessible from the outside through a network.

10. The remotely controlled robot, according to claim 9, further comprising:

a communication unit for starting the computer when a ringer signal is transmitted from the outside through the Internet a prescribed number of times.

11. A robot that can be remotely controlled, comprising:

a script storage unit for storing the programs of scripts for one or more operations stored in the script storage unit; and

a communication unit for receiving the command to execute one of the programs stored in the script storage unit.

12. A robot that can be remotely controlled, comprising:

a command receiving unit for receiving an emergency command from a person in a building; and

a communication unit for issuing the emergency command to a predetermined remote terminal according to the command.

13. The robot that can be remotely controlled according to claim 12, further comprising:

a picture taking unit for taking an inside picture of a building;

a rotation unit for changing the shooting direction of the picture taking unit; and

a communication unit for transmitting a picture taken by the picture taking unit to the outside, according to the command on a shooting direction from the outside.

14. A self-position identification method of a robot with a camera whose shooting direction can be changed, comprising of:

taking in advance a panoramic picture of each room to which the robot may travel;

generating a reference picture by extracting a plurality of block pictures from the panoramic picture; and

identifying a room where the robot is located, by applying correlation calculation and DP matching, using both a picture of the same size as the block picture in the panoramic picture taken in a position where the robot is located, and the reference picture.

15. The robot self-position identification method according to claim 14, wherein

designating the picture of a landmark, taken in advance, of all the landmarks in the identified room, as a reference template, applying correlation calculation between the reference template and a picture taken in a position where the robot is located, and calculating the position of the landmark in the taken picture;

and

stereoscopically measuring a distance between the robot and each of a plurality of landmarks and identifying the own robot'"'"'s position and direction in the identified room.

16. The robot self-position identification method according to claim 15, wherein

extracting a vertical line in the taken picture of the landmark;

calculating cost corresponding to a difference between an angle that is formed by each of two shooting directions of two cameras and the direction of the vertical line, and a resulted angle of calculation that is formed by each of the two shooting directions of the two cameras and the direction of the landmark presuming the position and direction of the robot; and

changing the presumed position and direction of the robot and identifying a presumed position and direction of the robot, where the cost becomes the lowest, to be the position and direction of the robot.

17. A robot that can be remotely controlled, comprising:

layout storage means for storing a layout plan of a building;

communication means for receiving designation of a position designated in the layout plan from a remote terminal; and

travel control means for controlling travel of a robot to the designated position.

18. A robot that can be remotely controlled, comprising:

picture taking means for taking an inside picture of a building;

communication means for transmitting the picture taken by the picture taking means when the robot regularly/irregularly patrols inside a building, to a computer with memory accessible from the outside through a network.

19. A robot that can be remotely controlled, comprising:

script storage means for storing the programs of scripts for one or more operations stored in the script storage means; and

communication means for receiving the command to execute one of the programs stored in the script storage means.