Method and apparatus to determine robot location using omni-directional image

• US 8,498,488 B2
• Filed: 07/31/2007
• Issued: 07/30/2013
• Est. Priority Date: 09/26/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yoon, Sukjune, Roh, Kyung Shik, Han, Woosup, Min, Seung Ki
• Primary Examiner(s): Bhatnagar, Anand
• Assistant Examiner(s): PARK, SOO JIN
• Application Number:
  US11/830,883
• Publication Number:
  US 20080075357A1
• Time in Patent Office: 2,191 Days
• Field of Search: 382/181, 382/190, 382/195, 382/203, 382/206, 382/207, 700/245, 700/253, 700/259, 348 36- 39
• US Class Current: 382/207
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

A method to determine the location of a robot using an omni-directional image, the method including acquiring an omni-directional image from a robot, extracting a predetermined current line from the acquired omni-directional image, calculating a correlation coefficient between the extracted current line of the robot and each landmark line of pre-stored nodes using a Fast Fourier Transform (FFT), and performing a stochastic approach method of a particle filtering process on a basis of the calculated correlation coefficient to recognize a location of the robot.

Claims

1. A method to locate a robot using an omni-directional image, the method comprising:

acquiring the omni-directional image from a robot;

extracting a predetermined current line from the acquired omni-directional image;

calculating a correlation coefficient between the extracted current line of the robot and each pre-stored landmark line of nodes corresponding to locations in a robot-locatable area using a Fast Fourier Transform (FFT);

selecting M nodes at which the calculated correlation coefficient is equal to or higher than a predetermined value;

modifying a current line of the robot such that same spatial objects are located at a same location on a basis of the landmark lines of the selected M nodes to create a wrapped current line;

calculating a correlation coefficient between the wrapped current line of the robot and the landmark lines of the M nodes;

selecting N nodes at which the calculated correlation coefficient is equal to or higher than a predetermined correlation coefficient such that N<

M; and

recognizing a location of the robot on a basis of the selected N nodes,

wherein the pre-stored landmark lines of the nodes are lines pre-extracted from omni-directional images acquired when the robot is located at the nodes in the robot-locatable area.

2. The method of claim 1, wherein the predetermined current line is a circumference spaced apart from an origin of the omni-directional image by a predetermined location.

3. The method of claim 1, wherein the correlation coefficient between the current line of the robot and each pre-stored landmark line of the nodes is calculated by the following equation:

4. The method of claim 1, wherein the modifying of the current line comprises:

extracting an edge of the current line of the robot and an edge of each landmark line of the M nodes;

matching the edge of the current line of the robot with the edge of the landmark line of the M nodes; and

modifying the current line of the robot on a basis of the matched edge, such that the same spatial objects are located at the same location of the current line.

5. The method of claim 4, wherein the edge is indicative of an end point at which each RGB of the current line changes by a predetermined value or more.

6. A method to locate a robot with an omni directional camera mounted thereon, the method comprising:

setting a number landmark lines for a predetermined number of nodes corresponding to locations within a robot-locatable area;

acquiring an omni directional image from the robot;

extracting a current line from the acquired image;

calculating a correlation coefficient between the current line and the landmark lines for each node;

selecting a first number of nodes at which the calculated correlation coefficient is equal to or higher than a predetermined value;

modifying the current line into a plurality of wrapped current lines such that spatial objects in each wrapped current line are at the same location with corresponding spatial objects in each of the landmark lines for the first number of nodes;

calculating a second correlation coefficient between the wrapped current lines and the landmark lines of the first number of nodes;

selecting a second number of nodes among the first number of nodes at which the second calculated correlation coefficient is equal to or higher than a second predetermined value; and

recognizing a location of the robot on the basis of the selected second number of nodes; and

determining a location of the robot based on the calculated correlation coefficient,

wherein the landmark lines for the predetermined number of nodes are lines pre-extracted from omni-directional images acquired when the robot is located at the predetermined number of nodes in the robot-locatable area.

7. The method of claim 6, wherein the calculating of the correlation coefficient uses a Fast Fourier Transform (FFT) method.

8. The method of claim 6, wherein the modifying of the current line comprises:

extracting an edge of the current line and an edge of each landmark line of the first number of nodes; and

matching the edge of the current line with the edge of the landmark lines.

9. The method of claim 8, wherein the edge is an end point at which each RGB of the current line changes by at least a third predetermined value.

10. The method of claim 6, wherein the predetermined value and the second predetermined value are the same.

11. A robot locating apparatus, comprising:

a robot body;

an omni-directional camera mounted on the robot body to acquire an omni-directional image; and

a controller to extract a predetermined current line from the acquired omni-directional image, to calculate a correlation coefficient between the extracted current line of the robot and each pre-stored landmark line of nodes corresponding to locations of a robot locatable area using a Fast Fourier Transform (FFT), to select M nodes at which the calculated correlation coefficient is equal to or higher than a predetermined value, to modify the current line of the robot such that same spatial objects are located at a same location on both the current line and the landmark lines on a basis of the landmark lines of the selected M nodes to create a wrapped current line, to calculate a correlation coefficient between the wrapped current line of the robot and the landmark lines of the M nodes, to select N nodes at which the calculated correlation coefficient is equal to or higher than a predetermined correlation coefficient such that N<

M, and to recognize a location of the robot based on the selected N nodes,

wherein the pre-stored landmark lines of the nodes are lines pre-extracted from omni-directional images acquired when the robot is located at the nodes in the robot-locatable area.

12. The apparatus of claim 11, wherein the controller is mounted apart from the robot body and communicates with at least one of the robot body and the omni-directional camera.