Method and apparatus for path planning, selection, and visualization

• US 20100241289A1
• Filed: 07/21/2007
• Published: 09/23/2010
• Est. Priority Date: 06/22/2006
• Status: Abandoned Application

• Current Assignee: Roy Sandberg
• Original Assignee: Roy Sandberg
• Inventors: Sandberg, Roy
• Application Number:
  US12/308,611
• Publication Number:
  US 20100241289A1
• Time in Patent Office: Days
• US Class Current: 701/2
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G05B 2219/35506 Camera images overlayed with graphics, model
• CPC Class Codes: G05B 2219/40161 Visual display of machining, operation, remote viewing
• CPC Class Codes: G05B 2219/40169 Display of actual situation at the remote site
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G06T 1/0014 Image feed-back for automatic industrial control, e.g. robot with camera robots B25J19/023

Abstract

New and Improved methods and apparatus for robotic path planning, selection, and visualization are described A path spline visually represents the current trajectory of the robot through a three dimensional space such as a room By altering a graphical representation of the trajectory—the path spline—an operator can visualize the path the robot will take, and is freed from real-time control of the robot Control of the robot is accomplished by periodically updating the path spline such that the newly updated spline represents the new desired path for the robot Also a sensor that may be located on the robot senses the presence of boundaries (obstacles) in the current environment and generates a path that circumnavigates the boundaries while still maintaining motion in the general direction selected by the operator The mathematical form of the path that circumnavigates the boundaries may be a spline

Claims

1. A method of controlling a remotely located robot comprising the steps of:

a) computationally superimposing a graphical representation of a path on an image of a remote location, the image displayed on a computer display;

b) computationally modifying the graphical representation of the path in response to a user input; and

c) computationally executing a move sequence derived from the graphical representation of the modified path.

2. The method of claim 1, wherein:

the remotely located robot adjusts its path due to user input while it is moving.

3. The method of claim 1, wherein:

a section of the move sequence has a curvature of a clothoid spiral.

4. The method of claim 1, wherein:

subsequent move sequences are continuously and automatically executing by the robot at a predefined rate.

5. A method of avoiding an obstacle comprising the steps of:

a) computationally superimposing a line or curve on an image of a remote location, the image displayed on a computer display;

b) detecting the distance of an object by use of a distance sensor;

c) moving in response to the detected object; and

d) superimposing a second line or second curve on an image of a remote location, the image displayed on a computer screen, where the second line or second curve represents the movement in response to the detected object.

6. A method of avoiding an obstacle comprising the steps of:

a) computationally superimposing a line or curve on an image of a remote location, the image displayed on a computer display;

b) detecting the distance of an object by use of a distance sensor;

c) superimposing a second line or second curve on an image of a remote location, the image displayed on a computer screen, where the second line or second curve represents the planned movement in response to the detected object; and

d) moving in accordance with the planned movement.

7. A method of controlling a remotely located robot comprising the steps of:

a) determining the round-trip delay for information sent between a client and a remotely located robot;

b) accepting an image of a remote location from a remotely located robot;

c) modifying the image such that it is representative of a predicted movement of the robot, the predicted movement predicted to occur at a time equal to the round-trip delay;

d) displaying the modified image

8. A method of controlling a remotely located robot comprising the steps of

a) accepting a camera image;

b) normalizing the camera image whereby the normalized camera image is invariant with respect to a camera angle;

c) deriving a first horizontal translation, a first vertical translation, and a first in-plane rotation from the normalized camera image;

d) deriving a second horizontal translation, a second vertical translation, and a second in-plane rotation from a plurality of wheel rotation sensors;

e) determining an error in robot position by measuring the difference between the first horizontal translation and the second horizontal translation, the first vertical translation and the second vertical translation, and the first in-plane rotation and the second in-plane rotation; and

f) moving a wheel rotation motor in a corrective manner based on the error in robot position.

9. A method of controlling a remotely located robot comprising the steps of:

a) accepting a one-dimensional array of distance values from a distance sensor;

b) finding a local maxima in the one-dimensional array of distance values;

c) plotting a path from the current location of the remotely located robot to a location represented by the local maxima in the one-dimensional array of distance values; and

d) displaying the path on a graphical user interface;

10. Mobile video teleconferencing system and control method An apparatus for controlling a remotely located robot comprising:

a) a distance sensor;

b) a computer accepting a one-dimensional array of distance values from the distance sensor, the computer finding a local maxima in the one-dimensional array of values, and calculating a path from a current location of the remotely located robot to a location represented by the local maxima; and

c) a display showing a graphical representation of the calculated path.