Auto-Reach Method and System for a Remote Vehicle

• US 20150273684A1
• Filed: 04/09/2015
• Published: 10/01/2015
• Est. Priority Date: 04/15/2011
• Status: Active Grant

• Current Assignee: Flir Detection, Inc. (Teledyne Technologies Incorporated)
• Original Assignee: iRobot Corporation
• Inventors: Huang, Wesley Hanan, Phillips, Emilie A.
• Granted Patent: US 9,770,823 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B25J 11/002 Manipulators for defensive or military tasks
• CPC Class Codes: B25J 19/023 including video camera means
• CPC Class Codes: B25J 5/005 mounted on endless tracks or belts
• CPC Class Codes: B25J 9/162 Mobile manipulator, movable base with manipulator arm mounted on it
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 2219/39391 Visual servoing, track end effector with camera image feedback
• CPC Class Codes: G05B 2219/40003 Move end effector so that image center is shifted to desired position
• CPC Class Codes: G05B 2219/40062 Door opening
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: Y10S 901/09 Closed loop, sensor feedback controls arm movement
• CPC Class Codes: Y10S 901/47 Optical

Abstract

The present teachings provide a method of controlling a remote vehicle having an end effector and an image sensing device. The method includes obtaining an image of an object with the image sensing device, determining a ray from a focal point of the image to the object based on the obtained image, positioning the end effector of the remote vehicle to align with the determined ray, and moving the end effector along the determined ray to approach the object.

Claims

1. A method of controlling a remote vehicle having an end effector and an image sensing device disposed thereon to move the remote vehicle to approach an object, the method comprising:

moving the remote vehicle and the imaging sensing device from an initial pose to a targeting pose at which a focal point of the image sensing device is aligned with the object;

obtaining an image of the object with the image sensing device;

determining a ray from a focal point of the image to the object based on the obtained image;

positioning the end effector of the remote vehicle to align with the determined ray; and

moving the end effector along the determined ray to approach the object, wherein the end effector is mounted on the remote vehicle;

grasping the object with the end effector;

rotating and/or moving the object by moving the remote vehicle and/or end effector.

2. The method according to claim 1, further comprising providing at least one user input selection option, and receiving a first user input selection from the at least one user input selection option to determine the ray.

3. The method according to claim 2, further comprising receiving a second user input selection from the at least one user input selection option, and controlling the end effector to grip the object after receiving the second user input selection.

4. The method according to claim 3, further comprising receiving a third user input selection from the at least one user input selection option, and moving the image sensor to a targeting pose to view the object within a field of view of the image sensor before displaying the image of the object on the display.

5. The method according to claim 1, further comprising detecting when the end effector reaches the object, and stopping moving the end effector along the ray when the end effector is detected to reach the object.

6. The method according to claim 1, further comprising detecting whether torque of a motor of the remote vehicle increases after moving the end effector to approach the object, and determining that the end effector reaches the object when the torque of the motor is detected to increase.

7. The method according to claim 1, wherein the remote vehicle comprises a chassis and moving the remote vehicle to approach the object comprises moving the chassis across a planar surface, and the remote vehicle is controlled by an operator that is remote from the vehicle.

8. The method according to claim 1, wherein the end effector is mounted on the remote vehicle with a movable structure, and rotating the object comprises moving the movable structure.

9. A method of controlling a remote vehicle having an end effector and an image sensing device to move the remote vehicle to approach an object, the method comprising:

displaying an image of an object obtained from the image sensing device and an object alignment symbol on a display, the object alignment symbol representing a focal point of the image sensed by the image sensing device;

moving the remote vehicle and the image sensing device from an initial pose to a targeting pose at which the focal point of the image sensing device is aligned with the object;

receiving an input to align the object alignment symbol with the displayed object;

determining a ray from the focal point of the image to the object based on the received input;

aligning the end effector of the remote vehicle with the determined ray;

moving the remote vehicle to approach the object; and

moving the end effector along the determined ray to approach the object, wherein the end effector is mounted on the remote vehicle;

grasping the object with the end effector;

rotating and/or moving the object by moving the remote vehicle and/or end effector.

10. The method according to claim 9, further comprising providing at least one user input selection option, and receiving a first user input selection from the at least one user input selection option to determine the ray.

11. The method according to claim 10, further comprising receiving a second user input selection from the at least one user input selection option, and controlling the end effector to grip the object after receiving the second user input selection.

12. The method according to claim 11, further comprising receiving a third user input selection from the at least one user input selection option, and moving the image sensor to a targeting pose to view the object within a field of view of the image sensor before displaying the image of the object on the display.

13. The method according to claim 9, further comprising detecting when the end effector reaches the object, and stopping moving the end effector along the ray when the end effector is detected to reach the object.

14. The method according to claim 9, further comprising detecting whether torque of a motor of the remote vehicle increases after moving the end effector to approach the object, and determining that the end effector reaches the object when the torque of the motor is detected to increase.

15. The method according to claim 9, wherein the remote vehicle comprises a chassis and moving the remote vehicle to approach the object comprises moving the chassis across a planar surface, and the remote vehicle is controlled by an operator that is remote from the vehicle.

16. The method according to claim 9, wherein the end effector is mounted on the remote vehicle with a movable structure, and rotating the object comprises moving the movable structure.

17. A method of controlling a remote vehicle having an end effector and an image sensing device to move the remote vehicle to approach an object, the method comprising:

receiving a first input to move the image sensing device from an initial pose to a targeting pose to view an object within a field of view of the image sensing device, wherein a focal point of the image sensing device is aligned with the object in the targeting pose;

displaying an image of the object obtained from the image sensing device;

receiving a second input to move the image sensing device to an object alignment position at which a focal point of the image is aligned with the displayed, object;

determining a ray from the focal point of the image to the object based on the displayed image;

controlling the end effector of the remote vehicle to be positioned to align with the determined ray;

moving the remote vehicle to approach the object; and

controlling the end effector to move along the determined ray to approach the object, wherein the end effector is mounted on the remote vehicle;

grasping the object with the end effector;

rotating and/or moving the object by moving the remote vehicle and/or end effector.

18. The method according to claim 17, further comprising providing at least one user input selection option, and receiving a first user input selection from the at least one user input selection option to determine the ray.

19. The method according to claim 18, further comprising receiving a second user input selection from the at least one user input selection option, and controlling the end effector to grip the object after receiving the second user input selection.

20. The method according to claim 19, further comprising receiving a third user input selection from the at least one user input selection option, and moving the image sensor to a targeting pose to view the object within a field of view of the image sensor before displaying the image of the object on the display.

21. The method according to claim 17, further comprising detecting when the end effector reaches the object, and stopping moving the end effector along the ray when the end effector is detected to reach the object.

22. The method according to claim 17, further comprising detecting whether torque of a motor of the remote vehicle increases after moving the, end effector to approach the object, and determining that the end effector reaches the object when the torque of the motor is detected to increase.

23. The method according to claim 17, wherein the remote vehicle comprises a chassis and moving the remote vehicle to approach the object comprises moving the chassis across a planar surface, and the remote vehicle is controlled by an operator that is remote from the vehicle.