TRACKING AND FOLLOWING OF MOVING OBJECTS BY A MOBILE ROBOT

• US 20120316680A1
• Filed: 06/13/2011
• Published: 12/13/2012
• Est. Priority Date: 06/13/2011
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Olivier, Charles F. III, Fouillade, Jean Sebastien, Felon, Adrien, Clinton, Nathaniel T., Sanchez, Russell, Burianek, Francois, Chalabi, Malek M., Cole, Jeffrey, Kikkeri, Harshavardhana Narayana
• Application Number:
  US13/158,465
• Publication Number:
  US 20120316680A1
• Time in Patent Office: Days
• US Class Current: 700/258
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means

Abstract

A robot tracks objects using sensory data, and follows an object selected by a user. The object can be designated by a user from a set of objects recognized by the robot. The relative positions and orientations of the robot and object are determined. The position and orientation of the robot can be used so as to maintain a desired relationship between the object and the robot. Using the navigation system of the robot, during its movement, obstacles can be avoided. If the robot loses contact with the object being tracked, the robot can continue to navigate and search the environment until the object is reacquired.

Claims

1. A computer-implemented process comprising:

receiving sensory data into memory from a robot;

tracking one or more objects in an environment of the robot using the sensory data;

directing the robot to move so as to maintain a relative position and orientation of the robot with respect to one or more of the tracked objects; and

controlling the movement of the robot so as to avoid obstacles using the sensory data.

2. The computer-implemented process of claim 1, further comprising:

enabling a user to select one or more of the tracked objects which the robot is directed to follow.

3. The computer-implemented process of claim 2, further comprising:

providing the user with a live video feed and indicating tracked objects in the live video feed.

4. The computer-implemented process of claim 3, wherein if tracking of an object loses an object then the process further comprises:

attempting to reacquire tracking of the lost object.

5. The computer-implemented process of claim 4, wherein attempting to reacquire tracking of the lost object comprises adjusting the position and orientation of the robot.

6. The computer-implemented process of claim 1, wherein if tracking of an object loses an object then the process further comprises:

attempting to reacquire tracking of the lost object.

7. The computer-implemented process of claim 6, wherein attempting to reacquire tracking of the lost object comprises adjusting the position and orientation of the robot.

8. The computer-implemented process of claim 1, wherein the tracked object is a person, and further comprising providing a second robot in a second environment and:

receiving sensory data into memory from a second robot;

tracking a person in the second environment of the second robot using the sensory data;

directing the second robot to move so as to maintain a relative position and orientation of the robot with respect to the tracked person in the second environment; and

controlling the movement of the robot so as to avoid obstacles using the sensory data.

9. An article of manufacture comprising:

a computer storage medium;

computer program instructions stored on the computer storage medium which, when processed by a processing device, instruct the processing device to perform a process comprising;

receiving sensory data into memory from a robot;

tracking objects in an environment of the robot using the sensory data;

directing the robot to move so as to maintain a relative position and orientation of the robot with respect to one or more of the tracked objects;

controlling the movement of the robot so as to avoid obstacles using the sensory data;

10. The article of manufacture of claim 9, wherein the process performed further comprises:

enabling a user to select one or more of the tracked objects which the robot is directed to follow.

11. The article of manufacture of claim 10, wherein the process performed further comprises:

providing the user with a live video feed and indicating tracked objects in the live video feed.

12. The article of manufacture of claim 11, wherein if tracking of an object loses an object then the process further comprises:

attempting to reacquire tracking of the lost object.

13. The article of manufacture of claim 12, wherein attempting to reacquire tracking of the lost object comprises adjusting the position and orientation of the robot.

14. The article of manufacture of claim 9, wherein if tracking of an object loses an object then the process further comprises attempting to reacquire tracking of the lost object by adjusting the position and orientation of the robot.

15. A computing machine comprising:

an object recognition module having an input receiving sensory data from an environment of a robot and an output indicating objects recognized in the environment;

a track and follow module having an input indicating a selected object to be tracked and an output indicating a position and orientation for the robot to follow the selected object; and

a navigation module having an input receiving the position and orientation and an output to a motion control system of the robot directing the robot to move to the desired position and orientation along a path to avoid obstacles.

16. The computing machine of claim 15, wherein the track and follow module includes an object tracking module having an input that receives information about the recognized objects and an output indicating whether the selected object is within predetermined boundaries;

17. The computing machine of claim 16, wherein the track and follow module includes a position calculation module having an input for receiving the output indicating whether the selected object is within predetermined boundaries and an output providing a position and orientation for the robot in which the object is within the boundaries.

18. The computing machine of claim 17, wherein the track and follow module includes an object reacquisition module having an input receiving information about the recognized objects, and an output providing the desired position and orientation to move the robot to attempt to reacquire the selected object.

19. The computing machine of claim 18, further comprising a user interface providing a user with information about the recognized objects and having a mechanism allowing a user to select one of the recognized objects.

20. The computing machine of claim 19, wherein the user interface includes a live video feed and indication of objects recognized in the live video feed.