ROBOT SYSTEM AND METHOD AND COMPUTER-READABLE MEDIUM CONTROLLING THE SAME

• US 20110118877A1
• Filed: 11/17/2010
• Published: 05/19/2011
• Est. Priority Date: 11/19/2009
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: HWANG, Won Jun, HAN, Woo Sup
• Application Number:
  US12/948,367
• Publication Number:
  US 20110118877A1
• Time in Patent Office: Days
• US Class Current: 700/264
• CPC Class Codes: B25J 13/00 Controls for manipulators programme controls B25J9/16; control in general G05
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A robot system rapidly performs a motion based on a gesture recognized from a user and achieves a smooth interface with the user. The system receives a gesture input by a user, and sets a position of a first gesture as a reference position, if the gesture input by the user is recognized as the first gesture. The system also judges a moving direction of a second gesture from the reference position if the gesture input by the user is recognized as the second gesture. The system recognizes a command instructing a robot to perform a motion corresponding to the judged moving direction.

Claims

1. A robot system, comprising:

a user terminal to receive gestures input by a user;

a server to recognize a first gesture, a position of which is set as a reference position, and a second gesture indicating movement of the robot, and to recognize a command corresponding to a moving direction of the second gesture from the reference position; and

the robot to execute a motion corresponding to the command.

2. The robot system according to claim 1, wherein:

the first gesture and the second gesture of one hand of the user indicate a moving direction of the robot; and

the first gesture and the second gesture of the other hand of the user indicate a view change of the robot.

3. The robot system according to claim 2, wherein the server judges a distance from the reference position to a position at which the second gesture of the one hand is made, and controls a moving velocity of the robot based on the judged distance.

4. The robot system according to claim 2, wherein the server judges a distance from the reference position to a position at which the second gesture of the other hand is made, and controls a view changing velocity of the robot based on the judged distance.

5. The robot system according to claim 2, wherein the server changes zoom magnification of a view of the robot corresponding to the moving direction of the second gesture from the reference position.

6. The robot system according to claim 1, wherein:

the robot captures an image of a vicinity of the robot;

the user terminal displays the image of the vicinity of the robot; and

the user instructs the robot to perform the movement based on the image of the vicinity of the robot.

7. The robot system according to claim 1, wherein, when the first gesture is re-recognized, the server resets a position at which the re-recognized first gesture is made as the reference position.

19. The robot system of claim 6, wherein the image includes a plurality of humans and an image of a selected prior user of the robot system is transmitted to the server based on a priority order of registered users of the robot system if it is determined by facial recognition that at least two of the humans are the registered users of the robot system.

20. The robot system of claim 1, further comprising

a second control unit to recognize the reference position and to calculate a relative direction and a relative distance from the reference position at which the second gesture is made to determine the moving direction, a view changing direction, a moving velocity, and a view changing velocity based on the relative direction and relative distance.

21. The robot system of claim 1, further comprising

a third control unit including a leg driving unit, a head driving unit, and a hand driving unit to execute the motion corresponding to the command.

8. A method of controlling a robot system, comprising:

receiving a gesture input by a user;

setting, by a computer, a position of a first gesture as a reference position if the gesture input by the user is recognized as the first gesture

judging, by the computer, a moving direction of a second gesture from the reference position if the gesture input by the user is recognized as the second gesture; and

recognizing, by the computer, a command and instructing a robot to perform a motion corresponding to the judged moving direction.

9. The method according to claim 8, further comprising:

transmitting the command instructing the robot to perform the motion to the robot; and

controlling the motion of the robot based on the command.

10. The method according to claim 8, further comprising:

capturing and outputting an image of a vicinity of the robot by the robot; and

inputting the gesture based on the image of the vicinity of the robot.

11. The method according to claim 8, wherein the first gesture and the second gesture include:

the first gesture and the second gesture of one hand of the user to indicate a moving direction of the robot; and

the first gesture and the second gesture of the other hand of the user to indicate a view change of the robot.

12. The method according to claim 11, further comprising:

judging a distance from the reference position to a position at which the second gesture of the one hand is made; and

controlling a moving velocity of the robot based on the judged distance.

13. The method according to claim 11, further comprising:

judging a distance from the reference position to a position at which the second gesture of the other hand is made; and

controlling a view changing velocity of the robot based on the judged distance.

14. The method according to claim 11, wherein the indication of the view change of the robot includes indicating change of zoom magnification of a view of the robot corresponding to the moving direction of the second gesture from the reference position.

15. The method according to claim 8, further comprising, resetting a position at which the re-recognized first gesture is made as the reference position when the first gesture is re-recognized.

16. The method according to claim 8, wherein the input of the gesture includes judging whether the user is extracted.

17. At least one non-transitory computer readable medium comprising computer readable instructions that control at least one processor to implement a method, comprising:

receiving a gesture input by a user;

setting a position of a first gesture as a reference position if the gesture input by the user is recognized as the first gesture;

judging a moving direction of a second gesture from the reference position if the gesture input by the user is recognized as the second gesture; and

recognizing a command and instructing a robot to perform a motion corresponding to the judged moving direction.

18. A method, comprising:

receiving, by a robot, images of a first and second gesture provided by a user;

setting, by a computer, a first reference position at which the first gesture is made by a hand of the user relative to a torso of the user;

calculating, by the computer, a relative direction and a relative distance from the first reference position, to a second position of the second gesture made by the hand of the user; and

initiating movement of the robot, by the computer, at a velocity corresponding to the relative distance and the relative direction.