INTELLIGENT USER INTERFACE APPARATUS AND CONTROL METHOD FOR CONTROL OF SERVICE ROBOTS

• US 20110071674A1
• Filed: 09/16/2010
• Published: 03/24/2011
• Est. Priority Date: 09/18/2009
• Status: Active Grant

• Current Assignee: Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University)
• Original Assignee: Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University)
• Inventors: Jung, Soon Mook, Kim, Myung Jin, Jung, Hyun Uk, JEON, Jae Wook, Song, Tae Houn
• Granted Patent: US 8,666,545 B2
• Time in Patent Office: Days
• US Class Current: 700/246
• CPC Class Codes: B25J 13/00 Controls for manipulators programme controls B25J9/16; control in general G05
• CPC Class Codes: B25J 13/003 by means of an audio-responsive input audible safety signals B25J19/061

Abstract

Disclosed herein is a user interface apparatus and control method for the control of service robots. The user interface apparatus for the control of service robots includes an interaction server, an index block, and a robot control server. The interaction server receives control commands to control a service robot from a user, analyzes the control commands, and outputs the results of the analysis to the user. The index block determines the degree of difficulty of each of the analyzed control commands. The robot control server determines the operating mode of the service robot depending on the analyzed control command and the degree of difficulty, and controls the service robot in the determined operating mode.

Claims

1. A user interface apparatus for control of service robots, comprising:

an interaction server for receiving control commands to control a service robot from a user, analyzing the control commands, and outputting results of the analysis to the user;

an index block for determining a degree of difficulty of each of the analyzed control commands; and

a robot control server for determining operating mode of the service robot depending on the analyzed control command and the degree of difficulty, and controlling the service robot in the determined operating mode.

2. The user interface apparatus as set forth in claim 1, wherein the interaction server comprises:

a user command analysis unit for analyzing the control command received from the user; and

a command performance result output unit for outputting results of performance of the received control command and a degree of satisfaction with the performance of the control command.

3. The user interface apparatus as set forth in claim 2, wherein the user command analysis unit comprises:

a voice analysis module for analyzing the control command requested by the user based on a voice received from the user;

a facial expression analysis module for analyzing the control command requested by the user based on a facial expression or gesture received from the user in a form of an image; and

a keyword analysis module for analyzing the control command requested by the user based on a character string received from the user.

4. The user interface apparatus as set forth in claim 2, wherein the command performance result output unit comprises:

a work area output module for receiving and outputting data about a work area where the service robot has conducted a service; and

a work time output module for receiving and outputting work time for which the service robot has conducted the service.

5. The user interface apparatus as set forth in claim 1, wherein the robot control server comprises:

an operation control unit for selecting one operating mode from among tele-operating mode in which the service robot receives the control commands directly from the user and is controlled in compliance with the control commands, shared control mode in which the user and the service robot collaborate with each other on work, and full autonomy mode in which the service robot conducts work using a stored program, depending on the degree of difficulty of the control command determined by the index block, and controlling the service robot in the selected operating mode; and

a robot control result feedback unit for monitoring status of the service robot.

6. The user interface apparatus as set forth in claim 1, wherein the index block comprises a degree-of-user satisfaction calculation module for receiving service time and a service area from the service robot and calculating a degree of satisfaction of the control command, requested by the user, by applying the service time and service area to an artificial intelligence algorithm.

7. The user interface apparatus as set forth in claim 1, wherein the index block comprises a degree-of-difficulty determination module for determining the degree of difficulty of the control command, requested by the user, by applying service time and a service area, required for performance of the control command input from the user, to an artificial intelligence algorithm.

8. The user interface apparatus as set forth in claim 1, wherein:

the index block comprises a degree-of-difficulty re-evaluation module for determining the degree of difficulty of the control command, requested by the user, by applying a difference between a degree of current user satisfaction calculated using data acquired from the service robot currently at work and a degree of user satisfaction to an artificial intelligence algorithm; and

the robot control server re-determines the operating mode of the service robot according to the re-determined degree of difficulty, and controls the service robot.

9. A user interface control method for control of service robots, comprising;

receiving control commands to control a service robot from a user, analyzing the control commands, and determining a degree of difficulty of each of the analyzed control commands;

determining operating mode of the service robot according to the analyzed control command and the degree of difficulty, and controlling the service robot in the operating mode so that the service robot conducts the control command; and

monitoring results of performance of the control command conducted by the service robot, calculating a degree of satisfaction with the performance of the control command using the results of the performance of the control command, and outputting the degree of satisfaction.

10. The user interface control method as set forth in claim 9, wherein the analyzing the control commands comprises analyzing the control command of the user by analyzing at least one of a voice received from the user, a facial expression and a gesture received from the user in a form of an image, and a character string received from the user.

11. The user interface control method as set forth in claim 9, wherein the outputting the degree of satisfaction comprises additionally outputting data about a work area where the service robot has conducted a service and data about work time for which the service robot has conducted the service.

12. The user interface control method as set forth in claim 9, wherein the determining operating mode of the service robot according to the analyzed control command and the degree of difficulty comprises selecting one operating mode from among tele-operating mode in which the service robot receives the control commands directly from the user and is controlled in compliance with the control commands, shared control mode in which the user and the service robot collaborate with each other on work, and full autonomy mode in which the service robot conducts work using a stored program, depending on the determined degree of difficulty of the control command.

13. The user interface control method as set forth in claim 9, wherein the calculating a degree of satisfaction with the performance of the control command using the results of the performance of the control command comprises receiving service time and a service area from the service robot and calculating the degree of satisfaction of the control command, requested by the user, by applying the service time and service area to an artificial intelligence algorithm.

14. The user interface control method as set forth in claim 9, wherein the determining a degree of difficulty of each of the analyzed control commands comprises determining the degree of difficulty of the control command, requested by the user, by applying service time and a service area, required for performance of the control command input from the user, to an artificial intelligence algorithm.

15. The user interface control method as set forth in claim 9, further comprising:

determining the degree of difficulty of the control command, requested by the user, by applying a difference between a degree of current user satisfaction calculated using data acquired from the service robot currently at work and a degree of user satisfaction to an artificial intelligence algorithm; and

re-determining the operating mode of the service robot according to the re-determined degree of difficulty, and controlling the service robot.