APPARATUS FOR TRAINING RECOGNITION CAPABILITY USING ROBOT AND METHOD FOR SAME

• US 20140258192A1
• Filed: 08/17/2012
• Published: 09/11/2014
• Est. Priority Date: 10/12/2011
• Status: Abandoned Application

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: Kim, Mun Sang, Choi, Mun Taek, Yun, Sang Seok, Baek, Kyoung Keun, Lee, Seong Whan
• Application Number:
  US14/350,760
• Publication Number:
  US 20140258192A1
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: B25J 9/163 learning, adaptive, model based, rule based expert control
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: Y10S 901/50 Miscellaneous

Abstract

Disclosed is an apparatus for training a recognition capability by using a robot and to a method for same. Disclosed is the apparatus for training the recognition capability, according to one embodiment of the present invention, comprising: an instruction generation portion for transmitting to the robot a series of robot instructions for controlling the behavior of the robot; a sensor portion for collecting sensor information including a 3D position information and color information of a trainee; a trainee behavioral information generation portion for generating behavioral information of the trainee, based on the sensor information that is collected; and a recognition capability determination portion for outputting the recognition capability of the trainee, based on the robot instructions and the behavioral information of the trainee.

Claims

1. An apparatus for training recognition ability, comprising:

an instruction generating unit for generating a series of robot instruction information to instruct a behavior of a robot or a series of trainee instruction information to instruct a behavior of a trainee;

a sensor unit for collecting three-dimensional location information of the trainee who imitates the behavior of the robot according to the robot instruction information or acts according to the trainee instruction information, and sensor information comprising color information or mobile device usage information of the trainee;

a trainee behavior information generating unit for generating trainee behavior information based on the sensor information collected by the sensor unit; and

a recognition ability determining unit for calculating recognition ability of the trainee based on the trainee behavior information along with the robot instruction information or the trainee instruction information.

2. The apparatus for training recognition ability according to claim 1, further comprising:

a first communication unit capable of communicating with an arbitrary object external to the apparatus for training recognition ability;

a display unit for providing visual information to the trainee; and

a voice unit for providing voice information to the trainee,

wherein the series of robot instruction information is transmitted to the robot through the first communication unit, and the trainee instruction information is delivered to the trainee through the display unit or the voice unit.

3. The apparatus for training recognition ability according to claim 1,

wherein the mobile device usage information is generated from at least one of a touch sensor, an acceleration sensor, a magnetic sensor and a rotation sensor in the mobile device, and

wherein when the trainee instruction information is an instruction for operating the robot by using the mobile device, the instruction generating unit generates a series of robot instruction information again.

4. The apparatus for training recognition ability according to claim 1,

wherein when it is determined that the robot instruction information or the trainee instruction information is identical to the trainee behavior information within a predetermined range, the instruction generating unit generates robot instruction information for controlling the behavior of the robot again so that the robot performs a feedback behavior or feedback information is provided to the trainee through the display unit or the voice unit.

5. The apparatus for training recognition ability according to claim 2,

wherein the voice information guides a time limit for the trainee to imitate the robot instruction information or act according to the trainee instruction information, the time limit being adjustable.

6. The apparatus for training recognition ability according to claim 1,

wherein the instruction generating unit generates the series of robot instruction information or trainee instruction information based on trainee information, and

wherein the trainee information comprises face color information, gender information and age information of the trainee, and usage information of the apparatus for training recognition ability.

7. The apparatus for training recognition ability according to claim 1, wherein the instruction generating unit comprises:

a movement instruction generating unit for generating movement instruction to change a location of the robot; and

a gesture instruction generating unit for generating a gesture instruction to change a motion of the robot.

8. The apparatus for training recognition ability according to claim 1, wherein the sensor unit comprises:

a location sensor unit for collecting three-dimensional location information of the trainee;

a red-green-blue (RGB) sensor unit for collecting color information of the trainee; and

a mobile device sensor unit for collecting mobile device usage information of the trainee.

9. The apparatus for training recognition ability according to claim 6, further comprising a trainee information managing unit for determining whether the trainee is already registered by using the collected color information of the trainee and registering the trainee information.

10. The apparatus for training recognition ability according to claim 8,

wherein the trainee information managing unit comprises:

a trainee face searching unit for searching corresponding trainee information from pre-stored trainee information based on face color information among the collected color information of the trainee; and

a trainee information registering unit for registering trainee information comprising the face color information among the collected color information of the trainee, if a corresponding face is not searched by the trainee face searching unit.

11. The apparatus for training recognition ability according to claim 6,

wherein the trainee behavior information generating unit divides an available place of the trainee into a plurality of spaces, and generates the trainee behavior information by matching three-dimensional location information of the trainee with the plurality of spaces.

12. The apparatus for training recognition ability according to claim 6,

wherein the trainee behavior information generating unit generates the trainee behavior information by calculating a bending angle of a physical joint of the trainee based on the three-dimensional location information of the trainee.

13. A method for training recognition ability, comprising:

generating a series of robot instruction information to instruct a behavior of a robot or a series of trainee instruction information to instruct a behavior of a trainee;

collecting three-dimensional location information of the trainee who imitates the behavior of the robot according to the robot instruction information or acts according to the trainee instruction information, and sensor information comprising color information or mobile device usage information of the trainee;

generating trainee behavior information based on the sensor information collected by the sensor unit; and

calculating recognition ability of the trainee based on the trainee behavior information along with the robot instruction information or the trainee instruction information.

14. The method for training recognition ability according to claim 13, wherein said generating a series of robot instruction information or a series of trainee instruction information further comprises:

transmitting the series of robot instruction information to the robot; and

delivering the trainee instruction information to the trainee as visual information through a display unit or voice information through a voice unit.

15. The method for training recognition ability according to claim 13, wherein said generating a series of robot instruction information or a series of trainee instruction information further comprises:

generating a series of robot instruction information again when the trainee instruction information is an instruction for operating the robot by using the mobile device.

16. The method for training recognition ability according to claim 13,

wherein, in said calculating of recognition ability of the trainee based on the trainee behavior information along with the robot instruction information or the trainee instruction information, when it is determined that the robot instruction information or the trainee instruction information is identical to the trainee behavior information within a predetermined range, robot instruction information for controlling the behavior of the robot is generated again so that the robot performs a feedback behavior or feedback information is provided to the trainee through the display unit or the voice unit.

17. The method for training recognition ability according to claim 14,

wherein the voice information guides a time limit for the trainee to imitate the robot instruction information or act according to the trainee instruction information, the time limit being adjustable.

18. The method for training recognition ability according to claim 13,

wherein said generating of a series of robot instruction information or a series of trainee instruction information further comprises generating the series of robot instruction information or trainee instruction information based on trainee information, and

wherein the trainee information comprises face color information, gender information and age information of the trainee, and usage information of the apparatus for training recognition ability.

19. The method for training recognition ability according to claim 13, wherein said generating of a series of robot instruction information or a series of trainee instruction information further comprises:

generating movement instruction to change a location of the robot; and

generating a gesture instruction to change a motion of the robot.

20. The method for training recognition ability according to claim 18, wherein said generating of a series of robot instruction information or a series of trainee instruction information further comprises:

determining whether the trainee is already registered by using the collected color information of the trainee; and

registering the trainee information.

21. The method for training recognition ability according to claim 13, wherein said generating of trainee behavior information based on the sensor information collected by the sensor unit further comprises:

dividing an available place of the trainee into a plurality of spaces; and

generating the trainee behavior information by matching three-dimensional location information of the trainee with the plurality of spaces.

22. The method for training recognition ability according to claim 13, wherein said generating of trainee behavior information based on the sensor information collected by the sensor unit further comprises:

calculating a bending angle of a physical joint of the trainee based on the three-dimensional location information of the trainee.

23. A system for training recognition ability, comprising:

an apparatus for training recognition ability comprising an instruction generating unit for generating a series of robot instruction information to instruct a behavior of a robot or a series of trainee instruction information to instruct a behavior of a trainee, a sensor unit for collecting three-dimensional location information of the trainee who imitates the behavior of the robot according to the robot instruction information or acts according to the trainee instruction information, and sensor information comprising color information or mobile device usage information of the trainee, a trainee behavior information generating unit for generating trainee behavior information based on the sensor information collected by the sensor unit, and a recognition ability determining unit for calculating recognition ability of the trainee based on the trainee behavior information along with the robot instruction information or the trainee instruction information;

a robot communicating with the apparatus for training recognition ability to operate according to the series of robot instruction information; and

a mobile device used by the trainee and to which information is input according to the trainee instruction information.