System and method for reinforcing programming education through robotic feedback

• US 9,718,185 B2
• Filed: 10/20/2016
• Issued: 08/01/2017
• Est. Priority Date: 06/12/2014
• Status: Active Grant

• Current Assignee: Wonder Workshop, Inc.
• Original Assignee: Play-I, Inc.
• Inventors: Gupta, Saurabh, Gupta, Vikas
• Primary Examiner(s): Amin, Bhavesh V
• Application Number:
  US15/299,292
• Publication Number:
  US 20170036344A1
• Time in Patent Office: 285 Days
• CPC Class Codes: A63H 11/00 Self-movable toy figures
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/28 Arrangements of sound-producing means in dolls; Means in dolls for producing sounds
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: B25J 11/001 with emotions simulating means
• CPC Class Codes: B25J 13/06 Control stands, e.g. consoles, switchboards
• CPC Class Codes: B25J 9/0081 with master teach-in means
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G09B 19/0053 Computers, e.g. programming
• CPC Class Codes: Y10S 901/04 Manual lead through

Abstract

A method for toy robot programming, the toy robot including a set of sensors, the method including, at a user device remote from the toy robot: receiving sensor measurements from the toy robot during physical robot manipulation; in response to detecting a programming trigger event, automatically converting the sensor measurements into a series of puppeted programming inputs; and displaying graphical representations of the set of puppeted programming inputs on a programming interface application on the user device.

Claims

1. A method for reinforcing programming education through toy robot feedback, the method comprising:

at a user device, remote from the toy robot;

receiving a series of programming inputs from a user at a programming interface application on the user device;

automatically generating a set of control instructions for the toy robot based on a programming input of the series; and

sending the set of control instructions to the toy robot;

at the toy robot;

retrieving a robot personality;

prior to receiving the set of control instructions from the user device, automatically controlling the toy robot based on the robot personality, independent of a connection between the user device and the toy robot;

receiving the set of control instructions from the user device; and

in response to receiving the set of control instructions, operating the toy robot based on the set of control instructions and the robot personality.

2. The method of claim 1, further comprising:

recording, at the toy robot, a set of sensor measurements; and

transmitting the set of sensor measurements from the toy robot to the user device, wherein automatically generating the set of control instructions at the user device comprises automatically generating the set of control instructions based on the programming input of the series and the set of sensor measurements.

3. The method of claim 1, further comprising:

recording, at the toy robot, a set of sensor measurements while automatically controlling the toy robot;

identifying an inconsistency between the set of sensor measurements and a requirement for automatically controlling the toy robot based on the robot personality, independent of the connection between the user device and the toy robot;

in response to identification of the inconsistency, determining a secondary set of personality control instructions based on the set of sensor measurements and the robot personality; and

automatically controlling the toy robot based on the secondary set of personality control instructions, independent of the connection between the user device and the toy robot.

4. The method of claim 1, wherein operating the toy robot comprises operating the toy robot within a threshold time period after receiving the set of control instructions.

5. The method of claim 1, further comprising, at the user device:

presenting, to the user, a set of robot personality identifiers, each representative of a different robot personality;

receiving a user selection of a selected robot personality identifier from the set of robot personality identifiers; and

sending a robot personality identified by the selected robot personality identifier to the toy robot, wherein the selected robot personality is the robot personality retrieved at the toy robot.

6. The method of claim 1, further comprising, at the user device:

storing a historical set of programming inputs from the user;

automatically determining the robot personality based on the historical set of programming inputs; and

sending the robot personality to the toy robot.

7. The method of claim 6, wherein automatically determining the robot personality comprises:

identifying a pattern of programming inputs from the history of programming inputs; and

in response to the pattern of programming inputs substantially matching a predetermined pattern of programming inputs, selecting the robot personality associated with the predetermined pattern of programming inputs.

8. The method of claim 1, wherein the robot personality defines an action response to an event trigger, and wherein automatically controlling the toy robot comprises, in response to detecting the event trigger, automatically controlling the toy robot to perform the action response.

9. The method of claim 8, wherein detecting the event trigger comprises detecting motion, wherein performing the action response comprises play a predetermined audio output, and wherein automatically controlling the toy robot comprises, in response to detecting motion at a motion sensor of the toy robot, automatically controlling the toy robot to play the predetermined audio output.

10. The method of claim 1, wherein the set of control instructions specifies robot output for a first subset of a set of robot output types, wherein the robot personality specifies the robot output for a second subset of the set of robot output types, and wherein the set of robot output types comprises robot movement, robot audio output, and robot visual output.

11. The method of claim 10, wherein the first and the second subsets of robot output types are non-overlapping.

12. The method of claim 10, wherein the first and the second subsets of robot output types share an overlapping robot output type, the method further comprising:

identifying higher priority control instructions by comparing a priority of the set of control instructions to a priority of the robot personality with respect to the overlapping robot output type, wherein operating the toy robot comprises specifying the robot output for the overlapping robot output type based on the higher priority control instructions.

13. The method of claim 1, wherein operating the toy robot comprises:

modifying the set of control instructions based on the robot personality; and

operating the toy robot based on the modified set of control instructions.

14. The method of claim 1, further comprising updating the robot personality to specify operation of a toy robot accessory mounted to the toy robot, wherein automatically controlling the toy robot comprises automatically controlling the toy robot accessory based on the robot personality, independent of the connection between the user device and the toy robot, and wherein operating the toy robot comprises operating the toy robot accessory based on the robot personality.

15. A method for reinforcing programming education through toy robot feedback, the toy robot including a set of sensors, the method comprising:

storing a robot personality at the toy robot;

at a user device, remote from the toy robot;

receiving a series of programming inputs from a user at a programming interface application on the user device;

receiving a first set of sensor measurements from the toy robot; and

automatically generating a first set of control instructions for the toy robot based on a programming input of the series and the first set of sensor measurements;

modifying the first set of control instructions based on the robot personality; and

operating the toy robot based on the modified first set of control instructions.

16. The method of claim 15, wherein operating the toy robot based on the modified first set of control instructions is performed within a threshold time period after modifying the first set of control instructions, and wherein operating the toy robot based on the modified second set of control instructions is performed within the threshold time period after modifying the second set of control instructions.

17. The method of claim 15, further comprising:

receiving a second set of sensor measurements during operation of the toy robot;

identifying an inconsistency between the second set of sensor measurements and a requirement for a second set of control instructions, wherein the second set of control instructions is generated based on a succeeding programming input of the series;

in response to identification of the inconsistency;

determining a secondary programming input based on the second set of sensor measurements;

automatically generating a secondary set of control instructions based on the secondary programming input;

modifying the secondary set of control instructions based on the robot personality; and

operating the toy robot based on the modified secondary set of control instructions.

18. The method of claim 15, further comprising:

at the user device;

storing a historical set of programming inputs associated with the toy robot, the history of programming inputs comprising the series of programming inputs;

identifying a pattern of conditional control instructions from the history of programming components; and

automatically generating a third set of control instructions for the toy robot based on a subsequent programming input received from the user at the programming interface application on the user device;

modifying the third set of control instructions based on the pattern of conditional control instructions and the robot personality; and

operating the toy robot based on the modified third set of control instructions.

19. The method of claim 15, further comprising, at the toy robot:

receiving the robot personality from the user device, wherein modifying the first set of control instructions and modifying the second set of control instructions are each performed at the toy robot.

20. The method of claim 15, wherein modifying the second set of control instructions comprises modifying robot audio output instructions based on the robot personality;

and wherein operating the toy robot comprises outputting the robot audio output based on the modified robot audio output instructions.