APPARATUS AND METHODS FOR REMOTELY CONTROLLING ROBOTIC DEVICES

• US 20150283703A1
• Filed: 04/03/2014
• Published: 10/08/2015
• Est. Priority Date: 04/03/2014
• Status: Abandoned Application

• Current Assignee: Brain Corporation
• Original Assignee: Brain Corporation
• Inventors: Izhikevich, Eugene M., Laurent, Patryk, Petre, Csaba
• Application Number:
  US14/244,890
• Publication Number:
  US 20150283703A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B25J 9/163 learning, adaptive, model based, rule based expert control
• CPC Class Codes: G05B 13/00 Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion G05B19/00 takes precedence
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/008 based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
• CPC Class Codes: Y10S 901/47 Optical

Abstract

Robotic devices may be operated by users remotely. A learning controller apparatus may detect remote transmissions comprising user control instructions. The learning apparatus may receive sensory input conveying information about robot'"'"'s state and environment (context). The learning apparatus may monitor one or more wavelength (infrared light, radio channel) and detect transmissions from user remote control device to the robot during its operation by the user. The learning apparatus may be configured to develop associations between the detected user remote control instructions and actions of the robot for given context. When a given sensory context occurs, the learning controller may automatically provide control instructions to the robot that may be associates with the given context. The provision of control instructions to the robot by the learning controller may obviate the need for user remote control of the robot thereby enabling autonomous operation by the robot.

Claims

1. A non-transitory computer-readable storage medium having instructions embodied thereon, the instructions being executable by a processor to perform a method for operating a device, the method comprising:

effectuating transmission of a first command configured to cause a movement of the device;

storing a user command in a memory, the user command being received during the movement of the device; and

determining an association between the user command and the first command so as to cause a transmission of the first command responsive to the user command being received subsequent to the determination of the association.

2. The storage medium of claim 1, wherein the method further comprises pairing individual ones of a plurality of transmitted commands with respective ones of a plurality of user commands during a training stage.

3. The storage medium of claim 1, wherein the association is configured to enable remote control of the device by converting user commands to the transmitted first command.

4. The storage medium of claim 3, wherein the method further comprises effectuating storing in a memory information associated with a sequence of user commands and transmission of the corresponding sequence of transmitted commands to cause the device to execute a sequence of movements.

5. The storage medium of claim 4, wherein the method further comprises pairing a macro command with the sequence of commands.

6. The storage medium of claim 5, wherein the method further comprises facilitating launching of the sequence by providing the macro command.

7. The storage medium of claim 1, wherein the method further comprises effectuating storing in memory a first context responsive to receipt of the user command.

8. The storage medium of claim 7, wherein the transmission of the first command is responsive to an observation of another context similar to the first context.

9. The storage medium of claim 8, wherein the method further comprises facilitating launching of the sequence by providing the macro command.

10. The storage medium of claim 1, wherein receipt of the user command includes receipt of a wireless transmission from a remote controller.

11. The storage medium of claim 1, wherein the user command comprises one or both of a voice command or a gesture command.

12. The storage medium of claim 1, wherein receipt of the user command includes receipt of an output of a camera.

13. The storage medium of claim 1, wherein receipt of the user command includes receipt of information related to the movement of the device provided by a motion sensor component.

14. The storage medium of claim 1, wherein:

the method further comprises performing a learning process; and

the association between the user command and the first command is determined based on the learning process.

15. The storage medium of claim 14, wherein the learning process comprises a supervised learning process.

16. The storage medium of claim 14, wherein:

the learning process includes a first mode and second mode; and

the association is effectuated responsive to the learning process being in the first mode but not the second mode.

17. The storage medium of claim 14, wherein a transition of the learning process between the first mode and the second mode is responsive to an indication provided by the user via a user interface component.

18. An apparatus configured for remotely controlling a first robotic device and a second robotic device, the apparatus comprising:

a transceiver apparatus comprising a receiver and a transmitter;

a sensor interface; and

one or more physical processors communicatively coupled with the transceiver apparatus and the sensor interface, the one or more physical processors being configured to execute computer program instructions to cause the one or more physical processors to;

detect a first context based on sensor input received via the sensor interface;

determine a first association between a first context and a first command configured to cause the first robotic device to execute a task, the first command being received by the receiver; and

determine a second control command based on a second association and the first context, the second control command being configured to cause the second robotic device to execute the task;

wherein the second association is determined responsive to a receipt of the second command and a second context occurring prior to occurrence of the first command.

19. The apparatus of claim 18, wherein:

the first command is provided via a wireless communication from a remote controller; and

the second context comprises the first context.

20. The apparatus of claim 18, wherein:

the first command is provided via a first wireless communication link from a remote controller; and

the second command is provided to the second robotic device via a second wireless communication link, the second wireless link being different from the first wireless link based on one or more of frequency, code, and duration.