Apparatus and methods for removal of learned behaviors in robots
First Claim
1. A method of operating a learning process for a computerized apparatus, the method comprising:
- operating the learning process to determine a plurality of respective associations between a plurality of commands and a plurality of contexts;
storing the plurality of associations, one or more of the plurality of associations being configured to enable provision of one or more of the plurality of commands based on an occurrence of one or more of the plurality of contexts;
determining the one or more of the plurality of contexts via one or more sensory inputs;
determining a first user indication corresponding to the one or more sensory inputs;
when a given association between the one or more of the plurality of commands and the one or more of the plurality of contexts occurs, executing one or more tasks corresponding to the one or more of the plurality of commands;
responsive to a second user indication, updating the one or more of the plurality of associations, the updating the one or more of the plurality of associations being configured to reduce a probability of the provision of at least one of the plurality of commands based on another occurrence of the one or more of the plurality of contexts subsequent to the updating the one or more of the plurality of associations, the second user indication comprising an unlearn indication; and
when the unlearn indication is present, inhibiting execution of at least one of the one or more tasks.
2 Assignments
0 Petitions
Accused Products
Abstract
Computerized appliances may be operated by users remotely. In one implementation, a learning controller apparatus may be operated to determine association between a user indication and an action by the appliance. The user indications, e.g., gestures, posture changes, audio signals may trigger an event associated with the controller. The event may be linked to a plurality of instructions configured to communicate a command to the appliance. The learning apparatus may receive sensory input conveying information about robot'"'"'s state and environment (context). The sensory input may be used to determine the user indications. During operation, upon determine the indication using sensory input, the controller may cause execution of the respective instructions in order to trigger action by the appliance. Device animation methodology may enable users to operate computerized appliances using gestures, voice commands, posture changes, and/or other customized control elements.
-
Citations
19 Claims
-
1. A method of operating a learning process for a computerized apparatus, the method comprising:
-
operating the learning process to determine a plurality of respective associations between a plurality of commands and a plurality of contexts; storing the plurality of associations, one or more of the plurality of associations being configured to enable provision of one or more of the plurality of commands based on an occurrence of one or more of the plurality of contexts; determining the one or more of the plurality of contexts via one or more sensory inputs; determining a first user indication corresponding to the one or more sensory inputs; when a given association between the one or more of the plurality of commands and the one or more of the plurality of contexts occurs, executing one or more tasks corresponding to the one or more of the plurality of commands; responsive to a second user indication, updating the one or more of the plurality of associations, the updating the one or more of the plurality of associations being configured to reduce a probability of the provision of at least one of the plurality of commands based on another occurrence of the one or more of the plurality of contexts subsequent to the updating the one or more of the plurality of associations, the second user indication comprising an unlearn indication; and when the unlearn indication is present, inhibiting execution of at least one of the one or more tasks. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A home automation apparatus, comprising:
-
a camera component configured to provide a sequence of frames to a learning process; a user interface device configured to receive an event indication and an undo indication from a user; a communications apparatus configured to provide a command to a remote device; and a processing component configured to operate the learning process and to detect an action of a user based on an analysis of the sequence of frames; wherein the processing component is configured to; based on the detection of the action of the user and the event indication and in an absence of a contemporaneous undo indication, update a configuration of the learning process to increase a probability of the command being communicated to the remote device based on a subsequent detection of the action of the user; and based on the detection of the action of the user and the event indication and the contemporaneous undo indication, update the configuration of the learning process to decrease the probability of the command being communicated to the remote device based on the subsequent detection of the action of the user.
-
-
15. A home automation apparatus, comprising:
-
a sensor component configured to provide a sensory input to a learning process; a user interface configured to receive a plurality of action indications and an undo indication from a user; a communications apparatus configured to provide a command of a plurality of commands to a remote device; and a processing component configured to operate the learning process and to determine one or more context instances in the sensory input; wherein; the learning process is operable to determine an association between a given context and a given action of the plurality of actions, the given action having a respective command of the plurality of commands associated therewith; and the processing component is configured to, based on detection of the undo indication, update a configuration of the learning process to prevent transmission of at least one command of the plurality of commands during an interval subsequent to receipt of the undo indication and in the given context corresponding to the respective command. - View Dependent Claims (16, 17)
-
-
18. A method of removing learned behavior of a robotic apparatus, the method comprising:
-
determining a context in a sensory input, the context having one or more actions executable by the apparatus associated therewith based on a previously learned first association; based on an occurrence of the context, causing the apparatus to execute the at least one of the one or more actions based on at least one control command transmitted to the apparatus; determining an occurrence of an idle indication; based on the occurrence of the idle indication, producing a second association between the context and a null action; and based on the second association between the context and the null action, preventing transmission of at least one of the at least one control command to the apparatus; wherein; the previously learned first association is configured to trigger the transmission of the at least of the at least one control command to the apparatus; and the learned behavior comprises an execution of the one or more actions by the apparatus based on the occurrence of the context. - View Dependent Claims (19)
-
Specification