Adaptive system for real-time behavioral coaching and command intermediation

• US 9,824,606 B2
• Filed: 08/28/2009
• Issued: 11/21/2017
• Est. Priority Date: 08/28/2009
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara H., Grabarnik, Genady, Kanevsky, Dimitri, Rish, Irina
• Primary Examiner(s): Saint-Vil, Eddy
• Application Number:
  US12/549,852
• Publication Number:
  US 20110053129A1
• Time in Patent Office: 3,007 Days
• Field of Search: 434238, 434236, 434350, 700245, 700249, 700248
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26

Abstract

A method, information processing system, and computer readable article of manufacture reinforce behavior in an individual. A behavior associated with an individual is monitored. A determination is made, based on the monitoring, that the behavior substantially matches a behavior in a set of behaviors. A set of interactive actions associated with the behavior are identified. At least one of the interactive actions in the set of interactive actions is selected. The at least one of the interactive actions that has been selected is performed. A response from the individual is monitored in response to the least one of the interactive actions being performed. An indicator is associated with the at least one of the interactive actions based on the reaction from the individual. The indicator indicates a relative degree of success in obtaining a desired response from the individual.

Claims

1. A computer implemented method with an interactive electronic device for reinforcing behavior of a child, the computer implemented method comprising:

associating a first interactive electronic device in a group of interactive electronic devices with at least a second interactive electronic device in the group of interactive electronic devices, when none of the first interactive electronic device and the at least a second interactive electronic device is selected to be the only interactive electronic device to select appropriate action to be collectively performed by the group of interactive electronic devices, any of the first interactive electronic device and the at least a second interactive electronic device can select appropriate action to be collectively performed by the group of interactive electronic devices; and

in response to the first interactive electronic device being the first in the group to perform all of the following;

capturing, by at least one of a visual sensor and an audio sensor of the first interactive electronic device, a behavior of a child, the behavior being an external physical behavior of a given type and a given action;

determining, based on the capturing, that the behavior substantially matches a behavior in a set of behaviors, wherein the behavior in the set of behaviors comprises a given type and a given action matching the given type and given action of the external physical behavior;

identifying, in response to the determining, a set of interactive actions associated with the behavior;

selecting, in response to the identifying, at least one of the interactive actions in the set of interactive actions, wherein the selecting comprises

identifying a value indicating a relative degree of success in obtaining a desired response from the child associated with each of the interactive actions in the set of interactive actions; and

selecting the at least one of the interactive actions in response to the at least one of the interactive actions having a highest value;

then the first interactive electronic device performing the at least one of the interactive actions that has been selected, the performing comprising notifying the at least the second interactive electronic device of the captured behavior and instructing the at least the second interactive electronic device to perform at least one interactive action with the first interactive electronic device collectively adapting their own group behavior based on the response from the child monitored by any of the interactive electronic devices in the group during the at least one interactive action as a group, wherein the at least one interactive action performed as a group between the first interactive electronic device and the at least the second interactive electronic device physically by mechanical movement demonstrates a particular behavior lesson for the child to learn a desired behavior to be performed by the child,

where the first interactive electronic device and the at least the second interactive electronic device interact with one another by performing a mechanical movement of the first interactive electronic device and the at least the second interactive electronic device, the mechanical movement providing visual action, audible action, or both, as feedback to the child;

monitoring a response from the child in response to the at least one of the interactive actions being performed;

associating an indicator with the at least one of the interactive actions based on the response from the child that has been monitored, wherein the indicator is associated with the at least one of the interactive actions separate from the response from the child, and wherein the indicator indicates a relative degree of success in obtaining a desired response from the child with the at least one of the interactive actions that was performed; and

dynamically adjusting, based on the indicator assigned to the at least one of the interactive actions, a subsequent selection of at least one interactive action in the set of interactive actions for a subsequent detection of the behavior.

2. The computer implemented method of claim 1, further comprising:

receiving, from a guardian of the child, a behavior to be monitored for; and

storing the behavior that has been received in the set of behaviors.

3. The computer implemented method of claim 1, wherein the selecting further comprises:

determining a current environmental context; and

selecting the at least one of the interactive actions based on the current environmental context that has been determined.

4. The computer implemented method of claim 1, wherein the selecting is based on at least one previous monitored response from the child made with respect to one or more of the set of interactive actions.

5. The computer implemented method of claim 1, wherein the at least one of the interactive actions comprises at least one of:

an audible action;

a visual action; and

a physical action.

6. The computer implemented method of claim 1, wherein monitoring the behavior further comprises at least one of:

receiving audio information associated with the behavior;

receiving visual information associated with the behavior; and

receiving tactile information associated with the behavior.

7. The computer implemented method of claim 1, wherein the dynamically adjusting further comprises:

determining if the relative degree of success associated with the indicator is above a given threshold; and

dynamically selecting, in response to the relative degree of success being below the given threshold, at least one other interactive action in the set of interactive actions for the subsequent selection.

8. The computer implemented method of claim 1, wherein the selecting further comprises:

selecting the at least one of the interactive actions by a plurality of interactive devices, wherein the performing further comprises performing the at least one of the interactive action by the plurality of interactive devices.

9. An interactive electronic device for reinforcing behavior of a child, the interactive electronic device comprising:

a memory;

a processor communicatively coupled to the memory; and

an adaptive interaction system communicatively coupled to the memory and the processor, wherein the adaptive interaction system;

associates the interactive electronic device in a plurality of interactive electronic devices with at least a second interactive electronic device in the plurality of interactive electronic devices which constitutes a group of interactive electronic devices, when none of the interactive electronic device and the at least a second interactive electronic device is selected to be the only interactive electronic device to select appropriate action to be collectively performed by the group of interactive electronic devices, any of the interactive electronic device and the at least a second interactive electronic device can select appropriate action to be collectively performed by the group of interactive electronic devices; and

in response to the interactive electronic device being the first in the group to perform all of the following;

captures, by at least one of a visual sensor and an audio sensor of the interactive electronic device, a behavior of a child, the behavior being an external physical behavior of a given type and a given action;

determines, based on the capturing, that the behavior substantially matches a behavior in a set of behaviors, wherein the behavior in the set of behaviors comprises a given type and a given action matching the given type and given action of the external behavior;

determines if the behavior is associated with an environmental context flag, wherein the environmental context flag instructs the adaptive interaction system to capture environmental information for the behavior and identifies specific environmental information that is to be captured;

determines, in response to the behavior being associated with the environmental context flag, a current environmental context associated with the behavior, the current environmental context being specific to the behavior, where different types of environmental contexts are determined for different behaviors;

identifies, in response to the determining, a set of interactive actions associated with the behavior, wherein two or more behaviors in the set of behaviors are each associated with a different set of interactions, and wherein one or more of the set of interactions is associated with at least one environmental context;

selects, in response to the identifying, at least one of the interactive actions in the set of interactive actions based on the at least one environmental context associated with the at least one of the interactive action matching the current environmental context, wherein the adaptive interaction system selects the at least one of the interactive actions based on

identifying a value indicating a relative degree of success in obtaining a desired response from the child associated with each of the interactive actions in the set of interactive actions; and

selecting the at least one of the interactive actions in response to the at least one of the interactive actions having a highest value;

then the interactive electronic device performs the at least one of the interactive actions that has been selected, the performing comprising notifying the at least the second interactive electronic device of the captured behavior and instructing the at least the second interactive electronic device to perform at least one interactive action with the interactive electronic device collectively adapting their own group behavior based on the response from the child monitored by any of the interactive electronic devices in the group during the at least one interactive action as a group, wherein the at least one interactive action performed as a group between the interactive electronic device and the at least the second interactive electronic device physically by mechanical movement demonstrates a particular behavior lesson for the child to learn a desired behavior to be performed by the child, and wherein the at least one interactive action performed as a group comprises mechanical movement performed by the interactive electronic device and mechanical movement performed by the at least the second interactive electronic device,

where the interactive electronic device and the at least the second interactive electronic device interact with one another by performing a mechanical movement of the interactive electronic device and the other interactive electronic device, the mechanical movement providing visual action, audible action, or both, as feedback to the child,

monitors a response from the child in response to the at least one of the interactive actions being performed; and

associates an indicator with the at least one of the interactive actions based on the response from the child that has been monitored, wherein the indicator is associated with the at least one of the interactive actions separate from the response of the child, and wherein the indicator indicates a relative degree of success in obtaining a desired response from the child.

10. The interactive electronic device of claim 9, wherein the adaptive interaction system:

receives, from a guardian of the child, a behavior to be monitored for; and

stores the behavior that has been received in the set of behaviors.

11. The interactive electronic device of claim 9, wherein the adaptive interaction system further selects at least one of the interactive actions in the set of interactive actions based on:

determining a current environmental context; and

selecting the at least one of the interactive actions based on the current environmental context that has been determined.

12. The interactive electronic device of claim 9, wherein the adaptive interaction system selects at least one of the interactive actions in the set of interactive actions based on at least one previous monitored response from the child made with respect to one or more of the set of interactive actions.

13. A system for reinforcing behavior of a child, the system-comprising:

a plurality of interactive electronic devices communicatively coupled to each other, each of the plurality of interactive electronic devices comprising a memory, a processor communicatively coupled to the memory, and an adaptive interaction system communicatively coupled to the memory and the processor, wherein the adaptive interaction system of at least a first interactive electronic device in the plurality of interact electronic devices;

associates the first interactive electronic device in the plurality of interactive electronic devices with at least a second interactive electronic device in the plurality of interactive electronic devices which constitutes a group of interactive electronic devices, when none of the first interactive electronic device and the at least a second interactive electronic device is selected to be the only interactive electronic device to select appropriate action to be collectively performed by the group of interactive electronic devices, any of the first interactive electronic device and the at least a second interactive electronic device can select appropriate action to be collectively performed by the group of interactive electronic devices; and

in response to the first interactive electronic device being the first in the group to perform all of the following;

captures, by at least one of a visual sensor and an audio sensor of the first interactive electronic device, a behavior of a child, the behavior being an external physical behavior of a given type and a given action;

determines, based on the capturing, that the behavior substantially matches a behavior in a set of behaviors, wherein the behavior in the set of behaviors comprises a given type and a given action matching the given type and given action of the external physical behavior;

determines if the behavior is associated with an environmental context flag, wherein the environmental context flag instructs the adaptive interaction system to capture environmental information for the behavior and identifies specific environmental information that is to be captured;

determines, in response to the behavior being associated with the environmental context flag, a current environmental context associated with the behavior the current the environmental context being specific to the behavior, where different types of environmental contexts are determined for different behaviors;

identifies, in response to the determining, a set of interactive actions associated with the behavior, wherein one or more of the set of interactions is associated with at least one environmental context;

selects, in response to the identifying, at least one of the interactive actions in the set of interactive actions based on the at least one environmental context associated with the at least one of the interactive action matching the current environmental context, wherein the selecting further comprises;

identifies a value indicating a relative degree of success in obtaining a desired response from the child associated with each of the interactive actions in the set of interactive actions; and

selects the at least one of the interactive actions in response to the at least one of the interactive actions having a highest value;

then the first interactive electronic device performs the at least one of the interactive actions that has been selected, the performing comprising notifying the at least the second interactive electronic device of the captured behavior and instructing the at least the second interactive electronic device to perform at least one interactive action with the first interactive electronic device collectively adapting their own group behavior based on the response from the child monitored by any of the interactive electronic devices in the group during the at least one interactive action as a group, wherein the at least one interactive action performed as a group between the first interactive electronic device and the at least the second interactive electronic device physically by mechanical movement demonstrates a particular behavior lesson for the child to learn a desired behavior to be performed by the child, and wherein the at least one interactive action performed as a group comprises mechanical movement performed by the first interactive electronic device and mechanical movement performed by the at least the second interactive electronic device,

where the first interactive electronic device and the at least the second interactive electronic device interact with one another by performing a mechanical movement of the first interactive electronic device and the at least the second interactive electronic device, the mechanical movement providing visual action, audible action, or both, as feedback to the child;

monitors a response from the child in response to the at least one of the interactive actions being performed; and

associates an indicator with the at least one of the interactive actions based on the response from the child that has been monitored, wherein the indicator is associated with the at least one of the interactive actions separate from the response from the child, and wherein the indicator indicates a relative degree of success in obtaining a desired response from the child.

14. The system of manufacture of claim 13, further comprising instructions for:

receiving, from a guardian of the child, a behavior to be monitored for; and

storing the behavior that has been received in the set of behaviors.

15. The system e of claim 13, wherein the instructions for selecting further comprise instructions for:

determining a current environmental context; and

selecting the at least one of the interactive actions based on the current environmental context that has been determined.

16. The system of claim 13, wherein the selecting is based on at least one previous monitored response from the child made with respect to one or more of the set of interactive actions.

17. The system of claim 13, wherein the dynamically adjusting further comprises:

determining if the relative degree of success is above a given threshold;

dynamically selecting, in response to the relative degree of success being below the given threshold, at least one other interactive action in the set of interactive actions for the subsequent selection.