Automated environment providing feedback based on user routine

• US 10,719,122 B2
• Filed: 09/16/2015
• Issued: 07/21/2020
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Marti, Lukas M., Huang, Ronald Keryuan
• Primary Examiner(s): Tran, Anthan
• Application Number:
  US14/856,252
• Publication Number:
  US 20160091871A1
• Time in Patent Office: 1,770 Days
• Field of Search: 702188
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2829 involving user profiles according to which the execution of a home appliance functionality is automatically triggered
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

A device in an automated environment can detect patterns in the user'"'"'s interactions with accessories in the automated environment and can provide feedback to the user based on the patterns. Examples include: suggesting automation of particular actions based on the patterns; suggesting actions that conform to the pattern when the user performs part of the pattern; or suggesting changes to a pattern to conform to a preferred pattern.

Claims

1. A method comprising:

detecting, by a coordinator device comprising a processor and a memory in an automated environment, a plurality of interactions between one or more controller devices with one or more accessory devices in the automated environment, wherein the coordinator device is configured to manage the plurality of interactions between the one or more accessory devices and the one or more controller devices in the automated environment, wherein the coordinator device is a different device from the one or more controller devices,

wherein the plurality of interactions comprise sending messages between the one or more controller devices and the one or more accessory devices in response to a user interaction with at least one of the one or more controller devices and the one or more accessory devices;

collecting, by the coordinator device, accessory interaction data pertaining to each of the plurality of interactions between the one or more controller devices with the one or more accessory devices, the accessory interaction data for a detected interaction between a controller device and an accessory device including information about a particular interaction message communicated between the controller device and the accessory device during the detected interaction, wherein collecting the accessory interaction data includes collecting data from one or both of the controller device or the accessory device;

analyzing, by the coordinator device, the accessory interaction data to detect a pattern in the plurality of interactions between the one or more controller devices with the one or more accessory devices; and

providing, by the coordinator device, feedback to a controller device of the one or more controller devices based on the detected pattern in the plurality of interactions.

2. The method of claim 1, wherein providing feedback to the controller device of the one or more controller devices includes:

subsequent to detecting the pattern, detecting a deviation from the pattern; and

in response to detecting the deviation, prompting a user of the controller device to take an action conforming to the pattern.

3. The method of claim 1, wherein providing feedback to the controller device of the one or more controller devices includes:

determining that the detected pattern differs from a preferred pattern based on a recommended practice; and

recommending to a user of the controller device a change in the detected pattern to conform more closely to the preferred pattern.

4. The method of claim 3, wherein the recommended practice reduces energy consumption.

5. The method of claim 3, wherein the recommended practice shifts energy consumption away from peak hours.

6. The method of claim 3, further comprising:

subsequent to determining that the detected pattern differs from the preferred pattern, detecting a specific instance in which a user action matches the detected pattern; and

in response to detecting the specific instance, issuing a prompt to the user to conform more closely to the preferred pattern.

7. The method of claim 1, wherein providing feedback to the controller device of the one or more controller devices includes:

presenting to a user of the controller device an offer to automate an accessory action based on the detected pattern; and

in response to the user accepting the offer, establishing an automation rule to automatically initiate the accessory action in response to a triggering condition defined based on the detected pattern.

8. The method of claim 1, wherein the accessory interaction data for the detected interaction includes one or more of a group consisting of:

an indicator of which of the one or more controller devices participated in the detected interaction;

an indicator of which of the one or more accessory devices participated in the detected interaction;

location information indicating a location of the one or more controller devices that participated in the detected interaction;

a time at which the detected interaction occurred; and

state information pertaining to the automated environment.

9. The method according to claim 1, wherein the feedback provided to the controller device of the one or more controller devices, based on the detected pattern in the plurality of interactions, comprises one of notifying a user of the controller device regarding a deviation from the detected pattern, recommending a change to the detected pattern, and recommending an automation to be performed in the automated environment.

10. The method according to claim 1, wherein the accessory interaction data, that is collected by the coordinator device and pertains to each of the plurality of interactions between the one or more controller devices with the one or more accessory devices, comprises one of an identifier of the one or more accessory devices, an identifier of the automated environment where the one or more accessory devices is located, a location information for the one or more controller devices, and a record of a message sent and/or received during the detected interaction.

11. The method according to claim 1, further comprising generating a pattern result based on the detected pattern in the plurality of interactions;

and

collecting updated accessory interaction data pertaining to each of the plurality of interactions in order to generate a periodically updated pattern result.

12. The method according to claim 1, wherein the particular interaction message comprises a control message instructing the accessory device to perform an action.

13. The method according to claim 1, wherein the coordinator device in located in a local automated environment with the one or more accessory devices.

14. A method comprising:

detecting, by a first controller device in an automated environment, a plurality of interactions with one or more accessory devices in the automated environment,

wherein the plurality of interactions comprise sending messages between one or more controller devices and the one or more accessory devices in response to a user interaction with at least one of the one or more controller devices and the one or more accessory devices;

collecting, by the first controller device, accessory interaction data pertaining to each of the plurality of interactions between the one or more controller devices with the one or more accessory devices, the accessory interaction data for a detected interaction between a controller device and an accessory device including information about a particular interaction message communicated between the controller device and the accessory device during the detected interaction;

analyzing, by the first controller device, the collected accessory interaction data to detect a pattern in the plurality of interactions between the one or more controller devices with one or more accessory devices; and

providing, by the first controller device, feedback to a second controller device, of the one or more controller devices, that is different from the first controller device, based on the detected pattern in the plurality of interactions.

15. The method of claim 14, wherein the plurality of interactions occur while the controller device is physically within the automated environment.

16. The method of claim 14, wherein providing feedback to the second controller device of the one or more controller devices includes:

subsequent to detecting the pattern, detecting a deviation from the pattern; and

in response to detecting the deviation, prompting a user of the controller device to take an action conforming to the pattern.

17. The method of claim 14, wherein providing feedback to the second controller device of the one or more controller devices includes:

determining that the detected pattern differs from a preferred pattern based on a recommended practice; and

recommending to a user of the controller device a change in the detected pattern to conform more closely to the preferred pattern.

18. The method of claim 17, wherein the recommended practice reduces energy consumption.

19. The method of claim 17, wherein the recommended practice shifts energy consumption away from peak hours.

20. The method of claim 17, further comprising:

subsequent to determining that the detected pattern differs from the preferred pattern, detecting a specific instance in which a user action matches the detected pattern; and

in response to detecting the specific instance, issuing a prompt to the user to conform more closely to the preferred pattern.

21. The method of claim 14, wherein providing feedback to the second controller device of the one or more controller devices includes:

presenting to a user of the second controller device an offer to automate an accessory action based on the detected pattern; and

in response to the user accepting the offer, establishing an automation rule to automatically initiate the accessory action in response to a triggering condition defined based on the detected pattern.

22. The method of claim 14, wherein the accessory interaction data includes one or more of a group consisting of:

an indicator of which of the one or more accessory devices participated in the detected interaction;

location information indicating a location of the controller device at a time of the detected interaction;

a time at which the detected interaction occurred; and

state information pertaining to the automated environment.

23. A coordinator device in an automated environment comprising:

a communication interface to communicate with one or more accessory devices in the automated environment and to communicate with one or more controller devices; and

a processor coupled to the communication interface and configured to;

detect a plurality of interactions of one or more controller devices with the one or more accessory devices in the automated environment,

wherein the coordinator device is configured to manage the plurality of interactions between the one or more accessory devices and the one or more controller devices in the automated environment,

wherein the plurality of interactions comprise sending messages between the one or more controller devices and the one or more accessory devices in response to a user interaction with at least one of the one or more controller devices and the one or more accessory devices,

wherein the coordinator device is a different device from the one or more controller devices;

collect accessory interaction data pertaining to each of the plurality of interactions between the one or more controller devices with the one or more accessory devices, the accessory interaction data for a detected interaction between a controller device and an accessory device including information about a particular interaction message communicated between the controller device and the accessory device during the detected interaction, wherein collecting the accessory interaction data includes collecting data from one or both of the controller device or the accessory device;

analyze the accessory interaction data to detect a pattern in the plurality of interactions between the one or more controller devices with one or more accessory devices; and

provide feedback to a controller device of the one or more controller devices based on the detected pattern in the plurality of interactions.

24. A mobile controller device in an automated environment comprising:

a communication interface to communicate with one or more accessory devices in the automated environment; and

a processor coupled to the communication interface and configured to;

detect a plurality of interactions with one or more accessory devices in the automated environment,

wherein the plurality of interactions comprise sending messages between one or more controller devices and the one or more accessory devices in response to a user interaction with at least one of the one or more controller devices and the one or more accessory devices;

collect accessory interaction data pertaining to each of the plurality of interactions between the one or more controller devices with the one or more accessory devices, the accessory interaction data for a detected interaction between the mobile controller device and an accessory device including information about a particular interaction message communicated between the mobile controller device and the accessory device during the detected interaction;

analyze the collected accessory interaction data to detect a pattern in the plurality of interactions between the one or more controller devices with one or more accessory devices; and

provide feedback to a controller device, of the one or more controller devices, that is different from the mobile controller device, based on the detected pattern in the plurality of interactions.