Accessory management system using environment model

• US 10,454,783 B2
• Filed: 05/29/2015
• Issued: 10/22/2019
• Est. Priority Date: 02/05/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Burks, Andrew, Nadathur, Anush G., Rama, Srinivas, McLaughlin, Kevin P., Abuan, Joe, Haskins, Harlan
• Primary Examiner(s): Pan, Yongjia
• Application Number:
  US14/725,912
• Publication Number:
  US 20150350031A1
• Time in Patent Office: 1,607 Days
• Field of Search: None
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/281 indicating a format for calling an appliance service function in a home automation network for remote control or remote monitoring of applications H04L67/025
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04W 76/16 Involving different core network technologies, e.g. a packet-switched [PS] bearer in combination with a circuit-switched [CS] bearer

Abstract

Controllers can be used to control the operation of various accessories. A group of accessories can be organized into an accessory network that can facilitate coordinated control of multiple accessories. The accessory network can be organized according to an environment model that can include a hierarchical representation of a physical environment where accessories are present. The environment model can be synchronized across different controllers that have access to the accessories.

Claims

1. A method executable by one or more devices, the method comprising:

defining an environment model that comprises a hierarchical representation of a physical environment where a plurality of accessory devices are present, the hierarchical representation including a plurality of rooms at a first level and a plurality of zones at a higher level than the first level, each zone of the plurality of zones including at least one subset of the plurality of rooms, and wherein defining the environment model comprises defining a list of users and devices associated with the users that are authorized to edit the environment model;

adding a representation of each of the plurality of accessory devices to the environment model, the representation of each accessory device of the plurality of accessory devices being assigned to a room of the plurality of rooms in the environment model based at least in part on a physical location of each of the plurality of accessory devices;

identifying a respective characteristic of each of the plurality of accessory devices, the respective characteristic identifying an operation that a respective accessory device of the plurality of accessory devices is configured to perform and including a current state for the respective characteristic; and

providing a user interface operable to;

present a representation of the respective accessory device, a representation of a target state selector, and a representation of the current state;

receive an input indicating a selection of a target state for the respective accessory device; and

control the respective accessory device by sending information identifying the selection of the target state, enabling the respective accessory to compare the target state with information stored at the respective accessory device that indicates the current state.

2. The method of claim 1 further comprising:

establishing a pairing with each of the accessory devices, wherein establishing a pairing with an accessory device includes providing to the accessory device a long-term public key of the one or more devices and obtaining from the accessory a long-term public key of the accessory device.

3. The method of claim 1 wherein the environment model includes one room that is not assigned to any of the zones.

4. The method of claim 3 wherein adding the representations of the accessory devices to the environment model includes assigning the representations of the accessory devices to rooms, wherein for each accessory device, the representation thereof is assigned to exactly one room and wherein representations of accessory devices that are assigned to a particular room are also assigned to the zone in which the room is contained.

5. The method of claim 4 further comprising:

defining, in response to user input, a service group within the environment model, the service group having at least a representation of a first accessory device and a representation of a second accessory device assigned thereto,

wherein the representation of the first accessory device and the representation of the second accessory device are also assigned to rooms that are in different zones.

6. The method of claim 1 further comprising:

defining, within the environment model, a triggered action set, the triggered action set specifying a triggering condition and one or more control messages to be sent to one or more of the accessory devices represented in the environment model in response to detecting, by the one or more devices, that the triggering condition obtains.

7. The method of claim 6 wherein the triggered action set further specifies a triggering event such that detection by the one or more devices of the triggering event results in testing whether the triggering condition obtains.

8. The method of claim 1 wherein the environment model is synchronized among a plurality of devices on the list of devices.

9. The method of claim 1, wherein the one or more devices are wirelessly connected to an access point.

10. The method of claim 9, wherein the plurality of accessory devices are wirelessly connected to the access point.

11. A device comprising:

a user interface;

a communication interface to communicate with one or more other devices including at least an accessory device; and

a processing subsystem coupled to the user interface and the communication interface, the processing subsystem configured to;

define an environment model that comprises a hierarchical representation of a physical environment where a plurality of accessory devices are present, the hierarchical representation including a plurality of rooms at a first level and a plurality of zones at a higher level than the first level, each zone of the plurality of zones including at least one subset of the plurality of rooms, and wherein the environment model is defined by defining a list of users and devices associated with the users that are authorized to edit the environment model;

add a representation of each of the plurality of accessory devices to the environment model, the representation of each accessory device of the plurality of accessory devices being assigned to a room of the plurality of rooms in the environment model based at least in part on a physical location of each of the plurality of accessory devices;

identify a respective characteristic of each of the plurality of accessory devices, the respective characteristic identifying an operation that a respective accessory device of the plurality of accessory devices is configured to perform and including a current state for the respective characteristic; and

present the user interface operable to;

present a representation of the respective accessory device, a representation of a target state selector, and a representation of the current state;

receive an input indicating a selection of a target state for the respective accessory device; and

control the respective accessory device by sending information identifying the selection of the target state, enabling the respective accessory to compare the target state with information stored at the respective accessory device that indicates the current state.

12. The device of claim 11 wherein the processing subsystem is further configured to execute an application program that has a configuration mode and a control mode, wherein the configuration mode allows a user to operate the user interface to define the environment model and add representations of the accessory devices to the environment model, and wherein the control mode allows the user to operate the user interface to control the accessory devices within a framework corresponding to the environment model.

13. The device of claim 11, wherein the user interface in a configuration mode includes a user interface screen describing an accessory and a user-operable identify control for the accessory,

wherein, responsive to user operation of the identify control, the device sends a reveal request to the accessory device, the reveal request being recognizable by the accessory device as an instruction to perform an action that is observable by the user, the action being determined by the accessory device.

14. A computer-readable storage medium having stored thereon program instructions that, when executed by a processor of at least one device, cause the at least one device to perform operations comprising:

defining an environment model, the environment model including a hierarchical representation of a physical environment where a plurality of accessory devices are present, and the hierarchical representation including a plurality of rooms at a lowest level and a plurality of zones at a higher level than the lowest level, each zone of the plurality of zones including at least one subset of the plurality of rooms, and wherein defining the environment model comprises defining a list of users and devices associated with the users that are authorized to edit the environment model;

adding a representation of each of the plurality of accessory devices to the environment model, the representation of each accessory device of the plurality of accessory devices being assigned to a room of the plurality of rooms in the environment model based at least in part on a physical location of each of the plurality of accessory devices;

identifying a respective characteristic of each of the plurality of accessory devices, the respective characteristic identifying an operation that a respective accessory device of the plurality of accessory devices is configured to perform and including a current state for the respective characteristic; and

providing a user interface operable to;

present a representation of the respective accessory device, a representation of a target state selector, and a representation of the current state;

receive an input indicating a selection of a target state for the respective accessory device; and

control the respective accessory device by sending information identifying the selection of the target state, enabling the respective accessory to compare the target state with information stored at the respective accessory device that indicates the current state.

15. The computer-readable storage medium of claim 14 wherein the operations further comprise:

establishing a pairing with each of the accessory devices, wherein establishing a pairing with an accessory device includes providing to the accessory device a long-term public key of the at least one device and obtaining from the accessory a long-term public key of the accessory device.

16. The computer-readable storage medium of claim 14 wherein for each accessory device, the representation thereof is assigned to exactly one room.

17. The computer-readable storage medium of claim 16 wherein the operations further comprise:

defining, in response to user input, a service group within the environment model, the service group having at least a representation of a first accessory device and a representation of a second accessory device assigned thereto,

wherein the representation of the first accessory device and the representation of the second accessory device are also assigned to rooms that are in different zones.