User interfaces, systems and methods for configuring smart devices for interoperability with a smart hub device

• US 10,397,013 B1
• Filed: 11/12/2015
• Issued: 08/27/2019
• Est. Priority Date: 04/11/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Hill, Edward, Kozura, John, Taylor, Haley A., Mathews, Jeff, Zimmer, Andrew
• Primary Examiner(s): Chu, Wutchung
• Application Number:
  US14/940,139
• Time in Patent Office: 1,384 Days
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/2809 indicating that an appliance service is present in a home automation network monitoring functionality H04L43/0817; discovery or management thereof, e.g. service location protocol [SLP] or web services, H04L67/51
• CPC Class Codes: H04L 12/281 indicating a format for calling an appliance service function in a home automation network for remote control or remote monitoring of applications H04L67/025
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display

Abstract

This application discloses a method implemented at a client device for adding a smart device in a smart home environment. The client device executes a client-side application associated with a user account, and the client-side application is associated with an electronic device that is coupled to the client device over a first communication network. A first user interface is then displayed by the client-side application for adding a new smart device. The first user interface includes a first affordance that when selected causes the electronic device to initiate a plurality of commissioning options. The client device then displays a device-specific control user interface associated with the new smart device in response to receiving an indication that the new smart device has been added into the smart home environment via communication between the electronic device and the new smart device using one of a plurality of communication protocols.

Claims

1. A method for adding a smart device in a smart home environment, wherein the smart home environment includes one or more smart devices, comprising:

at a client device having one or more processors and memory storing one or more programs for execution by the one or more processors;

executing a client-side application associated with a user account, wherein the client-side application is associated with an electronic device that is coupled to the client device over a first communication network to manage the electronic device and one or more smart devices coupled to the electronic device, wherein the electronic device is communicatively coupled to each of the one or more smart devices using a corresponding one of a plurality of different communication protocols;

displaying by the client-side application a first user interface for adding a new smart device to the smart home environment, the first user interface including a first affordance that when selected causes the electronic device to initiate one of a plurality of commissioning options for adding a new smart device to the smart home environment, wherein the plurality of commissioning options for adding a new smart device are defined according to at least a level of user interaction involved in a process of adding a smart device;

in accordance with at least the level of user interaction involved in the process of adding a smart device, selecting by the client-side application one of a plurality of device commissioning user interfaces, each device commissioning user interface corresponding to a respective one of the plurality of commissioning options for adding a new smart device; and

in response to receiving an indication from the electronic device that the new smart device has been added into the smart home environment via communication between the electronic device and the new smart device using the corresponding one of the plurality of communication protocols, displaying a device-specific control user interface associated with the new smart device.

2. The method of claim 1, further comprising:

after receiving a user selection of the first affordance, displaying the selected one of the plurality of device commissioning user interfaces prompting one or more user interventions, the completion of which is necessary for commissioning of the new smart device in accordance with the selected commissioning options.

3. The method of claim 1, wherein displaying the device-specific control user interface associated with the new smart device further comprises:

obtaining device information, and

displaying the device information on the device-specific control user interface.

4. The method of claim 3, wherein the device information includes at least one of a device name, a location, and descriptive information of the new smart device.

5. The method of claim 1, wherein an inventory of the smart home environment is displayed on the first user interface, and the first user interface further includes a plurality of second visual affordances each associated with a respective smart device that has been installed in the smart home environment, further comprising:

after commissioning of the new smart device, displaying on the first user interface the plurality of second visual affordances refreshed to include a third visual affordance that represents the new smart device.

6. The method of claim 1, further comprising:

sending to the electronic device a user request to search for a new smart device in the smart home environment.

7. The method of claim 1, wherein the plurality of commissioning options includes a first commissioning option associated with simple smart devices, further comprising:

in accordance with the first commissioning option, displaying on the selected one of the plurality of device commissioning user interfaces user interfaces an instruction to the user of the client device to instruct the user to press a button on the new smart device.

8. The method of claim 7, wherein the instruction is displayed to instruct the user to press one of a power button, a set button, and a motion sensor button on the new smart device.

9. The method of claim 1, further comprising:

causing the electronic device to establish communication with the new smart device over one or the one or more second communication networks, wherein the one or more second communication networks are distinct from the first communication network.

10. The method of claim 1, wherein the one or more second communication networks are implemented based on at least one communication protocol of a group consisting of Insteon, IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, Bluetooth Low Energy, ISA100.11a, WirelessHART, MiWi, OSIAN, Ethernet, and HomePlug.

11. A client device, comprising:

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

executing a client-side application associated with a user account, wherein the client-side application is associated with an electronic device that is coupled to the client device over a first communication network to manage the electronic device and one or more smart devices coupled to the electronic device, wherein the electronic device is communicatively coupled to each of the one or more smart devices using a corresponding one of a plurality of different communication protocols;

displaying by the client-side application a first user interface for adding a new smart device to the smart home environment, the first user interface including a first affordance that when selected causes the electronic device to initiate one of a plurality of commissioning options for adding a new smart device to the smart home environment, wherein the plurality of commissioning options for adding a new smart device are defined according to at least a level of user interaction involved in a process of adding a smart device;

in accordance with at least the level of user interaction involved in the process of adding a smart device, selecting by the client-side application one of a plurality of device commissioning user interfaces, each device commissioning user interface corresponding to a respective one of the plurality of commissioning options for adding a new smart device; and

in response to receiving an indication from the electronic device that the new smart device has been added into the smart home environment via communication between the electronic device and the new smart device using the corresponding one of the plurality of communication protocols, displaying a device-specific control user interface associated with the new smart device.

12. The client device of claim 11, wherein the plurality of commissioning options includes a second commissioning option associated with complex smart devices, the one or more programs further comprising instructions for:

after the new smart device is identified, generating a sequence of instructions to guide the user to install the new smart device according to a manufacturer predetermined commissioning procedure.

13. The client device of claim 12, wherein the sequence of instructions is displayed on the on the selected one of the plurality of device commissioning user interfaces user interfaces, and includes:

a first instruction that instructs the user to select a configuration mode on a keypad of the new smart device; and

a second instruction that instructs the user to enter one or more codes on the keypad.

14. The client device of claim 13, wherein the new smart device is an electronic lock, and the sequence of instructions are configured to instruct the user to enter a master code on a keypad of the lock.

15. The client device of claim 11, wherein each device commissioning user interface further includes one or more instructions for a user action associated with the level of user interaction, the user action being one of pressing a button on the new smart device, entering a code on the new smart device and entering user account credentials on the device commissioning user interface.

16. A non-transitory computer-readable storage medium storing one or more programs for execution by one or more processors of a client device, the one or more programs comprising instructions for:

executing a client-side application associated with a user account, wherein the client-side application is associated with an electronic device that is coupled to the client device over a first communication network to manage the electronic device and one or more smart devices coupled to the electronic device, wherein the electronic device is communicatively coupled to each of the one or more smart devices using a corresponding one of a plurality of different communication protocols;

displaying by the client-side application a first user interface for adding a new smart device to the smart home environment, the first user interface including a first affordance that when selected causes the electronic device to initiate one of a plurality of commissioning options for adding a new smart device to the smart home environment, wherein the plurality of commissioning options for adding a new smart device are defined according to at least a level of user interaction involved in a process of adding a smart device;

in accordance with at least the level of user interaction involved in the process of adding a smart device, selecting by the client-side application one of a plurality of device commissioning user interfaces, each device commissioning user interface corresponding to a respective one of the plurality of commissioning options for adding a new smart device; and

in response to receiving an indication from the electronic device that the new smart device has been added into the smart home environment via communication between the electronic device and the new smart device using the corresponding one of the plurality of communication protocols, displaying a device-specific control user interface associated with the new smart device.

17. The non-transitory computer-readable storage medium of claim 16, wherein the plurality of commissioning options includes a third commissioning option associated with premium smart devices, further comprising:

in accordance with the third commissioning option, generating a request for user inputs of user account credentials associated with the new smart device.

18. The non-transitory computer-readable storage medium of claim 17, wherein the new smart device is associated with a new smart device application that is distinct from the client-side application, and the user account credentials associated with the new smart device are used to access a corresponding user account of the new smart device application.

19. The non-transitory computer-readable storage medium of claim 16, wherein the new smart device has been associated with another user account of the client-side application, or commissioned to communicate with another hub device in another smart home environment.

20. The non-transitory computer-readable storage medium of claim 16, wherein the new smart device is one of a camera, a duplex receptacle, a wall switch, a smart light bulb, a thermostat, a smart power outlet, a motion sensor, an electronic lock, an appliance module, a hue bridge, an audio device and a security device.