Home automation via voice control

• US 10,554,432 B2
• Filed: 12/19/2017
• Issued: 02/04/2020
• Est. Priority Date: 05/07/2014
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Warren, Jeremy B.
• Primary Examiner(s): Patel, Ramesh B
• Application Number:
  US15/847,014
• Publication Number:
  US 20180176031A1
• Time in Patent Office: 777 Days
• Field of Search: None
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: H04L 12/2803 Home automation networks

Abstract

Methods and systems are described for setting operation rules for use in controlling aspects of a home automation system. According to at least one embodiment, an apparatus for establishing operation rules in a home automation system includes a processor, a memory in electronic communication with the processor, and instructions stored in the memory which are executable by the processor to receive a spoken command having a plurality of rule setting terms, establish at least one operation rule for the home automation system based on the spoken command, and store the at least one operation rule for later use by the home automation system.

Claims

1. An apparatus for establishing operation rules in a home automation system, comprising:

a processor;

a memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to;

receive a spoken command having a plurality of rule setting terms;

identify at least a portion of the spoken command that is unrecognizable by the home automation system based at least in part on receiving the spoken command;

generate a request for clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

deliver the request for a clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

receive the clarification of at least the portion of the spoken command that is unrecognizable by the home automation system based at least in part on delivering the request for the clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

establish at least one operation rule for the home automation system based on the spoken command and the clarification of the spoken command; and

store the at least one operation rule for later use by the home automation system.

2. The apparatus of claim 1, wherein the instructions are executable by the processor to:

initiate a rules mode for the home automation system prior to receiving the spoken command.

3. The apparatus of claim 2, wherein the instructions are executable by the processor to:

terminate the rules mode after establishing the at least one operation rule.

4. The apparatus of claim 2, wherein the initiating the rules mode includes receiving a touch input at a control panel of the home automation system.

5. The apparatus of claim 2, wherein the initiating the rules mode includes receiving a spoken trigger word or an audible sound.

6. The apparatus of claim 1, wherein the instructions are executable by the processor to:

identify one or more unknown terms in the spoken command, wherein delivering a request for clarification of the spoken command is based at least in part on the identifying.

7. The apparatus of claim 6, wherein the request for clarification includes an audible message.

8. The apparatus of claim 6, wherein the request for clarification includes a displayed message visible on a control panel of the home automation system.

9. The apparatus of claim 1, wherein the instructions are executable by the processor to:

generate a message that includes a restatement of the spoken command and a request for confirmation of the correctness of the restatement of the spoken command.

10. The apparatus of claim 1, wherein the instructions are executable by the processor to:

generate a message to a user of the home automation system that includes a restatement of the at least one operation rule and requests confirmation of the accuracy of the at least one operation rule.

11. A computer-program product for establishing operation rules in a home automation system, the computer-program product comprising a non-transitory computer-readable medium storing instructions executable by a processor to:

initiate a rule setting mode for the home automation system;

receive a spoken command having a plurality of rule setting terms;

identify at least a portion of the spoken command that is unrecognizable by the home automation system based at least in part on receiving the spoken command;

generate a message requesting a confirmation of at least the portion of the spoken command that is unrecognizable by the home automation;

deliver the message requesting confirmation of at least the portion of the spoken command that is unrecognizable by the home automation system;

receive a response message confirming the spoken command that was unrecognizable by the home automation system based at least in part on delivering the message requesting confirmation of at least the portion of the spoken command that is unrecognizable by the home automation system;

generate at least one operation rule for the home automation system based on the spoken command and the confirmation of the spoken command; and

generate a message that includes a restatement of the at least one operation rule.

12. The computer-program product of claim 11, wherein at least some of the plurality of rule setting terms are defined during installation of the home automation system at a property.

13. The computer-program product of claim 11, wherein at least some of the plurality of rule setting terms are generic to a plurality of different home automation systems associated with a plurality of different properties.

14. The computer-program product of claim 11, wherein the plurality of rule setting terms include at least one static term that is generic to a plurality of different home automation systems, and at least one dynamic term that is uniquely defined for the home automation system.

15. The computer-program product of claim 11, wherein the instructions are executable by the processor to:

store the at least one operation rule for later use by the home automation system, wherein storing the at least one operation rule includes storing in a local database of the home automation system.

16. The computer-program product of claim 11, wherein the instructions are executable by the processor to:

identify one or more unknown terms in the spoken command, wherein generating the message requesting confirmation of the spoken command is based at least in part on the identifying.

17. The computer-program product of claim 16, wherein the instructions are executable by the processor to:

receive confirmation of the spoken command.

18. A computer-implemented method for establishing operation rules in a home automation system, comprising:

initiating a rules mode for the home automation system;

receiving a spoken command having a plurality of rule setting terms;

identifying at least a portion of the spoken command that is unrecognizable by the home automation system based at least in part on receiving the spoken command;

generating a request for clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

delivering the request for a clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

receiving the clarification of at least the portion of the spoken command that is unrecognizable by the home automation system based at least in part on delivering the request for the clarification of at least the portion of the spoken command that is unrecognizable by the home automation system;

establishing at least one operation rule for the home automation system using the spoken command and the clarification of the spoken command;

storing the at least one operation rule; and

operating at least one function of the home automation system based on the at least one stored operation rule.

19. The method of claim 18, wherein the plurality of rule setting terms include at least one static term that is pre-programmed into the home automation system prior to installation.

20. The method of claim 18, wherein the plurality of rule setting terms include at least one dynamic term that is uniquely programmed into the home automation system no sooner than installation at a property.