Voice control using multi-media rooms

• US 9,929,873 B2
• Filed: 12/05/2014
• Issued: 03/27/2018
• Est. Priority Date: 12/06/2013
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Hwang, Jungtaik, Eyring, Matthew J., Warren, Jeremy Bruce, Nye, James Ellis
• Primary Examiner(s): Hang, Vu B
• Application Number:
  US14/561,655
• Publication Number:
  US 20150162007A1
• Time in Patent Office: 1,208 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204

Abstract

Methods and systems are described for controlling an automation and security system. According to at least one embodiment, an apparatus for voice control of an automation and security system includes a processor, a memory in electronic communication with the processor, and instructions stored in the memory. The instructions are executable by a processor to detect a trigger word spoken by a user at a location remote from a control panel of the automation and security system, detect a command spoken by the user at the remote location which follows the trigger word, deliver at least one audio response to the user at the remote location in response to the command, and perform an action in response to the command.

Claims

1. An apparatus for voice control of an automation and security system, comprising:

a processor;

a memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by a processor to;

detect sound spoken by a user to a first multi-media device at a location remote from a control panel of the automation and security system;

determine that the sound comprises a trigger word;

determine that the sound further comprises a command spoken after the trigger word;

send an instruction to deactivate a second multi-media device upon determining that the sound comprises at least one of the trigger word and the command spoken by the user;

deliver at least one audio response to the first multi-media device at the remote location in response to the command; and

perform an action in response to the command.

2. The apparatus of claim 1, wherein detecting the trigger word and detecting the command are performed by the at least one multi-media device, and the at least one multi-media device is distinct from the control panel.

3. The apparatus of claim 2, further comprising:

delivering the command from the at least one multi-media device to the control panel.

4. The apparatus of claim 2, wherein the at least one multi-media device includes a speaker configured to deliver the at least one audio response to the user and a microphone configured to detect the trigger word and the command.

5. The apparatus of claim 1, wherein the at least one audio response includes a request for confirmation of the command, and the instructions are further executable by the processor to:

detect a confirmation of the command spoken by the user at the remote location.

6. The apparatus of claim 1, wherein the at least one audio response includes a confirmation that the action is completed.

7. The apparatus of claim 1, wherein the instructions are executable by the processor to:

detect with the control panel a trigger word spoken by a user;

detect with the control panel a command spoken by the user which follows the trigger word detected with the control panel;

deliver with the control panel at least one audio response to the user in response to the command; and

perform an action in response to the command.

8. The apparatus of claim 7, wherein the control panel includes a speaker configured to deliver the at least one audio response from the control panel and a microphone configured to detect the trigger word and command with the control panel.

9. The apparatus of claim 1, further comprising:

a plurality of multi-media devices at the remote location, wherein detecting the trigger word and detecting the command are performed by at least two of the plurality of multi-media devices.

10. A computer-program product for voice control of an automation and security system having at least one multi-media device and a control panel, the computer-program product comprising a non-transitory computer-readable medium storing instructions executable by a processor to:

detect sound spoken by a user to a first multi-media device at a location remote from a control panel;

determine that the sound comprises a trigger word;

determine that the sound further comprises a command spoken after the trigger word;

send an instruction to deactivate a second multi-media device upon determining that the sound comprises at least one of the trigger word and the command spoken by the user, the at least one multi-media device including the first and second multi-media devices;

deliver at least one of the detected trigger word and the detected command from the first multi-media device to the control panel;

deliver at least one audio response to the user via the first multi-media device at the remote location in response to the command; and

perform at least one automation or security action in response to the command.

11. The computer-program product of claim 10, wherein the command includes a request for confirmation of a status of the automation and security system.

12. The computer-program product of claim 10, wherein the command includes turning ON or turning OFF a security feature of the automation and security system.

13. The computer-program product of claim 10, wherein delivering at least one audio response includes asking a question of the user to confirm the command.

14. The computer-program product of claim 10, wherein each of the at least one multi-media devices includes a microphone configured to detect the command and a speaker configured to deliver the at least one audio response.

15. A computer-implemented method for voice control of an automation and security system, comprising:

monitoring with one or more multi-media devices for a sound made by a user;

detecting the sound with a first multi-media device from the one or more multi-media devices, the first multi-media device being at a location remote from a control panel of the automation and security system;

determining with the first multi-media device that the sound comprises a trigger word;

determining with the first multi-media device that the sound further comprises a command spoken after the trigger word;

confirming the command;

delivering at least one of the detected trigger word and the detected command from the first multi-media device to the control panel;

sending, by the control panel, an instruction to deactivate a second multi-media device from the one or more multi-media devices upon detecting at least one of the trigger word and the command spoken by the user;

analyzing, by the control panel, at least one of the detected trigger word and the delivered command; and

performing, based at least in part on the analysis, with the control panel at least one action in response to at least one of the trigger word and the command.

16. The method of claim 15, wherein confirming the command further comprises:

delivering at least one audio message to the user via the at least one multi-media device in response to the command and detecting a confirming response from the user.

17. The method of claim 16, wherein at least one of the one or more multi-media devices filter at least one of the detected trigger word and the detected command before delivering the at least one of the detected trigger word and the detected command to the control panel.

18. The method of claim 15, wherein confirming the command further comprises:

comparing the command to a database of commands.

19. The method of claim 15, wherein confirming the command is performed by at least one of the one or more multi-media devices.