Voice control using multi-media rooms

• US 10,432,419 B1
• Filed: 03/23/2018
• Issued: 10/01/2019
• Est. Priority Date: 12/06/2013
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Hwang, Jungtaik, Eyring, Matthew J., Warren, Jeremy Bruce, Nye, James Ellis
• Primary Examiner(s): Hang, Vu B
• Application Number:
  US15/934,202
• Time in Patent Office: 557 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204

Abstract

Methods and systems are described for controlling an automation and security system. According to at least one embodiment, an apparatus for voice control of an automation and security system includes a processor, a memory in electronic communication with the processor, and instructions stored in the memory. The instructions are executable by a processor to detect a trigger word spoken by a user at a location remote from a control panel of the automation and security system, detect a command spoken by the user at the remote location which follows the trigger word, deliver at least one audio response to the user at the remote location in response to the command, and perform an action in response to the command.

Claims

1. An apparatus for voice control of an automation and security system, comprising:

a processor;

a memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by a processor to;

detect sound input spoken by a user near a first multi-media device at a location remote from a control panel of the automation and security system, wherein detecting the sound input is performed by the first multi-media device, and the first multi-media device is distinct from the control panel;

parse the sound input to identify a trigger word;

parse the sound input further to identify a command spoken after the trigger word; and

generate an instruction for deactivating a second multi-media device and send the instruction to deactivate the second multi-media device upon identifying at least one of the trigger word and the command spoken by the user, wherein the second multi-media device is deactivated.

2. The apparatus of claim 1, wherein the instructions are executable by the processor to:

deliver at least one audio response to the first multi-media device at the remote location in response to the command.

3. The apparatus of claim 2, wherein the at least one audio response includes a confirmation that the action is completed.

4. The apparatus of claim 3, wherein the sound input is detected at least in part via a microphone of the first multi-media device, and the at least one audio response is transmitted at least in part via a speaker of the first multi-media device.

5. The apparatus of claim 1, wherein the instructions are executable by the processor to:

perform an action in response to the command.

6. The apparatus of claim 1, wherein the instructions are executable by the processor to:

receive an indication confirming that the second multi-media device is deactivated.

7. A computer-program product for voice control of an automation and security system having at least a first multi-media device, a second multi-media device, and a control panel, the computer-program product comprising a non-transitory computer-readable medium storing instructions executable by a processor to:

detect sound input spoken by a user to a first multi-media device at a location remote from a control panel, wherein detecting the sound input is performed by the first multi-media device, and the first multi-media device is distinct from the control panel;

parse the sound input to identify a trigger word;

parsing the sound input further to identify a command spoken after the trigger word; and

generate an instruction for deactivating a second multi-media device and send the instruction to deactivate the second multi-media device upon identifying at least one of the trigger word and the command spoken by the user, wherein the second multi-media device is deactivated.

8. The computer-program product of claim 7, wherein the instructions are executable by a processor to:

deliver at least one of the detected trigger word and the detected command from the first multi-media device to the control panel.

9. The computer-program product of claim 7, wherein the instructions are executable by a processor to:

deliver at least one audio response to the user in response to the command.

10. The computer-program product of claim 9, wherein delivering at least one audio response includes asking a question of the user to confirm the command.

11. The computer-program product of claim 9, wherein the delivering is performed at least in part via the first multi-media device at the remote location.

12. The computer-program product of claim 7, wherein the instructions are executable by a processor to:

perform at least one automation or security action in response to the command.

13. The computer-program product of claim 7, wherein the instructions are executable by a processor to:

determine that the command includes a request for confirmation of a status of the automation and security system.

14. The computer-program product of claim 7, wherein the instructions are executable by a processor to:

determine that the command includes turning ON or turning OFF a security feature of the automation and security system.

15. A computer-implemented method for voice control of an automation and security system, comprising:

monitoring with at least one of a first multi-media device and a second multi-media device for a sound input made by a user;

detecting, by the first multi-media device, the sound input with the first multi-media device, the first multi-media device being at a location remote from a control panel of the automation and security system, wherein the first multi-media device is distinct from the control panel;

parsing the sound input to identify a trigger word;

parsing the sound input further to identify a command spoken after the trigger word; and

generating and sending, by the control panel, an instruction to the second multi-media device to deactivate the second multi-media device upon identifying at least one of the trigger word and the command spoken by the user, wherein the second multi-media device is deactivated.

16. The method of claim 15, further comprising:

confirming the command.

17. The method of claim 16, wherein confirming the command further comprises:

delivering at least one audio message to the user via the at least one multi-media device in response to the command and detecting a confirming response from the user.

18. The method of claim 16, wherein confirming the command further comprises:

comparing the command to a database of commands.

19. The method of claim 15, further comprising:

analyzing at least one of the detected trigger word and the delivered command.

20. The method of claim 18, further comprising:

performing, based at least in part on the analysis, at least one action in response to at least one of the trigger word and the command.