History-based key phrase suggestions for voice control of a home automation system
First Claim
1. A method comprising:
- building a history database on a storage device that maintains events that have occurred in a home automation system, each event associated with a time and indicating one or more services activated, one or more scenes activated or one or more types of media content presented by the home automation system;
selecting a subset of the events of the history database based on a comparison of each event and associated time with a present condition of the home automation system and a present time, to produce a scored prediction dataset, wherein event scores in the scored prediction dataset are determined at least in part based on a frequency of each event within a time window, with a shorter time window causing a higher score than a longer time window;
selecting one or more intentions from a list of intentions based on the event scores from the scored prediction dataset, wherein each intention from the list is recognized by a voice recognition engine and includes a key phrase paired with an action to be performed by the home automation system;
displaying, to a current user of a remote control or mobile device of the home automation system in a user interface on the remote control or mobile device, one or more key phrases from the one or more selected intentions as one or more key phrase suggestions;
receiving, at the voice recognition engine, speech input of the current user from a microphone of the remote control or mobile device;
comparing, by the voice recognition engine, the speech input against the key phrases of the list of intentions to find a matching intention; and
triggering the action associated with the matching intention, wherein the action controls one or more devices within a room of the home automation system.
4 Assignments
0 Petitions
Accused Products
Abstract
In one embodiment, history-based key phrase suggestions are provided for voice control of a home automation system. A host controller builds a history database that maintains a history of events, each event indicating one or more services activated, one or more scenes activated or one or more types of media content presented by the home automation system. A predictions process on the host controller selects a subset of the events of the history database based on a present condition of the home automation system to produce a predication dataset. A grammar process on a remote control or mobile device selects one or more intentions from a list used by a voice recognition engine, based on the prediction dataset. Each intention includes a key phrase paired with an action. A voice user interface (UI) process suggests key phrases from the one or more selected intentions in a voice control UI on the remote control or mobile device.
48 Citations
18 Claims
-
1. A method comprising:
-
building a history database on a storage device that maintains events that have occurred in a home automation system, each event associated with a time and indicating one or more services activated, one or more scenes activated or one or more types of media content presented by the home automation system; selecting a subset of the events of the history database based on a comparison of each event and associated time with a present condition of the home automation system and a present time, to produce a scored prediction dataset, wherein event scores in the scored prediction dataset are determined at least in part based on a frequency of each event within a time window, with a shorter time window causing a higher score than a longer time window; selecting one or more intentions from a list of intentions based on the event scores from the scored prediction dataset, wherein each intention from the list is recognized by a voice recognition engine and includes a key phrase paired with an action to be performed by the home automation system; displaying, to a current user of a remote control or mobile device of the home automation system in a user interface on the remote control or mobile device, one or more key phrases from the one or more selected intentions as one or more key phrase suggestions; receiving, at the voice recognition engine, speech input of the current user from a microphone of the remote control or mobile device; comparing, by the voice recognition engine, the speech input against the key phrases of the list of intentions to find a matching intention; and triggering the action associated with the matching intention, wherein the action controls one or more devices within a room of the home automation system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A home automation system comprising:
-
a host controller that is coupled to and configured to control one or more audio/video (A/V) devices, lighting devices, heating ventilation and cooling (HVAC) devices or security devices within a structure to provide home automation, the host controller including; host activity recording software stored on the host controller that is configured to build a history database that maintains events that have occurred in the structure, each event indicating one or more services activated, one or more scenes activated or one or more types of media content presented, and a predictions software process stored on the host controller that is configured to select a subset of the events of the history database based on a present condition of the home automation system and a frequency of each event within a time window to produce a scored prediction dataset that scores each event based at least in part on the time window, with a shorter time window causing a higher score than a longer time window; and a remote control or mobile device in communication with the host controller over a network, the remote control or mobile device including; a voice recognition engine stored on the remote control or mobile device, and voice suggestion software stored on the remote control or mobile device and configured to select one or more intentions from a list of intentions based on the event scores of the scored prediction dataset wherein each intention from the list is recognized by the voice recognition engine and includes a key phrase paired with an action to be performed by the home automation system, and display on a screen of the remote control or mobile device to a current user of the home automation system one or more key phrases from the one or more selected intentions as one or more key phrase suggestions, wherein the voice recognition engine includes a recognizer process that is configured to receive speech input of the current user from a microphone of the remote control or mobile device, compare the speech input against the key phrases of the list of intentions to find a matching intention, and trigger the action associated with the matching intention and wherein the action controls one or more devices within a room of the home automation system. - View Dependent Claims (12, 13, 14)
-
-
15. A non-transitory electronic-device readable medium storing software that when executed on one or more processors is operable to:
-
receive a scored prediction dataset that includes a frequency of events that occurred in a home automation system within a time window that prior to a present time, each event indicating one or more services activated, one or more scenes activated or one or more types of media content presented by the home automation system, wherein each event is scored, and a shorter time window causes a higher score than a longer time window; select one or more key phrases from a list of key phrases used by a voice recognition engine of the home automation system based on the event scores; display the selected one or more key phases on a remote control or mobile device of the home automation system to a user as one or more key phrase suggestions; receive speech input by the remote control or mobile device from the user corresponding to one of the one or more key phrase selections; compare the speech input against the list of key phrases used by the voice recognition engine to find a match; and trigger an action associated with the matching key phrase, wherein the action controls one or more devices within a room of the home automation system. - View Dependent Claims (16, 17, 18)
-
Specification