Conversational interface for matching text of spoken input based on context model
First Claim
1. A computing device for conversational system control, the computing device comprising:
- a controller module to receive input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command for a controlled system;
a conversational interface module to match the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of dialog patterns, wherein the dialog patterns are arranged hierarchically to define one or more dialogs, and wherein each dialog pattern, when evaluated against the input text, determines whether the input text matches the corresponding dialog pattern, and wherein the matching pattern is associated with the system control command; and
a context management module to determine one or more of the parameters of the system control command based on a context model in response to a match of the input text;
wherein the conversational interface module is further to generate the system control command based on the language model in response to a determination of the one or more parameters; and
wherein the controller module is further to perform the system control command to cause a change in system state of the controlled system, wherein the controlled system comprises a home automation system, and wherein the change in the system state comprises a change in device state of a device of the home automation system, wherein the device state comprises an activation state of the device or a set point of the device;
wherein the computing device further comprises a learning module to (i) observe the change in the system state of the controlled system in response to performance of the system control command, (ii) generate a new dialog pattern based on the input text and the change in the device state, wherein the new dialog pattern is associated with the system control command, and (iii) update the language model to include the new dialog pattern.
1 Assignment
0 Petitions
Accused Products
Abstract
Technologies for conversational control of a home automation system include a computing device in communication with one or more home automation devices. The computing device receives text input indicative of a spoken user request including one or more parameters associated with a home automation command. The computing device matches the text input against a home automation language model including several predefined dialog patterns. The computing device resolves parameters of the command using a context model. The computing device may resolve the location, device, or requested device state of the command. The computing device generates a text response and a home automation command using the language model, and then presents the text response to the user and performs the home automation command using the home automation devices. In some embodiments, the computing device may control an application automation system or a data exploration system. Other embodiments are described and claimed.
32 Citations
20 Claims
-
1. A computing device for conversational system control, the computing device comprising:
-
a controller module to receive input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command for a controlled system; a conversational interface module to match the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of dialog patterns, wherein the dialog patterns are arranged hierarchically to define one or more dialogs, and wherein each dialog pattern, when evaluated against the input text, determines whether the input text matches the corresponding dialog pattern, and wherein the matching pattern is associated with the system control command; and a context management module to determine one or more of the parameters of the system control command based on a context model in response to a match of the input text; wherein the conversational interface module is further to generate the system control command based on the language model in response to a determination of the one or more parameters; and wherein the controller module is further to perform the system control command to cause a change in system state of the controlled system, wherein the controlled system comprises a home automation system, and wherein the change in the system state comprises a change in device state of a device of the home automation system, wherein the device state comprises an activation state of the device or a set point of the device; wherein the computing device further comprises a learning module to (i) observe the change in the system state of the controlled system in response to performance of the system control command, (ii) generate a new dialog pattern based on the input text and the change in the device state, wherein the new dialog pattern is associated with the system control command, and (iii) update the language model to include the new dialog pattern. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for conversational system control, the method comprising:
-
receiving, by a computing device, input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command for a controlled system; matching, by the computing device, the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of dialog patterns, wherein the dialog patterns are arranged hierarchically to define one or more dialogs, and wherein each dialog pattern, when evaluated against the input text, determines whether the input text matches the corresponding dialog pattern, and wherein the matching pattern is associated with the system control command; determining, by the computing device, one or more of the parameters of the system control command using a context model in response to matching the input text; generating, by the computing device, the system control command using the language model in response to determining the one or more parameters; performing, by the computing device, the system control command to cause a change in system state of the controlled system, wherein the controlled system comprises a home automation system, and wherein the change in the system state comprises a change in device state of a device of the home automation system, wherein the device state comprises an activation state of the device or a set point of the device; observing, by the computing device, the change in the system state of the controlled system in response to performing the system control command; generating, by the computing device, a new dialog pattern based on the input text and the change in the system state, wherein the new dialog pattern is associated with the system control command; and updating, by the computing device, the language model to include the new dialog pattern. - View Dependent Claims (11, 12, 13)
-
-
14. One or more non-transitory, computer-readable storage media comprising a plurality of instructions that in response to being executed cause a computing device to:
-
receive input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command for a controlled system; match the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of dialog patterns, wherein the dialog patterns are arranged hierarchically to define one or more dialogs, and wherein each dialog pattern, when evaluated against the input text, determines whether the input text matches the corresponding dialog pattern, and wherein the matching pattern is associated with the system control command; determine one or more of the parameters of the system control command using a context model in response to matching the input text; generate the system control command using the language model in response to determining the one or more parameters; perform the system control command to cause a change in system state of the controlled system, wherein the controlled system comprises a home automation system, and wherein the change in the system state comprises a change in device state of a device of the home automation system, wherein the device state comprises an activation state of the device or a set point of the device; observe the change in the system state of the controlled system in response to performing the system control command; generate a new dialog pattern based on the input text and the change in the system state, wherein the new dialog pattern is associated with the system control command; and update the language model to include the new dialog pattern. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification