TECHNOLOGIES FOR CONVERSATIONAL INTERFACES FOR SYSTEM CONTROL

• US 20160378080A1
• Filed: 06/25/2015
• Published: 12/29/2016
• Est. Priority Date: 06/25/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Uppala, Anantha Deepthi, Jackson, Kara E., Cobbley, David J., Dickinson, Andrew S., Pandit, Milind, Yarvis, Mark D.
• Granted Patent: US 10,274,911 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Technologies for conversational control of a home automation system include a computing device in communication with one or more home automation devices. The computing device receives text input indicative of a spoken user request including one or more parameters associated with a home automation command. The computing device matches the text input against a home automation language model including several predefined dialog patterns. The computing device resolves parameters of the command using a context model. The computing device may resolve the location, device, or requested device state of the command. The computing device generates a text response and a home automation command using the language model, and then presents the text response to the user and performs the home automation command using the home automation devices. In some embodiments, the computing device may control an application automation system or a data exploration system. Other embodiments are described and claimed.

Claims

1. A computing device for conversational system control, the computing device comprising:

a controller module to receive input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command;

a conversational interface module to match the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of patterns and wherein the matching pattern is associated with the system control command; and

a context management module to determine one or more of the parameters of the system control command based on a context model in response to a match of the input text;

wherein the conversational interface module is further to generate the system control command based on the language model in response to a determination of the one or more parameters; and

wherein the controller module is further to perform the system control command.

2. The computing device of claim 1, wherein:

the matching pattern is further associated with text response;

the conversational interface module is further to generate the text response based on the language model; and

the controller module is further to present the text response to a user of the computing device.

3. The computing device of claim 1, further comprising:

an automated speech recognition module to perform automated speech recognition to generate the input text; and

a text-to-speech module to generate speech output based on the text response with a text-to-speech engine.

4. The computing device of claim 1, wherein:

the system control command comprises a home automation command;

the one or more parameters of the home automation command include a location, a device, or a requested device state; and

the context model includes conversational context data, user context data, and home automation device context data.

5. The computing device of claim 4, wherein to determine the one or more of the parameters of the home automation command based on the context model comprises to determine a location parameter, a device parameter, or a device state parameter of the home automation command based on the conversational context data.

6. The computing device of claim 4, wherein to determine the one or more of the parameters of the home automation command based on the context model comprises to determine a location parameter of the home automation command based on the user context data.

7. The computing device of claim 4, wherein to determine the one or more of the parameters of the home automation command based on the context model comprises to determine a device parameter or a device state parameter of the home automation command based on the home automation device context data.

8. The computing device of claim 4, wherein the context management module is further to update the context model based on data received from a home automation system.

9. The computing device of claim 4, wherein:

the controller module is further to determine whether the home automation command is valid based on the home automation device context data of the context model in response to the determination of the one or more parameters of the home automation command; and

the conversational interface module is to generate an error message for the text response with the language model in response to a determination that the home automation command is not valid;

wherein to generate the system control command based on the language model comprises to generate the home automation command in response to a determination that the home automation command is valid.

10. The computing device of claim 4, further comprising a learning module to:

observe a change in device state of a home automation system in response to performance of the home automation command;

generate a new pattern based on the input text, wherein the pattern is associated with the home automation command; and

update the language model to include the new pattern.

11. The computing device of claim 1, wherein:

the system control command comprises an application control command;

the one or more parameters of the application control command include an application user command or an application object; and

the context model includes conversational context data and application context data.

12. The computing device of claim 1, wherein:

the system control command comprises a data exploration command;

the one or more parameters of the data exploration command include a data query parameter; and

the context model includes conversational context data and query context data.

13. A method for conversational system control, the method comprising:

receiving, by a computing device, input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command;

matching, by the computing device, the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of patterns and wherein the matching pattern is associated with the system control command;

determining, by the computing device, one or more of the parameters of the system control command using a context model in response to matching the input text;

generating, by the computing device, the system control command using the language model in response to determining the one or more parameters; and

performing, by the computing device, the system control command.

14. The method of claim 13, further comprising:

generating, by the computing device, a text response using the language model in response to determining the one or more parameters, wherein the matching pattern is associated with the text response; and

presenting, by the computing device, the text response to a user of the computing device.

15. The method of claim 13, wherein:

the system control command comprises a home automation command;

the one or more parameters of the home automation command include a location, a device, or a requested device state; and

the context model includes conversational context data, user context data, and home automation device context data.

16. The method of claim 15, further comprising:

determining, by the computing device, whether the home automation command is valid based on the home automation device context data of the context model in response to determining the one or more parameters of the home automation command; and

generating, by the computing device, an error message for the text response using the language model in response to determining that the home automation command is not valid;

wherein generating the system control command based on the language model comprises generating the home automation command in response to determining that the home automation command is valid.

17. The method of claim 15, further comprising:

observing, by the computing device, a change in device state of a home automation system in response to performing the home automation command;

generating, by the computing device, a new pattern based on the input text, wherein the pattern is associated with the home automation command; and

updating, by the computing device, the language model to include the new pattern.

18. One or more computer-readable storage media comprising a plurality of instructions that in response to being executed cause a computing device to:

receive input text indicative of a spoken user request, wherein the spoken user request includes one or more parameters associated with a system control command;

match the input text against a language model to identify a matching pattern, wherein the language model includes a plurality of patterns and wherein the matching pattern is associated with the system control command;

determine one or more of the parameters of the system control command using a context model in response to matching the input text;

generate the system control command using the language model in response to determining the one or more parameters; and

perform the system control command.

19. The one or more computer-readable storage media of claim 18, further comprising a plurality of instructions that in response to being executed cause the computing device to:

generate a text response using the language model in response to determining the one or more parameters, wherein the matching pattern is associated with the text response; and

present the text response to a user of the computing device.

20. The one or more computer-readable storage media of claim 18, wherein:

the system control command comprises a home automation command;

the one or more parameters of the home automation command include a location, a device, or a requested device state; and

the context model includes conversational context data, user context data, and home automation device context data.

21. The one or more computer-readable storage media of claim 20, wherein to determine the one or more of the parameters of the home automation command using the context model comprises to determine a location parameter, a device parameter, or a device state parameter of the home automation command based on the conversational context data.

22. The one or more computer-readable storage media of claim 20, wherein to determine the one or more of the parameters of the home automation command using the context model comprises to determine a location parameter of the home automation command based on the user context data.

23. The one or more computer-readable storage media of claim 20, wherein to determine the one or more of the parameters of the home automation command using the context model comprises to determine a device parameter or a device state parameter of the home automation command based on the home automation device context data.

24. The one or more computer-readable storage media of claim 20, further comprising a plurality of instructions that in response to being executed cause the computing device to:

determine whether the home automation command is valid based on the home automation device context data of the context model in response to determining the one or more parameters of the home automation command; and

generate an error message for the text response using the language model in response to determining that the home automation command is not valid;

wherein to generate the system control command based on the language model comprises to generate the home automation command in response to determining that the home automation command is valid.

25. The one or more computer-readable storage media of claim 20, further comprising a plurality of instructions that in response to being executed cause the computing device to:

observe a change in device state of a home automation system in response to performing the home automation command;

generate a new pattern based on the input text, wherein the pattern is associated with the home automation command; and

update the language model to include the new pattern.