Method and system for interactive conversational dialogue for cognitively overloaded device users
First Claim
1. A dialog system, comprising:
- a memory circuit including a knowledge base to store device information regarding a plurality of devices and corresponding domains, and to categorize the information in at least one of a relational and an ontological manner, wherein the respective device information of each one of the plurality of devices is encapsulated in the knowledge base in isolation from all other device information in the knowledge base and from device-independent information in the knowledge base for plug-n-play of the domains; and
a processor configured to execute;
a speech recognition module to receive speech from a user and convert the speech into a word sequence, and to recognize at least one of full and partial proper names using a statistical model;
a natural language understanding module to identify meaning structures from the word sequence using a statistically dependent model of a selected one of the domains and based on the device information in the knowledge base regarding the domain, and to adjust a boundary of the at least one of the full and partial proper names without using the statistical model;
a dialogue management module to interpret the meaning structures in a context of the conversation using the device information in the knowledge base regarding the domain, and to construct a content of a response;
a device/application manager to interface between the plurality of devices and the dialogue management module;
a response generation module to select content and generate the response based on the context and grammatical rules; and
a speech synthesis module to synthesize speech wave forms for the response.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method to interactively converse with a cognitively overloaded user of a device, includes maintaining a knowledge base of information regarding the device and a domain, organizing the information in at least one of a relational manner and an ontological manner, receiving speech from the user, converting the speech into a word sequence, recognizing a partial proper name in the word sequence, identifying meaning structures from the word sequence using a model of the domain information, adjusting a boundary of the partial proper names to enhance an accuracy of the meaning structures, interpreting the meaning structures in a context of the conversation with the cognitively overloaded user using the knowledge base, selecting a content for a response to the cognitively overloaded user, generating the response based on the selected content, the context of the conversation, and grammatical rules, and synthesizing speech wave forms for the response.
-
Citations
30 Claims
-
1. A dialog system, comprising:
-
a memory circuit including a knowledge base to store device information regarding a plurality of devices and corresponding domains, and to categorize the information in at least one of a relational and an ontological manner, wherein the respective device information of each one of the plurality of devices is encapsulated in the knowledge base in isolation from all other device information in the knowledge base and from device-independent information in the knowledge base for plug-n-play of the domains; and a processor configured to execute; a speech recognition module to receive speech from a user and convert the speech into a word sequence, and to recognize at least one of full and partial proper names using a statistical model; a natural language understanding module to identify meaning structures from the word sequence using a statistically dependent model of a selected one of the domains and based on the device information in the knowledge base regarding the domain, and to adjust a boundary of the at least one of the full and partial proper names without using the statistical model; a dialogue management module to interpret the meaning structures in a context of the conversation using the device information in the knowledge base regarding the domain, and to construct a content of a response; a device/application manager to interface between the plurality of devices and the dialogue management module; a response generation module to select content and generate the response based on the context and grammatical rules; and a speech synthesis module to synthesize speech wave forms for the response. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A computer-implemented method of interactively conversing with a cognitively overloaded user of a device, the method comprising:
-
maintaining a knowledge base of information regarding the device and a domain; organizing the information in at least one of a relational manner and an ontological manner; receiving, by a processor of the computer, speech from the user; converting, by the processor, the speech into a word sequence; recognizing, by the processor, at least one of a full and partial proper name in the word sequence using a statistical model; identifying, by the processor, meaning structures from the word sequence using a model of the domain information; adjusting, by the processor, a boundary of the at least one of the full and partial proper names to enhance an accuracy of the meaning structures using a name database and without using the statistical model; interpreting, by the processor, the meaning structures in a context of the conversation with the cognitively overloaded user using the knowledge base; selecting, by the processor, a content for a response to the cognitively overloaded user; generating, by the processor, the response based on the selected content, the context of the conversation, and grammatical rules; and synthesizing speech wave forms for the response. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29)
-
-
30. A hardware-implemented storage medium having stored thereon a set of instructions executable by a processor to perform the following:
-
maintaining a knowledge base of information regarding a device and a domain; organizing the information in at least one of a relational manner and an ontological manner; receiving speech from a user of the device; converting the speech into a word sequence; recognizing a partial proper name in the word sequence using a statistical model; identifying meaning structures from the word sequence using a model of the domain information; adjusting a boundary of the partial proper names to enhance an accuracy of the meaning structures using a name database and without using the statistical model; interpreting the meaning structures in a context of the conversation with the user using the knowledge base; selecting a content for a response to the user; generating the response based on the selected content, the context of the conversation, and grammatical rules; and synthesizing speech wave forms for the response.
-
Specification