System and method of providing a spoken dialog interface to a website

• US 7,580,842 B1
• Filed: 10/30/2007
• Issued: 08/25/2009
• Est. Priority Date: 12/18/2002
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Feng, Junlan, Bangalore, Srinivas, Rahim, Mazin G.
• Primary Examiner(s): Smits, Talivaldis Ivars
• Application Number:
  US11/928,886
• Time in Patent Office: 665 Days
• Field of Search: None
• US Class Current: 704/270.1
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00

Abstract

Disclosed is a system and method for generating a spoken dialog service from website data. Spoken dialog components typically include an automatic speech recognition module, a language understanding module, a dialog management module, a language generation module and a text-to-speech module. These components are capable of being automatically trained from processed website data. A website analyzer converts a website into structured text data set and a structured task knowledge base. The website analyzer further extracts linguistic items from the website data. The dialog components are automatically trained from the structured text data set, structured task knowledge base and linguistic items.

Claims

1. A system for generating data for use in a spoken dialog service, the system comprising:

a module configured to convert data from a structured database to a structured text data set and a structured task knowledge base for use by at least one of a plurality of spoken dialog service components;

a module configured to extract linguistic items from the structured database for use by at least one of the plurality of spoken dialog service components; and

a module configured to automatically generate a spoken dialog service by training each of the plurality of spoken dialog service components using at least one of the structured text data, the structured task knowledge base or the linguistic items.

2. The system of claim 1, wherein the structured text data set and the structured task knowledge base are used by a language understanding module, a language generation module and a dialog manager module spoken dialog service components.

3. The system of claim 1, where the linguistic items from the data are used for building a language model used for training an automatic speech recognition module.

4. The system of claim 3, wherein the linguistic items comprise named-entities.

5. The system of claim 4, wherein the structured text data further comprises nominal, verbal and adjectival phrases.

6. The system of claim 1, wherein the structured text data comprises a hierarchical tree.

7. The system of claim 6, wherein the hierarchical tree comprises a plurality of non-leaf tree nodes having a node alias that is human understandable.

8. The system of claim 7, wherein each non-leaf tree node further comprises a verbose description document and a concise summary.

9. The system of claim 8, wherein the verbose description document and concise summary are used for information matching and help prompt construction during dialog execution.

10. The system of claim 6, wherein the hierarchical tree further comprises at least one leaf node corresponding to a webpage.

11. The system of claim 10, wherein each leaf node further contains a list of information units associated with the webpage.

12. The system of claim 11, wherein the list of information units further comprises product and service names, product descriptions and service definitions.

13. The system of claim 12, wherein the list of information units further comprises explanations of acronyms and frequently asked questions.

14. A spoken dialog interface to the website, generated according to a method comprising:

encoding each webpage in a website as a sequence of feature vectors;

detecting boundaries between information units on each webpage; and

classifying information blocks organized according to the detected boundaries between information units into information class symbols, wherein the classified information blocks are utilized for generating a spoken dialog interface to the website.

15. The spoken dialog interface of claim 14, wherein the step of detecting boundaries is performed using one of a binary information retrieval classifier or a binary support vector machine classifier.

16. A computer-readable medium storing instructions for controlling a computing device to generate a spoken dialog interface, the instructions comprising:

encoding each webpage in a website as a sequence of feature vectors;

detecting boundaries between information units on each webpage; and

classifying information blocks organized according to the detected boundaries between information units into information class symbols, wherein the classified information blocks are utilized for generating a spoken dialog interface to the website.

17. The computer-readable medium of claim 16, wherein the step of detecting boundaries is performed using on of a binary information retrieval classifier or a binary support vector machine classifier.