Web-based speech recognition with scripting and semantic objects

• US 8,510,412 B2
• Filed: 09/06/2011
• Issued: 08/13/2013
• Est. Priority Date: 03/24/2000
• Status: Expired due to Term

• Current Assignee: Eliza Corporation (Gainwell Technologies)
• Original Assignee: Eliza Corporation (Gainwell Technologies)
• Inventors: Kroeker, John, Boulanov, Oleg
• Primary Examiner(s): Colin, Carl
• Assistant Examiner(s): Siddiqi, Mohammad A
• Application Number:
  US13/225,791
• Publication Number:
  US 20110320188A1
• Time in Patent Office: 707 Days
• Field of Search: 704/9, 704/251, 704/257, 704/270, 709/217, 709/218
• US Class Current: 709/217
• CPC Class Codes: G06F 40/211 Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/14 using statistical models, e.g. Hidden Markov Models [HMMs] G10L15/18 takes precedence
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

The present invention is a system and method for creating and implementing transactional speech applications (SAs) using Web technologies, without reliance on server-side standard or custom services. A transactional speech application may be any application that requires interpretation of speech in conjunction with a speech recognition (SR) system, such as, for example, consumer survey systems. A speech application in accordance with the present invention is represented within a Web page, as an application script that interprets semantic objects according to a context. Any commonly known scripting language can be used to write the application script, such as JavaScript (or ECMAScript), PerlScript, and VBscript. The present invention is “Web-based” to the extent that it implements Web technologies, but it need not include or access the World Wide Web.

Claims

1. A speech application computer system having access to database;

comprising;

A. a speech recognition (SR) hardware computer system configured to receive an audio input and generate a context-independent semantic tree for semantic data representing a plurality of valid interpretations of said audio input;

B. a set of speech application scripts, loaded at the SR hardware computer system and configured to task said SR hardware computer system, said set of application scripts defining a context;

C. a semantic tree evaluator program, configured to receive said set of semantic data and said context and, as a function thereof, to generate a linguistic result corresponding to said audio input, and to return said linguistic result to said set of application scripts; and

D. a set of reusable object oriented interfaces local to the SR hardware computer system, said interfaces configured to interface said one or more of said set of application scripts with said SR hardware computer system.

2. A system as in claim 1, wherein one or more of said set of application scripts is implemented on an extended HTML Web page.

3. A system as in claim 1, wherein one or more of said interfaces are objects exposed via scripting facilities.

4. A system as in claim 1, wherein said application script includes programming code written in a language chosen from a group of scripting languages comprising:

(1) JavaScript;

(2) PerlScript;

(3) VBscript; and

(4) ECMAScript.

5. A system as in claim 1, wherein said set of semantic data is represented as a semantic tree instance.

6. A system as in claim 1, wherein said set of semantic data is represented in a semantic object.

7. A system as in claim 1, wherein said audio input is received from a device chosen from a group comprising:

A. a telephone;

B. a cellular telephone;

C. a personal computer;

D. an application server;

E. an audio receiver; and

F. VoIP client.

8. A system as in claim 1, wherein said audio input is received via a network comprised of one or more wire or wireless networks from a group comprising:

A. a telephone network;

B. a cellular telephone network;

C. a LAN;

D. a WAN;

E. a virtual private network;

F. the Internet; and

G. the Web.

9. A system as in claim 1, wherein said plurality of valid interpretations of said audio input includes all valid interpretations of said audio input within said context.

10. A system as in claim 1, wherein speech application is chosen from a group of interactive speech applications comprising:

A. consumer survey applications;

B. Web access applications;

C. educational applications, including health education applications and computer-based lesson applications and testing applications;

D. screening applications, including patient screening applications and consumer screening applications;

E. health risk assessment applications;

F. monitoring applications, including heath data monitoring applications and consumer preference monitoring applications;

G. compliance applications, including applications that generate notifications of compliance related activities, including notifications regarding health or product maintenance;

H. test results applications, including applications that provide at least one of lab test results, standardized tests results, consumer product test results, and maintenance results; and

I. linking applications, including applications that link two or more of the applications in parts A through H.

11. A speech application computer system comprising:

A. a first computer hosting a speech recognition (SR) system and configured to receive an audio input from an input device and to generate a context-independent semantic tree for one or more semantic objects representing a plurality of valid interpretations of said audio input;

B. a Web page loaded on said first computer, from a second computer, said Web page including an application script comprising a set of speech application functionality and configured to interact with said input device via said SR system, wherein said speech application is configured to conduct speech application sessions without accessing said second computer;

C. a set of reusable object oriented interfaces local to the first computer, said interfaces including;

(1) one or more interface objects configured to facilitate access by said application script to standard services of said first computer; and

(2) an interface configured to facilitate access to and control of said SR system by said application script; and

D. a semantic tree evaluator program, configured to generate from said semantic objects, as a function of said context, a single interpretation of said audio input and to return said single interpretation to said application script.

12. A system as in claim 11, wherein speech application is chosen from a group of interactive speech applications comprising:

A. consumer survey applications;

B. Web access applications;

C. educational applications, including health education applications and computer-based lesson applications and testing applications;

D. screening applications, including patient screening applications and consumer screening applications;

E. health risk assessment applications;

F. monitoring applications, including heath data monitoring applications and consumer preference monitoring applications;

G. compliance applications, including applications that generate notifications of compliance related activities, including notifications regarding health or product maintenance;

H. test results applications, including applications that provide at least one of lab test results, standardized tests results, consumer product test results, and maintenance results; and

I. linking applications, including applications that link two or more of the applications in parts A through H.

13. A system as in claim 11, wherein said set of reusable object oriented interfaces and said semantic object evaluator are objects exposed via ActiveX facilities.

14. A method of performing a speech application session, wherein a SR system is hosted on a first computer and includes a means to receive an audio input, said method comprising:

A. receiving said audio input by said SR system;

B. loading a Web page including an application script on said first computer, said application script including a set of functionality configured to manage a speech application session and control said SR system, without accessing functionality from a second computer;

C. establishing a set of standard interfaces between said SR system and said application script, including establishing a semantic evaluator;

D. in response to tasking by said application script, generating by said SR system a context-independent semantic tree for one or more semantic objects representing all possible interpretations of said audio input;

E. in response to receiving a context defined by said application script, determining by said semantic evaluator a single semantic interpretation from said one or more semantic objects; and

F. determining a next action by said application script as a function of said single semantic interpretation.