Arrangement for defining and processing voice enabled web applications using extensible markup language documents

• US 6,490,564 B1
• Filed: 02/09/2000
• Issued: 12/03/2002
• Est. Priority Date: 09/03/1999
• Status: Expired due to Term

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Ravishankar, Swaminathan, Danner, Ryan Alan, Joshi, Satish, Dodrill, Lewis Dean, Martin, Steven J., Ravishankar, Geetha, Basil, Keith M.
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): NOLAN, DANIEL A
• Application Number:
  US09/501,516
• Time in Patent Office: 1,028 Days
• Field of Search: 704/275, 704/270, 704/260, 704/243, 455/414, 705/52, 345/24, 717/107
• US Class Current: 704/275
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 2203/253 where a visual mode is used instead of a voice mode
• CPC Class Codes: H04M 2203/4509 Unified messaging with single point of access to voicemail and other mail or messaging systems unified messaging in packet switching networks H04L51/56
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: H04M 3/53 Centralised arrangements for recording incoming messages , i.e. mailbox systems
• CPC Class Codes: H04M 3/5307 for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04M 3/533 Voice mail systems
• CPC Class Codes: H04M 7/12 for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal

Abstract

A unified web-based voice messaging system provides voice application control between a web browser and an application server via an hypertext transport protocol (HTTP) connection on an Internet Protocol (IP) network. The application server executes the voice-enabled web application by runtime execution of extensible markup language (XML) documents that define the voice-enabled web application to be executed. Each voice application operation can be defined as any one of a user interface operation, a logic operation, or a function operation. Each XML document includes XML tags that specify the user interface operation, the logic operation and/or the function operation to be performed within a corresponding voice application operation, the XML tags being based on prescribed rule sets that specify the executable functions to be performed by the application runtime environment.

Claims

1. A method in an executable system for defining an executable voice application, the method comprising:

defining a sequence of voice application operations to be performed by the voice application, each voice application operation corresponding to at least one of a user interface operation, a logic operation, and a function operation;

generating extensible markup language (XML) documents for the voice application operations, respectively, using a prescribed rule set for each of the user interface operation, the logic operation, and the function operation, the rule set specifying executable functions to be performed by an application runtime environment for the corresponding operation, the generating step including;

(1) providing at least one XML tag that specifies a corresponding one of the user interface operation, logic operation, and function operation in accordance with the corresponding rule set, and (2) selectively including in each XML document a reference to another one of the XML documents based on the sequence of voice application operations and the corresponding rule set; and

storing the XML documents for execution of the voice application by an application server in the application runtime environment.

2. The method of claim 1, wherein the generating step includes generating a menu XML document specifying performance of a first logic operation based on a user input.

3. The method of claim 2, wherein the generating step further includes generating an activity XML document specifying performance of a second logic operation based on a returned value from an executed procedure evaluating a second user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

4. The method of claim 3, wherein the step of generating an activity XML document includes specifying an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

5. The method of claim 3, wherein the step of generating an activity XML document further includes providing option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the second user input.

6. The method of claim 5, wherein the prescribed user inputs correspond to hotkey user inputs.

7. The method of claim 2, wherein the step of generating a menu document includes adding a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding value for the user input, the application runtime environment executing the first logic operation by selecting one of the XML documents for execution based on the corresponding value for the user input.

8. The method of claim 1, wherein the generating step includes generating a decision XML document specifying performance of the first logic operation based on a returned value from an executed procedure, the decision XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

9. The method of claim 8, wherein the step of generating a decision XML document includes adding a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding prescribed returned value from the executed procedure, the first logic operation selecting one of the XML documents for execution based on reception of the corresponding prescribed returned value from the executed procedure.

10. The method of claim 8, wherein the prescribed rule set for the action XML tag for the decision XML document specifies performing the first function operation independent of any user input.

11. The method of claim 1, wherein the generating step includes generating an activity XML document specifying performance of a first logic operation based on a returned value from an executed procedure evaluating a user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

12. The method of claim 11, wherein the step of generating an activity XML document includes specifying an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

13. The method of claim 11, wherein the step of generating an activity XML document further includes providing option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the user input.

14. The method of claim 13, wherein the prescribed user inputs correspond to hotkey user inputs.

15. The method of claim 1, wherein the generating step includes generating a user menu XML document that specifies user menu media information to be supplied to the user.

16. The method of claim 1, further comprising defining the rule sets for each of the user interface operation, the logic operation, and the function operation.

17. A system configured for generating a voice application, the system including:

a computer-based system configured for generating extensible markup language (XML) documents for a defined sequence of voice application operations to be performed by the voice application, respectively, each voice application operation corresponding to at least one of a user interface operation, a logic operation, and a function operation using a corresponding prescribed rule set, the rule set specifying executable functions to be performed by an application runtime environment for the corresponding operation, each XML document including (1) at least one XML tag that specifies a corresponding one of the user interface operation, logic operation, and function operation in accordance with the corresponding rule set, and selectively including (2) a reference to another one of the XML documents based on the sequence of voice application operations and the corresponding rule set; and

a storage medium configured for storing the XML documents for execution of the voice application by an application server in the application runtime environment.

18. The system of claim 17, wherein the computer-based system generates a menu XML document specifying performance of a first logic operation based on a user input.

19. The system of claim 18, wherein the computer-based system generates an activity XML document specifying performance of a second logic operation based on a returned value from an executed procedure evaluating a second user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

20. The system of claim 19, wherein the computer-based system includes in the activity XML document an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

21. The system of claim 19, wherein the computer-based system includes in the activity XML document a plurality of option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the second user input.

22. The system of claim 21, wherein the prescribed user inputs correspond to hotkey user inputs.

23. The system of claim 18, wherein the computer-based system includes in the menu XML document a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding value for the user input, the application runtime environment executing the first logic operation by selecting one of the XML documents for execution based on the corresponding value for the user input.

24. The system of claim 17, wherein the computer-based system generates a decision XML document specifying performance of the first logic operation based on a returned value from an executed procedure, the decision XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

25. The system of claim 24, wherein the computer-based system includes in the decision XML document a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding prescribed returned value from the executed procedure, the first logic operation selecting one of the XML documents for execution based on reception of the corresponding prescribed returned value from the executed procedure.

26. The system of claim 24, wherein the prescribed rule set for the action XML tag for the decision XML document specifies performing the first function operation independent of any user input.

27. The system of claim 17, wherein computer-based system generates an activity XML document specifying performance of a first logic operation based on a returned value from an executed procedure evaluating a user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

28. The system of claim 27, wherein the computer-based system includes in the activity XML document an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

29. The system of claim 27, wherein the computer-based system includes in the activity XML document a plurality of option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the user input.

30. The system of claim 29, wherein the prescribed user inputs correspond to hotkey user inputs.

31. The system of claim 17, wherein the computer-based system generates a user menu XML document that specifies user menu media information to be supplied to the user.

32. The system of claim 17, wherein the computer-based system defines the rule sets for each of the user interface operation, the logic operation, and the function operation.

33. A computer readable medium having stored thereon sequences of instructions for defining a voice application, the sequences of instructions including instructions for performing the steps of:

defining a sequence of voice application operations to be performed by the voice application, each voice application operation corresponding to at least one of a user interface operation, a logic operation, and a function operation;

generating extensible markup language (XML) documents for the voice application operations, respectively, using a prescribed rule set for each of the user interface operation, the logic operation, and the function operation, the rule set specifying executable functions to be performed by an application runtime environment for the corresponding operation, the generating step including;

(1) providing at least one XML tag that specifies a corresponding one of the user interface operation, logic operation, and function operation in accordance with the corresponding rule set, and (2) selectively including in each XML document a reference to another one of the XML documents based on the sequence of voice application operations and the corresponding rule set; and

storing the XML documents for execution of the voice application by an application server in the application runtime environment.

34. The medium of claim 33, wherein the generating step includes generating a menu XML document specifying performance of a first logic operation based on a user input.

35. The medium of claim 34, wherein the generating step further includes generating an activity XML document specifying performance of a second logic operation based on a returned value from an executed procedure evaluating a second user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

36. The medium of claim 35, wherein the step of generating an activity XML document includes specifying an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

37. The medium of claim 35, wherein the step of generating an activity XML document further includes providing option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the second user input.

38. The medium of claim 37, wherein the prescribed user inputs correspond to hotkey user inputs.

39. The medium of claim 34, wherein the step of generating a menu document includes adding a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding value for the user input, the application runtime environment executing the first logic operation by selecting one of the XML documents for execution based on the corresponding value for the user input.

40. The medium of claim 33, wherein the generating step includes generating a decision XML document specifying performance of the first logic operation based on a returned value from an executed procedure, the decision XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

41. The medium of claim 40, wherein the step of generating a decision XML document includes adding a plurality of option XML tags, each specifying a corresponding XML document for execution in response to a corresponding prescribed returned value from the executed procedure, the first logic operation selecting one of the XML documents for execution based on reception of the corresponding prescribed returned value from the executed procedure.

42. The medium of claim 40, wherein the prescribed rule set for the action XML tag for the decision XML document specifies performing the first function operation independent of any user input.

43. The medium of claim 33, wherein the generating step includes generating an activity XML document specifying performance of a first logic operation based on a returned value from an executed procedure evaluating a user input, the activity XML document including an action XML tag specifying performance of a first function operation that specifies calling the executed procedure, the application runtime environment executing the executable functions corresponding to calling the executed procedure.

44. The medium of claim 43, wherein the step of generating an activity XML document includes specifying an input XML tag that specifies a first one of the other XML documents for execution in response to the returned value specifying a successful condition, and a fallback XML tag that specifies a second one of the other XML documents for execution in response to the returned value specifying a fallback condition.

45. The medium of claim 43, wherein the step of generating an activity XML document further includes providing option XML tags specifying bypassing the second logic operation and performing a third logic operation in response to receiving one of a group of prescribed user inputs as the user input.

46. The medium of claim 45, wherein the prescribed user inputs correspond to hotkey user inputs.

47. The medium of claim 33, wherein the generating step includes generating a user menu XML document that specifies user menu media information to be supplied to the user.

48. The medium of claim 33, further comprising instructions for performing the step of defining the rule sets for each of the user interface operation, the logic operation, and the function operation.