Method and system for extending dialog systems to process complex activities for applications

• US 9,082,406 B2
• Filed: 11/30/2006
• Issued: 07/14/2015
• Est. Priority Date: 11/30/2006
• Status: Active Grant

• Current Assignee: Robert Bosch LLC (Robert Bosch GmbH)
• Original Assignee: Robert Bosch LLC (Robert Bosch GmbH)
• Inventors: Shen, Zhongnan, Weng, Fuliang, Meng, Yao, Raya, Madhuri
• Primary Examiner(s): ROBERTS, SHAUN A
• Application Number:
  US11/607,497
• Publication Number:
  US 20080134058A1
• Time in Patent Office: 3,148 Days
• Field of Search: 704/270, 704/275, 704/257
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/016 After-sales
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command

Abstract

A dialog system that includes a dialog manager to manage a conversation between the dialog system and a user, and to associate the conversation with a complex activity, and a plan engine to execute a plan script in connection with the complex activity, the plan script including a set of atomic dialog activities and logic to control a data and sequence flow of the atomic dialog activities, the set of atomic dialog activities being sub-activities of the complex activity, the complex activity being specified via a declarative activity specification language that connects the atomic dialog activities with a process.

Claims

1. A dialog system that uses a dialog move tree to manage a conversation between the dialog system and a user, comprising:

a dialog manager to associate the conversation with a complex activity; and

a plan engine to execute a plan script in connection with the complex activity, the plan script including a set of atomic dialog activities and logic to control a data and sequence flow of the atomic dialog activities, the set of atomic dialog activities being sub-activities of the complex activity,

wherein;

the dialog move tree forms a structured history of dialog moves performed by the dialog system and the user in the conversation;

the dialog manager dynamically adds to the dialog move tree a node for each occurrence of an atomic dialog activity of the set of atomic dialog activities; and

the complex activity is specified via a declarative activity specification language that connects the atomic dialog activities with a process.

2. The dialog system of claim 1, wherein the process is related to at least one of a web service and a business process.

3. The dialog system of claim 2, wherein the plan engine is configured to interact with a process engine that executes a process script in connection with the process, the process script including a set of atomic process activities and corresponding order constraints of the atomic process activities, the set of atomic process activities being sub-activities of the process.

4. The dialog system of claim 3, wherein the plan script defines a sequence of a combination of the set of atomic dialog activities and a set of triggers for triggering the process engine to execute portions of the process script.

5. The dialog system of claim 4, wherein the plan script defines activities via tags that include an element for assigning to a variable a value copied from a slot of a dialog move.

6. The dialog system of claim 5, wherein the tags are XML tags that hierarchically define the activities.

7. The dialog system of claim 4, wherein the plan script hierarchically defines activities via tags that include an element for assigning to various hierarchical levels of the hierarchically defined activities a value copied from a slot of a dialog move.

8. The dialog system of claim 7, wherein the tags are XML tags.

9. The dialog system of claim 4, wherein the plan script defines activities via tags that include an element for selecting between various activities depending on a newest node included in the dialog move tree.

10. The dialog system of claim 9, wherein the tags are XML tags that hierarchically define the activities.

11. The dialog system of claim 3, wherein the process script conforms to a standard XML-based language designed to accomplish tasks across multiple organizations in a distributed computing environment using a combination of Web services.

12. The dialog system of claim 3, wherein the process script conforms to BPEL4WS (Business Process Execution Language for Web Services).

13. The dialog system of claim 1, wherein the dialog manager is configured to interpret semantically incoming user requests and utterances, and perform an appropriate action on a device controlled by the dialog system.

14. The dialog system of claim 1, wherein the dialog manager is configured to maintain a history and current context of the conversation.

15. The dialog system of claim 14, wherein the dialog manager maintains the history and current context via a structure to store the atomic dialog activities as conversational threads.

16. The dialog system of claim 1, wherein the dialog manager is configured to at least one of provide a report to a user, ask a question, and obtain a parameter value from the user.

17. The dialog system of claim 1, wherein the dialog move tree represents a dynamic state of interactions between the user and the dialog system.

18. The dialog system of claim 1, wherein each time the user inputs an utterance with which the dialog manager associates a new complex activity that includes at least one atomic dialog activity, the dialog manager adds at least one node in the dialog move tree, each one of the at least one node corresponding to a respective one of the at least one atomic dialog activity.

19. The dialog system of claim 1, wherein each time the dialog system responds to a user request associated with a new complex activity that includes at least one atomic dialog activity, the dialog manager adds at least one node in the dialog movement tree, each one of the at least one node corresponding to a respective one of the at least one atomic dialog activity.

20. The dialog system of claim 1, wherein the set of atomic dialog activities for which representative nodes are dynamically added to the dialog move tree includes (a) an activity corresponding to a user utterance associated with a previous or new complex activity and (b) an activity corresponding to a speech output by the dialog system according to the plan script.

21. The dialog system of claim 1, wherein:

the nodes are hierarchically organized in the dialog move tree, and

for each of at least a subset of the nodes of the dialog move tree, dialog manager determines to which of plurality of dialog moves represented by nodes previously added to the dialog move tree the respective node relates, and adds the respective node as a child of the determined node.

22. The dialog system of claim 21, wherein the dialog manager refers to the dialog move tree for applying a context to a received user utterance and to determine a speech construct to output.

23. The dialog system of claim 21, wherein the dialog manager determines that a node is related as a child to another node by determining that a dialog move to which the node corresponds is provided as a response to a dialog move to which the another node corresponds.

24. The method of claim 1, further comprising:

at least one of providing a report to a user, asking a question, and obtaining a parameter value from the user.

28. The method of claim 24, wherein the dialog move tree represents a dynamic state of interactions between the user and the dialog system.

25. A dialog system that uses a dialog move tree to manage a conversation between the dialog system and a user, comprising:

a dialog manager to associate the conversation with a complex activity, the dialog manager being configured to interpret semantically incoming user requests and utterances, and perform an appropriate action on a device controlled by the dialog system; and

a plan engine to execute a plan script in connection with the complex activity, the plan script including a set of atomic dialog activities and logic to control a data and sequence flow of the atomic dialog activities, the set of atomic dialog activities being sub-activities of the complex activity;

wherein;

the dialog move tree forms a structured history of dialog moves performed by the dialog system and the user in the conversation;

the dialog manager dynamically adds to the dialog move tree a node for each occurrence of an atomic dialog activity of the set of atomic dialog activities;

the complex activity is specified via a declarative activity specification language that connects the atomic dialog activities with a process related to at least one of a web service and a business process; and

the plan engine is configured to interact with a process engine that executes a process script in connection with the process, the process script including a set of atomic process activities and corresponding order constraints of the atomic process activities, the set of atomic process activities being sub-activities of the process, the process script conforming to BPEL4WS (Business Process Execution Language for Web Services).

26. The dialog system of claim 25, wherein the dialog move tree represents a dynamic state of interactions between the user and the dialog system.

27. A method for extending a dialog system to process application activities by using a dialog move tree to manage a conversation between the dialog system and a user, the method comprising:

associating the conversation with a complex activity; and

executing a plan script in connection with the complex activity, the plan script including a set of atomic dialog activities and logic to control a data and sequence flow of the atomic dialog activities, the set of atomic dialog activities being sub-activities of the complex activity;

wherein;

the dialog move tree forms a structured history of dialog moves performed by the dialog system and the user in the conversation;

the dialog manager dynamically adds to the dialog move tree a node for each occurrence of an atomic dialog activity of the set of atomic dialog activities; and

the complex activity is specified via a declarative activity specification language that connects the atomic dialog activities with a process.

29. The method of claim 27, wherein the process is related to at least one of a web service and a business process.

30. The method of claim 29, wherein the plan script is executed in conjunction with a process script that is executed in connection with the process, the process script including a set of atomic process activities and corresponding order constraints of the atomic process activities, the set of atomic process activities being sub-activities of the process.

31. The method of claim 30, wherein the process script conforms to a standard XML-based language designed to accomplish tasks across multiple organizations in a distributed computing environment using a combination of Web services.

32. The method of claim 30, wherein the process script conforms to BPEL4WS (Business Process Execution Language for Web Services).

33. The method of claim 27, further comprising:

semantically interpreting incoming user requests and utterances; and

performing an appropriate action on a device.

34. The method of claim 27, further comprising:

maintaining a history and a current context of the conversation.

35. The method of claim 34, further comprising:

storing the atomic dialog activities as conversational threads.