CONVERSATIONAL USER INTERFACE AGENT DEVELOPMENT ENVIRONMENT

• US 20180129484A1
• Filed: 06/28/2017
• Published: 05/10/2018
• Est. Priority Date: 11/04/2016
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: KANNAN, Vishwac Sena, SCHULTZ, Kristoffer, BAPAT, Vikram, CHAMBERS, Rob, UZELAC, Aleksandar, SHAHID, Khuram, TRUFINESCU, Adina Magdalena
• Application Number:
  US15/636,503
• Publication Number:
  US 20180129484A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

One disclosed example provides a computing system configured to receive input defining a machine conversation dialog flow, display in an editing user interface a first representation of the machine conversation dialog flow in the form of a symbolic representation, receive input requesting display of a second representation of the machine conversation dialog flow, and in response to the request display in the editing user interface the machine conversation dialog flow in the character-based representation. The computing system is further configured to, based upon the machine conversation dialog flow, update a machine conversation schema template to form an updated machine conversation schema, and form an agent definition file based upon the updated machine conversation schema for use in executing the machine conversation dialog flow.

Claims

1. A computing system, comprising:

a logic subsystem; and

a data-holding sub system comprising computer-readable instructions executable by the logic system to

receive input defining a machine conversation dialog flow;

display in an editing user interface a first representation of the machine conversation dialog flow in the form of a symbolic representation;

receive input requesting display of a second representation of the machine conversation dialog flow;

in response to the request, display in the editing user interface the machine conversation dialog flow in a character-based representation; and

based upon the machine conversation dialog flow, update a machine conversation schema template to form an updated machine conversation schema, and form an agent definition file based upon the updated machine conversation schema for use in executing the machine conversation dialog flow.

2. The computing system of claim 1, wherein the instructions are executable to display in the editing user interface the symbolic representation as a flow diagram comprising states of the machine conversation in symbol form, and the character-based representation as a script view comprising states of the machine conversation in character form.

3. The computing device of claim 2, wherein the instructions are further executable to selectively display the machine conversation in the editing user interface via one or more other views than the flow diagram view and the script view.

4. The computing device of claim 1, wherein the instructions are further executable to receive, via the editing user interface input, user inputs additional states in the machine conversation dialog flow via the symbolic representation and also via the character-based representation.

5. The computing device of claim 1, wherein the instructions are further executable to receive an input selecting a selected flow diagram symbol in the symbolic representation of the machine conversation dialog flow, and in response display in the editing user interface editable code that is executable at a state in the machine conversation dialog flow represented by the selected flow diagram symbol.

6. The computing device of claim 1, wherein the instructions are further executable to receive an input selecting a selected state in a currently displayed representation of the machine conversation dialog flow, and to display a preview representing an appearance of a runtime user interface at the selected state in a preview field of the editing user interface.

7. The computing device of claim 1, wherein the instructions are further executable to receive a user input comprising one or more of a speech input and a text input to further define a selected state within the machine conversation dialog flow.

8. The computing device of claim 1, wherein the instructions are further executable to receive user inputs of a plurality of different types of triggers configured to initiate the machine conversation in runtime, the plurality of different types of triggers comprising a user input-based trigger type and an event-based trigger type.

9. The computing device of claim 1, wherein the instructions are further executable to display a user interface configured to permit adaptation of the machine conversation dialog flow to a plurality of different device contexts, and to receive inputs of runtime user interface presentation settings for each of the different types of device contexts.

10. A computing system, comprising:

a logic subsystem; and

a data-holding subsystem comprising computer-readable instructions executable by the logic system to operate an agent development environment configured to

receive input defining a machine conversation dialog flow;

display an editable representation of the machine conversation dialog flow in an editing field of a user interface of the agent development environment;

receive an input selecting a state within the machine conversation dialog flow displayed in the editing field;

in response, display in a preview field of the user interface a preview of the state within the machine conversation dialog flow as the state would be presented during runtime; and

based upon the input defining the machine conversation dialog flow, update a machine conversation schema template to form an updated machine conversation schema, and form an agent definition file based upon the updated machine conversation schema for use in executing the machine conversation dialog flow.

11. The computing device of claim 10, wherein the instructions are further executable to display the preview of the selected state within the machine conversation dialog flow as adapted to a type of device selected in the user interface.

12. The computing device of claim 11, wherein the instructions are further executable to display in the user interface a list of selectable hardware specifications for the type of device, receive input of a selected hardware specification, and display the preview of the selected state as the selected state would be presented in on a computing device having the selected hardware specification.

13. The computing device of claim 10, wherein the preview comprises visual elements obtained for the preview from outside of an operating environment of the agent development environment.

14. A computing system, comprising:

a logic subsystem; and

a data-holding subsystem comprising computer-readable instructions executable by the logic system to

receive input defining a machine conversation dialog flow;

based upon the input, modify a machine conversation schema template to form an agent definition;

receive an input requesting sharing of the agent definition, the input defining user accounts with which to grant access to the agent definition;

grant access to the machine conversation dialog flow to the user accounts defined;

receive feedback regarding testing usage of the agent definition from the user accounts;

receive an input requesting display of a representation of the feedback regarding testing usage of the agent definition from the user accounts; and

in response, display a representation of the machine conversation dialog flow and the representation of the feedback at one or more locations within the representation of the machine conversation dialog flow.

15. The computing device of claim 14, wherein the instructions are further executable to display the feedback by displaying a representation of a number of times a pathway between states was followed.

16. The computing device of claim 14, wherein the instructions are further executable to display the feedback by displaying a representation of a number of dropouts of user accounts at each of a plurality of states of the machine conversation dialog flow.

17. The computing device of claim 14, wherein the instructions are further executable to display the feedback by

displaying a representation of a number of successful language understandings at a location of the machine conversation dialog flow, wherein each successful language understandings represents an instance of the machine conversation dialog flow recognizing a user input, and

displaying a representation of a number of unsuccessful language understanding at the location of the machine conversation dialog flow, wherein each unsuccessful language understanding represents an instance of the machine conversation dialog flow not recognizing the user input.

18. The computing device of claim 14, wherein the instructions are further executable to receive an input via the editing user interface selecting a selected state in the machine conversation dialog flow, and in response provide an output of a user input received during testing usage that was not understood at the selected state.

19. The computing device of claim 14, wherein the instructions are further executable to modify a language understanding model such that an unsuccessful user query, input, or utterance is understood.

20. The computing device of claim 14, wherein receiving feedback regarding testing usage of the agent definition from the user accounts further comprises using telemetry to collect information on how the conversation flow is used.