Mixed initiative interface control

• US 7,461,344 B2
• Filed: 05/01/2002
• Issued: 12/02/2008
• Est. Priority Date: 05/04/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Lecoeuche, Renaud J., Young, Steven, Potter, Stephen
• Primary Examiner(s): Hailu; Tadesse
• Assistant Examiner(s): Roswell; Michael
• Application Number:
  US10/137,796
• Publication Number:
  US 20020193907A1
• Time in Patent Office: 2,407 Days
• Field of Search: 715/727, 715/728, 715/978, 704/275
• US Class Current: 715/727
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04M 2203/355 Interactive dialogue design tools, features or methods
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

A control system for a modular, mixed initiative, human-machine interface. The control system comprises moves, the moves defining units of interaction about a topic of information. The moves comprise at least one system move and at least one user move. Each system move is structured such that it contains information regarding pre-processing to be performed, information to develop a prompt to be issued to the user and information that enables possible user moves which can follow the system move to be listed. Each user move is structured such that it contains information relating to interpretation grammars that trigger the user move, information relating to processing to be performed based upon received and recognized data and information regarding the next move to be invoked. A corresponding method is provided.

Claims

1. A control system for a mixed initiative, human-machine interface, the control system comprising:

a dialog control unit configured to implement moves, the moves defining units of interaction on a topic of information, the moves comprising at least one system move and at least one user move, each system move generating a prompt to be issued to a user and information that activates a subset of the user moves as possible user moves which can follow the system move, each possible user move activating one or more corresponding interpretation grammars that, when matched by a user input, trigger the corresponding user move, wherein the dialog control unit combines moves such that the system moves generate composite prompts and the user moves activate a plurality of interpretation grammars.

2. A control system as defined in claim 1, wherein each system move is one of the group:

tell, ask, seeking confirmation, implied confirmation, give help, response to silence and response to mumble.

3. A control system as defined in claim 1 wherein each user move is one of the group:

answer, accept, deny, correct, ask help, silence, mumble.

4. A control system as defined in claim 1 wherein the moves are used to define the interface to a dialogue.

5. A control system as defined in claim 1 wherein the dialog control unit transports the moves through the system such that information input in response to a previous prompt can be processed by subsequent actions associated with the topic of information.

6. A control system as defined in claim 1 wherein the dialog control unit processes the topic of information as a composite structure of further topics.

7. A control system as defined in claim 1 wherein one of the moves comprises other moves.

8. A control system as defined in claim 1 wherein each system move also contains information regarding pre-processing to be performed.

9. A control system as defined in claim 1 wherein each system move also contains information regarding post-processing to be performed.

10. A control method for modular, mixed initiative, human-machine interface, the control method comprising the steps of:

defining moves in a dialog control unit, the moves defining units of interaction about a topic of information, the moves comprising at least one system move and at least one user move, each system move being structured such that, when it is implemented by the dialog control unit, it generates a prompt to be issued to a user and it enables a plurality of possible user moves which can follow the system move, each possible user move, when enabled, constraining recognizable user inputs by activating only corresponding interpretation grammars that, when matched by a user input, trigger the corresponding user move, the user move also identifying information relating to processing to be performed based upon a received and recognized user input and information regarding a next move to be invoked; and

controlling the interface with the dialog control unit to obtain information in a mixed initiative manner from a user, wherein the moves are combined to form composite prompts and grammars.

11. A method as defined in claim 10, wherein each system move is defined as one of a group:

tell, ask, seeking confirmation, implied confirmation, give help, response to silence and response to mumble.

12. A method as defined in claim 10 wherein each user move is defined as one of the group:

answer, accept, deny, correct, ask help, silence, mumble.

13. A method as defined in claim 10 wherein the moves are used to define the interface to a dialogue.

14. A method as defined in claim 10 further comprising the step of:

transporting the moves through the system such that a user input provided during a previous move can be processed by relevant actions associated with the topic of information in a subsequent move.

15. The method as defined in claim 10 wherein the topic of information is a composite structure of further topics.

16. A method as defined in claim 10 wherein the move is composed of other moves.

17. A method as defined in claim 10 wherein each system move also includes information regarding pre-processing to be performed.

18. A method as defined in claim 10 wherein each system move also includes information regarding post-processing to be performed.