Application module for managing interactions of distributed modality components

• US 7,409,690 B2
• Filed: 12/19/2003
• Issued: 08/05/2008
• Est. Priority Date: 12/19/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: McCobb, Gerald M., Bou-ghannam, Akram A.
• Primary Examiner(s): An; Meng-Ai
• Assistant Examiner(s): Cao; Diem K
• Application Number:
  US10/741,997
• Publication Number:
  US 20050138647A1
• Time in Patent Office: 1,691 Days
• Field of Search: 715863-864, 719310-320, 719328-330
• US Class Current: 719/315
• CPC Class Codes: G06F 2209/544 Remote
• CPC Class Codes: G06F 2209/545 Gui
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications

Abstract

A method for managing application modalities using dialogue states can include the step of asserting a set of activation conditions associated with a dialogue state of an application. Each of the activation conditions can be linked to at least one programmatic action, wherein different programmatic actions can be executed by different modality components. The application conditions can be monitored. An application event can be detected resulting in an associated application condition being run. At least one programmatic action linked to the application condition can be responsively initiated.

Claims

1. A method for managing distributed modality components using dialogue states of a multimodal application, comprising the steps of:

initiating the multimodal application;

determining a set of activation conditions associated with a dialogue state of the multimodal application;

loading said activation conditions in the set of activation conditions into a modality component server having a shared memory and an interface, each of said activation conditions being linked to at least one programmatic action, wherein different programmatic actions are executed by different modality components, wherein each of said modality components publishes a set of programmatic actions for that modality component, and wherein a multimodal engine includes activation rules specify activation conditions and programmatic actions;

monitoring said activation conditions and the dialog state;

running said activation conditions based upon an application event;

responsively initiating the at least one programmatic action linked to an occurrence of a fired activation condition; and

updating the dialogue state upon execution of the at least one programmatic action.

2. The method of claim 1, wherein said programmatic action is a modality component action executed remotely from said application.

3. The method of claim 1, further comprising the step of:

providing a modality manager that is remotely located from said application, wherein said asserting step, publishing step, monitoring step, running step, and initiating step are performed by said modality manager.

4. The method of claim 1, further comprising the steps of:

activating a modality component; and

identifying a plurality of activation conditions associated with said activated modality component, where said activating step occurs before said assertion step, and wherein said asserted set of activation conditions includes said plurality of activation conditions.

5. The method of claim 1, further comprising steps of:

determining that a dialogue state of the application changes from said dialogue state to a new dialogue state;

asserting a new set of activation conditions associated with said new dialogue state; and

updating said publishing, monitoring, and running steps to reflect the new set of application conditions.

6. The method of claim 5, wherein said application change results from said initiated programmatic action.

7. The method of claim 5, further comprising the steps of:

responsive to said new dialogue state determination, deactivating said previously activated modality component, wherein said plurality of activation conditions associated with said deactivated modality component are not included within said new set of activation conditions.

8. The method of claim 5, further comprising the steps of:

responsive to said new dialogue state determination, activating a previously deactivated modality component, wherein a plurality of activation conditions associated with said newly activated modality component are included in said new set of activation conditions.

9. The method of claim 1, further comprising the step of:

loading each activation condition into a centralized memory space, wherein said monitoring step utilizes said centralized memory space.

10. The method of claim 9, further comprising the steps of:

determining that the application changes from said dialogue state to a new dialogue state; and

updating the activation conditions contained within the centralized memory space to reflect activation conditions of said new dialogue state.