Method and system for distributed coordination of multiple modalities of computer-user interaction

• US 20030221158A1
• Filed: 05/22/2002
• Published: 11/27/2003
• Est. Priority Date: 05/22/2002
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: McCobb, Gerald M., Ativanichayaphong, Soonthorn, Cross, Charles W., Wilson, Leslie R., Metianu, Nicolae D.
• Granted Patent: US 7,032,169 B2
• Time in Patent Office: Days
• US Class Current: 715/500
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation

Abstract

A method of coordinating the presentation of multiple modes of interaction for network-based electronic content can include receiving a markup language document of a first modality and identifying within the markup language document a reference to another markup language document of a second and different modality. The markup language document of the first modality can be modified by removing the reference. The modified markup language document of the first modality can be provided to an associated browser.

Claims

1. A method of coordinating the presentation of multiple modes of interaction for network-based electronic content comprising:

receiving a markup language document of a first modality;

identifying within said markup language document a reference to another markup language document of a second and different modality;

modifying said markup language document of the first modality by removing at least part of said reference; and

providing said modified markup language document of the first modality to an associated browser.

2. A method of initializing a browser coordinator for coordinating the presentation of multiple modes of interaction for network-based electronic content, said method comprising:

providing a request for a markup language document from a browser of a first modality to a network application;

receiving said markup language document, wherein said markup language document includes a reference to a another markup language document of a second and different modality;

identifying said reference within said first markup language document;

modifying said markup language document by removing at least part of said reference; and

providing said modified markup language document to said browser of the first modality.

3. The method of claim 2, further comprising:

creating a synchronization table having at least said reference stored therein.

4. The method of claim 2, further comprising:

updating a synchronization table to include at least said reference stored therein.

5. A method of coordinating the presentation of multiple modes of interaction for network-based electronic content comprising:

receiving a request for a first markup language document from a browser of a first modality;

determining from a synchronization table a reference to a second markup language document associated with said first markup language document, wherein said second markup language document is associated with a browser of a second and different modality;

providing said request for said first markup language document to a network application and receiving said first markup language document;

modifying said first markup language document by removing at least part of said reference to said second markup language document; and

providing said modified first markup language document to said browser of the first modality.

6. The method of claim 5, further comprising:

updating said synchronization table associated with said browser of the first modality according to said reference to said second markup language document.

7. The method of claim 6, wherein said updating step further comprises:

creating a new synchronization table including said reference to said second markup language document; and

deleting said synchronization table.

8. The method of claim 5, further comprising:

providing said reference to said second markup language document to said browser of the second modality;

receiving a request for said second markup language document from said browser of the second modality;

providing said reference to said second markup language document to a network application;

receiving said second markup language document, wherein said second markup language document includes a second reference to another markup language document of the first modality;

modifying said second markup language document by removing at least part of said second reference; and

providing said modified second markup language document to said browser of the second modality.

9. The method of claim 8, further comprising:

updating a second synchronization table associated with said browser of the second modality according to said second reference.

10. The method of claim 9, wherein said updating step comprises:

creating a new second synchronization table including said second reference; and

deleting said second synchronization table.

11. A browser coordinator configured to receive requests for markup language documents from at least two browsers of differing modalities, to forward said requests to a network application, to receive said requested markup language documents having coordination tags contained therein, and to modify said received markup language documents by removing at least a portion of each said coordination tag from said received markup language documents.

12. The browser coordinator of claim 11, configured to maintain a visual synchronization table and a voice synchronization table, and to provide each said modified markup language document to an associated browser.

13. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:

receiving a markup language document of a first modality;

identifying within said markup language document a reference to another markup language document of a second and different modality;

modifying said markup language document of the first modality by removing at least part of said reference; and

providing said markup language document of the first modality to an associated browser.

14. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:

providing a request for a markup language document from a browser of a first modality to a network application;

receiving said markup language document, wherein said markup language document includes a reference to a another markup language document of a second and different modality;

identifying said reference within said markup language document;

modifying said markup language document by removing at least part of said reference; and

providing said modified markup language document to said browser of the first modality.

15. The machine-readable storage of claim 14, further comprising:

creating a synchronization table having at least said reference stored therein.

16. The machine-readable storage of claim 14, further comprising:

updating a synchronization table to include at least said reference stored therein.

17. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:

receiving a request for a first markup language document from a browser of a first modality;

determining from a synchronization table a reference to a second markup language document associated with said first markup language document, wherein said second markup language document is associated with a browser of a second and different modality;

providing said request for said first markup language document to a network application and receiving said first markup language document;

modifying said first markup language document by removing at least part of said reference to said second markup language document; and

providing said modified first markup language document to said browser of the first modality.

18. The machine-readable storage of claim 17, further comprising:

updating said synchronization table associated with said browser of the first modality according to said reference to said second markup language document.

19. The machine-readable storage of claim 18, wherein said updating step further comprises:

creating a new synchronization table including said reference to said second markup language document; and

deleting said synchronization table.

20. The machine-readable storage of claim 17, further comprising:

providing said reference to said second markup language document to said browser of the second modality;

receiving a request for said second markup language document from said browser of the second modality;

providing said reference to said second markup language document to a network application;

receiving said second markup language document, wherein said second markup language document includes a second reference to another markup language document of the first modality;

modifying said second markup language document by removing at least part of said second reference; and

providing said modified second markup language document to said browser of the second modality.

21. The machine-readable storage of claim 20, further comprising:

updating a second synchronization table associated with said browser of the second modality according to said second reference.

22. The machine-readable storage of claim 21, wherein said updating step comprises:

creating a new second synchronization table including said second reference; and

deleting said second synchronization table.