Method and system for distributed coordination of multiple modalities of computer-user interaction
First Claim
Patent Images
1. A method of coordinating the presentation of multiple modes of interaction for network-based electronic content comprising:
- receiving a markup language document of a first modality in a browser coordinator communicatively linked to a browser and a complementary browser, said browser configured to process said markup language document of said first modality and said complementary browser configured to process markup language documents of a second modality, which is different from the first modality;
using said browser coordinator to identify within said received markup language document of the first modality a reference to a markup language document of the second modality;
retrieving with said browser coordinator said markup language document of the second modality from a location identified by said browser coordinator based on said reference;
modifying with said browser coordinator said markup language document of the first modality by removing at least part of said reference;
conveying from said browser coordinator said modified markup language document of the first modality to said browser; and
conveying from said browser coordinator said markup language document of the second modality to said complementary browser.
2 Assignments
0 Petitions
Accused Products
Abstract
A method of coordinating the presentation of multiple modes of interaction for network-based electronic content can include receiving a markup language document of a first modality and identifying within the markup language document a reference to another markup language document of a second and different modality. The markup language document of the first modality can be modified by removing the reference. The modified markup language document of the first modality can be provided to an associated browser.
27 Citations
22 Claims
-
1. A method of coordinating the presentation of multiple modes of interaction for network-based electronic content comprising:
-
receiving a markup language document of a first modality in a browser coordinator communicatively linked to a browser and a complementary browser, said browser configured to process said markup language document of said first modality and said complementary browser configured to process markup language documents of a second modality, which is different from the first modality; using said browser coordinator to identify within said received markup language document of the first modality a reference to a markup language document of the second modality; retrieving with said browser coordinator said markup language document of the second modality from a location identified by said browser coordinator based on said reference; modifying with said browser coordinator said markup language document of the first modality by removing at least part of said reference; conveying from said browser coordinator said modified markup language document of the first modality to said browser; and conveying from said browser coordinator said markup language document of the second modality to said complementary browser.
-
-
2. A method of initializing a browser coordinator for coordinating the presentation of multiple modes of interaction for network-based electronic content, said method comprising:
-
providing to said browser coordinator a request for a markup language document from a browser of a first modality to a network application; receiving with said browser coordinator said markup language document, wherein said markup language document includes a reference to another markup language document of a second modality, which is different from the first modality; identifying with said browser coordinator said reference within said markup language document; retrieving said other markup language document of the second modality from a location identified by said browser coordinator based upon the reference; modifying said markup language document by removing at least part of said reference; providing said modified markup language document to said browser of the first modality; and providing said other markup language document to a complementary browser for rendering said other markup language document in coordination with a rendering of said modified markup language document by said browser of the first modality. - View Dependent Claims (3, 4)
-
-
5. A method of coordinating the presentation of multiple modes of interaction for network-based electronic content comprising:
-
receiving a request for a first markup language document from a browser of a first modality, the request being received in a browser coordinator communicatively linked to said browser and to a complementary browser, said browser configured to process said markup language document of said first modality and said complementary browser configured to process markup language documents of a second modality, which is different from the first modality; determining from a synchronization table contained in said browser coordinator a reference to a second markup language document of the second modality associated with said first markup language document, wherein said second markup language document is associated with a said complementary browser; providing said request for said first markup language document to a network application and receiving said first markup language document in said browser coordinator; modifying said first markup language document by said browser coordinator by removing at least part of said reference to said second markup language document; providing said modified first markup language document from said browser coordinator to said browser of the first modality; and providing said second markup language document from said browser coordinator to said complementary browser. - View Dependent Claims (6, 7, 8, 9, 10)
-
-
11. A browser coordinator configured to receive requests for markup language documents from at least two browsers of differing modalities,
to identify within a received markup language document of a first modality a reference to a markup language document of a second modality, which is different from the first modality, to retrieve said markup language document of the second modality from a location identified by said reference, to modify said markup language document of the first modality by removing at least part of said reference, to convey said modified markup language document of the first modality to browser of the first modality, and convey said markup language document of the second modality to a browser of the second modality.
-
13. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:
-
receiving a markup language document of a first modality in a browser coordinator communicatively linked to a browser and complementary browser, said browser configured to process said markup language document of said first modality and said complementary browser configured to process markup language documents of a second modality, which is different from the first modality; using said browser coordinator to identify within said received markup language document of the first modality a reference to a markup language document of the second modality; retrieving with said browser coordinator said markup language document of the second modality from a location identified by said browser coordinator based on said reference; modifying with said browser coordinator said markup language document of the first modality by removing at least part of said reference; conveying from said browser coordinator said modified markup language document of the first modality to said browser; and conveying from said browser coordinator said markup language document of the second modality to said complementary browser.
-
-
14. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:
-
providing to said browser coordinator a request for a markup language document from a browser of a first modality to a network application; receiving with said browser coordinator said markup language document, wherein said markup language document includes a reference to another markup language document of a second modality, which is different from the first modality; identifying with said browser coordinator said reference within said markup language document; retrieving said other markup language document of the second modality from a location identified by said browser coordinator based upon the reference; modifying said markup language document by removing at least part of said reference; providing said modified markup language document to said browser of the first modality; and
providing said other markup language document to a complementary browser for rendering said other markup language document in coordination with a rendering of said modified markup language document by said browser of the first modality. - View Dependent Claims (15, 16)
-
-
17. A machine-readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:
-
receiving a request for a first markup language document from a browser of a first modality, the request being received in a browser coordinator communicatively linked to said browser and to a complementary browser, said browser configured to process said markup language document of said first modality and said complementary browser configured to process markup language documents of a second modality, which is different from the first modality; determining from a synchronization table contained in said browser coordinator a reference to a second markup language document of the second modality associated with said first markup language document, wherein said second markup language document is associated with a said complementary browser; providing said request for said first markup language document to a network application and receiving said first markup language document in said browser coordinator; modifying said first markup language document by said browser coordinator by removing at least part of said reference to said second markup language document; providing said modified first markup language document from said browser coordinator to said browser of the first modality; and providing said second markup language document front said browser coordinator to said complementary browser. - View Dependent Claims (18, 19, 20, 21, 22)
-
Specification