Multi-modal content presentation
First Claim
1. A method comprising:
- receiving a user input, the user input having been input in a user interlace in one of multiple modalities;
accessing, in response to receiving the user input, a multimodality content document including content information and presentation information, the presentation information supporting presentation of the content information in each of the multiple modalities;
accessing, in response to receiving the user input, metadata for the user interface, the metadata indicating that the user interface provides a first modality and a second modality for interfacing with a user;
generating first-modality instructions based on the accessed multi-modality content document and the accessed metadata, the first-modality instructions providing instructions for presenting the content information on the user interface using the first modality; and
generating second-modality instructions based on the accessed multi-modality content document and the accessed metadata, the second-modality instructions providing instructions for presenting the content information on the user interface using the second modality,wherein;
the content information includes a first content portion and a second content portion,the metadata includes a user interface attribute related to pagination, andgenerating the first-modality instructions and the second-modality instructions comprises;
determining a particular first-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality;
determining a particular second-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein the particular first-modality pagination and the particular second-modality pagination are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second-modality on the user interface, and (iii) the user interface attribute related to pagination;
generating, based on the particular first-modality pagination, the first-modality instructions including instructions for (i) presenting the first content portion on the user interface during a first time interval, and (ii) presenting the second content portion on the user interface during a second time interval; and
generating, based on the particular second-modality pagination, the second-modality instructions including instructions for (i) presenting the first content portion on the user interface during the first time interval, and (ii) presenting the second content portion on the user interface during the second time interval; and
wherein generating the first-modality instructions and the second-modality instructions further comprises;
determining multiple first-modality paginations, including the particular first-modality pagination, describing pagination, between the first content portion and the second content portion during presentation on the user interface using the first modality;
determining multiple second-modality paginations, including the particular second-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein each of the multiple first-modality paginations and second-modality paginations are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination;
forming a first pagination scenario, the forming including associating with a first of the multiple first-modality paginations a first of the multiple second-modality paginations;
determining for the first pagination scenario a first distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality;
forming second pagination scenario, the forming including associating with a second of the multiple first-modality paginations a second of the multiple second-modality paginations;
determining for the second pagination scenario a second distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality;
comparing the first distance with the second distance; and
selecting a pagination scenario from the first pagination scenario and the second pagination scenario based on a result of the comparing.
2 Assignments
0 Petitions
Accused Products
Abstract
A method is provided that includes receiving a user input, the user input having been input in a user interface in one of multiple modalities. The method also includes accessing, in response to receiving the user input, a multi-modality content document including content information and presentation information, the presentation information supporting presentation of the content information in each of the multiple modalities. In addition, the method includes accessing, in response to receiving the user input, metadata for the user interface, the metadata indicating that the user interface provides a first modality and a second modality for interfacing with a user. First-modality instructions are generated based on the accessed multi-modality content document and the accessed metadata, the first-modality instructions providing instructions for presenting the content information on the user interface using the first modality. Second-modality instructions are generated based on the accessed multi-modality content document and the accessed metadata, the second-modality instructions providing instructions for presenting the content information on the user interface using the second modality.
34 Citations
16 Claims
-
1. A method comprising:
-
receiving a user input, the user input having been input in a user interlace in one of multiple modalities; accessing, in response to receiving the user input, a multimodality content document including content information and presentation information, the presentation information supporting presentation of the content information in each of the multiple modalities; accessing, in response to receiving the user input, metadata for the user interface, the metadata indicating that the user interface provides a first modality and a second modality for interfacing with a user; generating first-modality instructions based on the accessed multi-modality content document and the accessed metadata, the first-modality instructions providing instructions for presenting the content information on the user interface using the first modality; and generating second-modality instructions based on the accessed multi-modality content document and the accessed metadata, the second-modality instructions providing instructions for presenting the content information on the user interface using the second modality, wherein; the content information includes a first content portion and a second content portion, the metadata includes a user interface attribute related to pagination, and generating the first-modality instructions and the second-modality instructions comprises; determining a particular first-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality; determining a particular second-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein the particular first-modality pagination and the particular second-modality pagination are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second-modality on the user interface, and (iii) the user interface attribute related to pagination; generating, based on the particular first-modality pagination, the first-modality instructions including instructions for (i) presenting the first content portion on the user interface during a first time interval, and (ii) presenting the second content portion on the user interface during a second time interval; and generating, based on the particular second-modality pagination, the second-modality instructions including instructions for (i) presenting the first content portion on the user interface during the first time interval, and (ii) presenting the second content portion on the user interface during the second time interval; and wherein generating the first-modality instructions and the second-modality instructions further comprises; determining multiple first-modality paginations, including the particular first-modality pagination, describing pagination, between the first content portion and the second content portion during presentation on the user interface using the first modality; determining multiple second-modality paginations, including the particular second-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein each of the multiple first-modality paginations and second-modality paginations are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination; forming a first pagination scenario, the forming including associating with a first of the multiple first-modality paginations a first of the multiple second-modality paginations; determining for the first pagination scenario a first distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality; forming second pagination scenario, the forming including associating with a second of the multiple first-modality paginations a second of the multiple second-modality paginations; determining for the second pagination scenario a second distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality; comparing the first distance with the second distance; and selecting a pagination scenario from the first pagination scenario and the second pagination scenario based on a result of the comparing. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. An apparatus comprising:
-
means for receiving a user input, the user input having be en input in a user interface in one of multiple modalities; means for accessing, in response to receiving the user input, a multi-modality content document including content information and presentation information, the presentation information supporting presentation of the content information in each of the multiple modalities; means for accessing, in response to receiving the user input, metadata tor the user interface, the metadata indicating that the user interface provides a first modality and a second modality for interfacing with a user; means for generating first-modality instructions based on the accessed multi-modality content document and the accessed metadata, the first-modality instructions providing instructions for presenting the content information on the user interface using the first modality; and means for generating second-modality instructions based on the accessed multi-modality content document and the accessed metadata, the second-modality instructions providing instructions for presenting the content information on the user interface using the second modality, wherein; the content information includes a first-content portion and a second content portion, the metadata includes a user interface attribute related to pagination, and generating the first-modality instructions and the second-modality instructions comprises; determining a particular first-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality; determining a particular second-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein the particular first-modality pagination and the particular second-modality pagination are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination; generating, based on the particular first-modality pagination, the first-modality instructions including instructions for presenting the first content portion on the user interface during a first time interval, and (ii) presenting the second content portion on the user interface during a second time interval; and generating, based on the particular second-modality pagination, the second-modality instructions including instructions for (i) presenting the first content portion on the user interface during the first time interval, and (ii) presenting the second content portion on the user interface during the second time interval; wherein generating the first-modality instructions and the second-modality instructions further comprises; determining multiple first-modality paginations, including the particular first-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality; and determining multiple second modality paginations, including the particular second-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein each of the multiple first-modality paginations and second-modality paginations are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination; forming a first pagination scenario, the forming including associating with a first of the multiple first-modality paginations a first of the multiple second-modality paginations; determining for the first pagination scenario a first distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality; forming a second pagination scenario, the forming including associating with a second of the multiple first-modality paginations a second of the multiple second-modality paginations; determining for the second pagination scenario a second distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality; comparing the first distance with the second distance; and selecting a pagination scenario from the first pagination scenario and the second pagination scenario based on a result of the comparing. - View Dependent Claims (14)
-
-
15. An apparatus comprising a computer-readable medium that includes instructions for performing at least the following:
-
receiving a user input, the user input having been input in a user interface in one of multiple modalities; accessing, in response to receiving the user input, a multi-modality content document including content information and presentation information, the presentation information supporting presentation of the content information in each of the multiple modalities; accessing, in response to receiving the user input, metadata for the user interface, the metadata indicating that the user interface provides a first modality and a second modality for interfacing with a user; generating first-modality instructions based on the accessed multi-modality content document and the accessed metadata, the first-modality instructions providing instructions for presenting the content information on the user interface using the first modality; and generating second-modality instructions based on the accessed multi-modality content document and the accessed metadata, the second-modality instructions providing instructions for presenting the content information on the user interface using the second modality, wherein; the content information includes a first content portion and a second content portion, the metadata includes a user interface attribute related to pagination, and generating the first-modality instructions and the second-modality instructions comprises; determining a particular first-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality; determining a particular second-modality pagination describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein the particular first-modality pagination and the particular second-modality pagination are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination; generating, based on the particular first-modality pagination, the first-modality instructions including instructions for (i) presenting the first content portion on the user interface during a first time interval, and (ii) presenting the second content portion on the user interface during a second time interval; and generating, based on the particular second-modality pagination, the second-modality instructions including instructions for (i) presenting the first content portion on the user interface during the first time interval, and (ii) presenting the second content portion on the user interface during the second time interval, wherein generating the first-modality instructions and the second-modality instructions further comprises; determining multiple first-modality paginations, including the particular first-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the first modality; and determining multiple second-modality paginations, including the particular second-modality pagination, describing pagination between the first content portion and the second content portion during presentation on the user interface using the second modality, wherein each of the multiple first-modality paginations and second-modality paginations are determined based on (i) desired order of presentation of the first content portion and the second content portion in the first modality on the user interface, (ii) desired order of presentation of the first content portion and the second content portion in the second modality on the user interface, and (iii) the user interface attribute related to pagination; forming a first pagination scenario, the forming including associating with a first of the multiple first-modality paginations a first of the multiple second-modality paginations; determining for the first pagination scenario a first distance characterizing whether (i) the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configure to be presented on the user interface during a second common time interval using both the first modality and the second modality; forming a second pagination scenario, the forming including associating with a second of the multiple first-modality paginations a second of the multiple second-modality paginations; determining for the second pagination scenario a second distance characterizing whether the first content portion is configured to be presented on the user interface during a first common time interval using both the first modality and the second modality and (ii) the second content portion is configured to be presented on the user interface during a second common time interval using both the first modality and the second modality; comparing the first distance with the second distance; and selecting a pagination scenario from the first pagination scenario and the second pagination scenario based on a result of the comparing. - View Dependent Claims (16)
-
Specification