Synchronization and transmission of distributed user interfaces over computer networks

• US 7,849,455 B2
• Filed: 08/23/2006
• Issued: 12/07/2010
• Est. Priority Date: 08/23/2006
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: Kadner, Kay, Pohl, Christoph
• Primary Examiner(s): Khatri; Anil
• Application Number:
  US11/466,722
• Publication Number:
  US 20080126470A1
• Time in Patent Office: 1,567 Days
• Field of Search: 717168-175, 715/700, 709203-204, 709/223, 709/227
• US Class Current: 717/168
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display

Abstract

An initial user interface description is transmitted from a generation component to output modalities which include styling components configured to supplement the initial user interface description with layout information. The output modalities each include rendering components configured to render outputs based upon the initial user interface description and the layout information. Initial user interface description delay times between transmitting the initial user interface description from the generation component and rendering the outputs on the rendering components are determined, and a reference delay time is also determined based upon the greater of the initial user interface description delay times. Correction times are determined based upon the reference delay time and the initial user interface description delay times, and a subsequent user interface description is transmitted from the generation component to the output modalities based upon the correction times, such that the subsequent user interface description is rendered at the rendering components substantially simultaneously.

Claims

1. A method comprising:

transmitting an initial user interface description from a generation computing device to at least first and second output modalities, the initial user interface description corresponding to a distributed user interface, the first and second output modalities each including first and second styling components, respectively, the first and second styling components each configured to supplement the initial user interface description with first and second layout information, respectively, and first and second rendering components each configured to render the distributed user interface based upon the initial user interface description and the first and second layout information, respectively;

determining first and second initial user interface description delay times between transmitting the initial user interface description from the generation computing device and rendering the distributed user interface on each of the first and second rendering components, respectively;

determining a reference delay time based upon the greater of the first and second initial user interface description delay times;

determining first and second correction times based upon the reference delay time and the first and second initial user interface description delay times, respectively; and

transmitting a subsequent user interface description from the generation computing device to the first and second output modalities based upon the first and second correction times, respectively, such that the distributed user interface is updated at each of the first and second rendering components based on the subsequent user interface description substantially simultaneously;

wherein determining the initial user interface description delay time further comprises;

measuring a delay attribute; and

transmitting the delay attribute to the synchronization database;

calculating the initial user interface description delay time based upon the delay attribute; and

transmitting the initial user interface description delay time to the generation computing device.

2. The method of claim 1, wherein each of the first and second initial user interface description delay times is expressed as:

T_modality=T_processing+T_network,

wherein T_modality represents the initial user interface description delay time,

wherein T_processing represents a processing delay, and

wherein T_network represents a network delay.

3. The method of claim 2, wherein the processing delay is expressed as:

T_processing=T_styling+T_rendering,

wherein T_styling represents a styling component processing delay, and

wherein T_rendering represents a rendering component processing delay.

4. The method of claim 3, wherein the styling component processing delay is expressed as:

T_styling=style(data)+ε

_styling,

wherein style (data) represents an expected styling delay for the subsequent user interface description based upon an actual styling time of the initial user interface description, and

wherein ε

_styling represents a styling uncertainty delay.

5. The method of claim 3, wherein the rendering component processing delay is expressed as:

T_rendering=render(data′

)+ε

_rendering,

wherein render(data′

) represents an expected rendering delay for the subsequent user interface description based upon an actual rendering time of the initial user interface description inflated by an inflation factor α

to compensate for augmented layout information, and

wherein ε

_rendering represents a rendering uncertainty delay.

6. The method of claim 2, wherein the network delay is expressed as:

T_network=T_gen-sty+T_sty-ren,

wherein T_gen-sty represents a generation-styling network transmission delay between the generation component to the styling component, and

wherein T_sty-ren represents a styling-rendering network transmission delay between the styling component and the rendering component.

7. The method of claim 1, wherein transmitting the subsequent user interface description further comprises:

inserting the first correction time;

transmitting the subsequent user interface description from the generation computing device to the first output modality based upon the inserted first correction time;

inserting the second correction time; and

transmitting the subsequent user interface description from the generation computing device to the second output modality based upon the inserted second correction time.

8. The method of claim 1, wherein the initial user interface description is transmitted from the generation computing device to the first or second output modality via a wired or wireless connection.

9. The method of claim 1, wherein the first and second modalities are disposed in the same device.

10. The method of claim 1, wherein the first and second output modalities are provided as first and second devices, respectively.

11. A system comprising:

a generation computing device configured to transmit an initial user interface description, and to transmit a subsequent user interface description based upon first and second correction times, the initial user interface description corresponding to a distributed user interface;

at least first and second output modalities configured to receive the initial user interface description and the subsequent user interface description, the first and second output modalities each further comprising;

a styling component configured to supplement the initial user interface description with layout information, and

a rendering component configured to render the distributed user interface based upon the initial user interface description and the layout information; and

a synchronization database configured to determine first and second initial user interface description delay times between transmitting the initial user interface description from the generation computing device and rendering the distributed user interface on each of the first and second rendering components, respectively, to determine a reference delay time based upon the greater of the first and second initial user interface description delay times, and to determine the first and second correction times based upon the reference delay time and the first and second initial user interface description delay times, respectively,

wherein the distributed user interface is updated at each of the first and second rendering components based on the subsequent user interface description substantially simultaneously;

wherein determining the initial user interface description delay time further comprises;

measuring a delay attribute; and

transmitting the delay attribute to the synchronization database;

calculating the initial user interface description delay time based upon the delay attribute; and

transmitting the initial user interface description delay time to the generation computing device.

12. The system of claim 11, wherein the generation computing device, the first and second output modalities, and/or the synchronization database are physically disposed in one device.

13. The system of claim 11, wherein the first and/or second output modalities are integral to a personal digital assistant, a portable or non-portable computer, and/or a cellular telephone.

14. The system of claim 11, wherein the first and second output modalities are provided as first and second devices, respectively.

15. A method comprising:

transmitting an initial user interface description from a generation computing device to at least first and second devices, the initial user interface description corresponding to a distributed user interface, the first and second devices each including first and second styling components, respectively, the first and second styling components each configured to supplement the initial user interface description with first and second layout information, respectively, and first and second rendering components configured to render the distributed user interface based upon the initial user interface description and the first and second layout information, respectively;

determining first and second initial user interface description delay times between transmitting the initial user interface description from the generation computing device and rendering the distributed user interface on each of the first and second rendering components, respectively;

determining a reference delay time based upon the greater of the first and second initial user interface description delay times;

determining first and second correction times based upon the reference delay time and the first and second initial user interface description delay times, respectively; and

transmitting a subsequent user interface description from the generation computing device to the first and second devices based upon the first and second correction times, respectively, such that the distributed user interface is updated at each of the first and second rendering components based on the subsequent user interface description substantially simultaneously;

wherein determining the initial user interface description delay time further comprises;

measuring a delay attribute; and

transmitting the delay attribute to the synchronization database;

calculating the initial user interface description delay time based upon the delay attribute; and

transmitting the initial user interface description delay time to the generation computing device.

16. The method according to claim 15, wherein the first and second outputs are rendered via the same modality.