Method and system for providing synchronized views of multiple applications for display on a remote computing device

• US 9,729,673 B2
• Filed: 06/20/2013
• Issued: 08/08/2017
• Est. Priority Date: 06/21/2012
• Status: Active Grant

• Current Assignee: Calgary Scientific Inc.
• Original Assignee: Calgary Scientific Inc.
• Inventors: Holmes, Colin J.
• Primary Examiner(s): Hussain, Imad
• Application Number:
  US13/922,744
• Publication Number:
  US 20130346482A1
• Time in Patent Office: 1,510 Days
• Field of Search: 709203
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A method and system of providing remote access at a client computer that executes a client remote access program that simultaneously communicates with first and second server remote access programs. The first and second server remote access programs determine first and second presentation data indicative of an application state of first and second application programs. The client remote access program receives the first and the second presentation data and determines display data in dependence thereupon for substantially simultaneously displaying the first and the second presentation data. The first and second application programs are provided with an out-of-band communication path to synchronize data between themselves, without the synchronization occurring through the client remote access program.

Claims

1. An apparatus for providing remote access to a plurality of application programs executing on plural server computers, comprising:

a first server having a first memory and a first processor, the first server executing a first server remote access program on the first processor that is in communication with a first application program; and

a second server having a second memory and a second processor, the second server executing a second server remote access program on the second processor that is in communication with a second application program,

wherein a communication connection is provided between the first server and the second server to synchronize a state between the first server and the second server, wherein presentation data representing a change in the state of at least one of the first application program and the second application program is communicated as a hierarchy of logical elements to a client remote access program associated with a client computer in remote communication with the first server remote access program and the second server remote access program, wherein the client remote access program determines display data configured to display a simultaneous view of the states of the first and second application programs in dependence upon the entirety of the presentation data presentation data and indicative of the user interface, wherein the client computer displays the display data on a display associated with the client computer until receiving updated presentation data and updating the display data.

2. The apparatus of claim 1, wherein the communication connection comprises at least one of a shared memory space, a socket, a direct path between the plural server computers, a local path that traverses a local area network between the plural server computers, and a wide area network path between the plural server computers.

3. The apparatus of claim 1, wherein communication connection utilizes interprocess communication (IPC) facilities.

4. The apparatus of claim 1, wherein a user interface associated with the first application program and the second application program is substantially simultaneously displayed in accordance with the presentation data.

5. The apparatus of claim 4, wherein interaction zones are defined on a display of the client computer, and wherein interactive functionalities of the first application program and the second application program are associated with a respective interaction zone.

6. The apparatus of claim 5, wherein plural client remote access programs execute on respective plural client computers, wherein presentation data representing a change in a state of at least one of the first application program and the second application program is provided to the plural client remote access programs, and wherein the presentation data is displayed at the plural client computers.

7. A method of providing remote access to a plurality of application programs executing on plural server computers, comprising:

providing a server remote access program on each of the plural server computers, each server remote access program being in communication with a respective one of plural application programs;

synchronizing respective states of a selection of the plural application programs among the plural server computers,

using the respective server remote access programs to generate presentation data associated with the selection of the plurality of application programs and according to hardware capabilities of at least one client computing device receiving the presentation data;

after synchronizing the states and generating presentation data from the selection of the plurality of application programs, communicating the entirety of the presentation data to respective client remote access programs executing on the at least one client computing device;

determining, at the respective client remote access programs, display data indicative of a user interface, to be displayed at a respective client computing device in accordance with the presentation data until receiving updated presentation data and then updating the display data;

displaying the display data to display a simultaneous view of the states of the selection of plural application programs.

8. The method of claim 7, further comprising synchronizing the presentation data using an out-of-band communication link between the plural server computers.

9. The method of claim 8, wherein the out-of-band communication link utilizes interprocess communication (IPC) facilities.

10. The method of claim 7, further comprising:

defining interaction zones within the view displayed on a display of the client computer; and

associating interactive functionalities of each of the plural application programs with a respective interaction zone.

11. A method of providing remote access to a plurality of application programs executing on plural server computers, comprising:

providing a server remote access program on each of the plural server computers, each server remote access program being in communication with a respective one of plural application programs;

synchronizing respective states of a selection of the plural application programs among the plural server computers,

using the respective server remote access programs to generate presentation data associated with the selection of the plurality of application programs and according to hardware capabilities of at least one client computing device receiving the presentation data;

after synchronizing the states and generating presentation data from the selection of the plurality of application programs, communicating the entirety of the presentation data as a hierarchy of logical elements to a respective client remote access programs executing on the at least one client computing device;

determining, at the respective client remote access programs, display data indicative of a user interface, to be displayed at a respective client computing device in accordance with the presentation data until receiving updated presentation data and then updating the display data;

displaying the display data to display a simultaneous view of the states of the selection of plural application programs.

12. A method of providing remote access to a plurality of application programs executing on plural server computers, comprising:

providing at least one server remote access program on each of the plural server computers, each of the plural server remote access programs being in communication with a respective one of plural application programs;

providing a plurality of remote connections to respective client remote access programs executing on respective client computers and the client remote access programs communicating with the at least one server remote access program over the remote connections to enable access to the plural application programs;

providing a communication connection between the plural server computers;

synchronizing the states of the plural application programs among the plural server computers using an out-of-band communication link between the plural server computers that excludes the respective client computers;

communicating a first set of presentation data representing a change in a state of at least one of the plural application programs to a plurality of client remote access programs;

determining, at the respective client remote access programs, respective sets of display data, indicative of respective user interfaces at respective client computers wherein the display data at each of the respective client computers is in dependence upon the first set of presentation data;

displaying the respective display data at the respective client computers until receiving updated presentation data at the client remote access programs and updating the respective user interfaces.

13. The method of claim 12, wherein the communication connection comprises at least one of a shared memory space, a socket, a direct path between the plural server computers, a local path that traverses a local area network between the plural server computers, and a wide area network path between the plural server computers.

14. The method of claim 12, wherein the communication connection utilizes interprocess communication (IPC) facilities.

15. The method of claim 12, wherein the communication connection is provided between the plural server remote access programs.

16. The method of claim 12, further comprising substantially simultaneously displaying, in accordance with the presentation data, a user interface associated with each of the plural application programs.

17. The method of claim 12, further comprising:

defining interaction zones on a display of the client computer; and

associating interactive functionalities of each of the plural application programs with a respective interaction zone.

18. The method of claim 17, wherein a same interactive functionality of the plural application programs are associated with a same interaction zone.

19. The method of claim 17, further comprising:

providing the at least one remote connection to plural client remote access programs executing on plural client computers;

communicating presentation data representing a change in a state of at least one of the plural application programs to the plural client remote access programs; and

displaying the presentation data at the plural client computer.

20. The method of claim 19, further comprising:

associating the interaction zones with off-screen display buffers having characteristics that are independent of hardware capabilities of either of the plural server computers and the plural client computers; and

sizing, by at least one of the plural server computers, the interaction zones to match each client computer in a round robin fashion as each client computer connected to the plural server computers is updated.

21. The method of claim 20, further comprising:

defining the interaction zones having one size for all of the plural client computers; and

sending interaction zone scaling instructions to each client computer for display.

22. The method of claim 12, wherein the control data from the client remote access program comprises client screen data.