Sharing remote sessions of a user interface and/or graphics of a computer

• US 9,549,045 B2
• Filed: 04/17/2012
• Issued: 01/17/2017
• Est. Priority Date: 08/29/2011
• Status: Active Grant

• Current Assignee: Vmware LLC (Broadcom, Inc.)
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Jooste, Sarel Kobus
• Primary Examiner(s): Gillis, Brian J
• Assistant Examiner(s): Lin, Steve
• Application Number:
  US13/449,129
• Publication Number:
  US 20130054679A1
• Time in Patent Office: 1,736 Days
• Field of Search: 709/203, 709/225, 709/227
• US Class Current: 1/1
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: H04L 65/40 Support for services or applications
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

Methods, systems, and techniques for sharing a remoted user interface are described. Example embodiments provide a Remote Session Sharing Protocol (“RSSP”) for sharing a remoted user interface and/or graphics of a same computer system operating system or application. Use of the RSSP enables server computing systems to optimize the utilization of frame buffers and state information when multiple clients connect to the same remote session (e.g., connect to the same user interface of an application or operating system) at substantially the same time.

Claims

1. A method in a computing system for sharing a currently allocated session that is allocated to a first client device, comprising:

receiving, from a browser operating on a second client device, a hypertext transfer protocol (HTTP) request to remote a graphical user interface (GUI) of an application or a desktop running on a server to the second client device using HTTP requests and responses;

determining connection characteristics for the second client device;

determining whether to share the currently allocated session with the second client device based on the connection characteristics, the currently allocated session being used to remote the GUI of the application or the desktop running on the server to the first client device, wherein the second client device is distinct from the first client device, wherein the GUI is defined in a first frame buffer on the server and is associated with first state information;

associating the second client device with the currently allocated session when a determination is made to share the currently allocated session;

in response to the determination to share the currently allocated session, pausing all clients that share the currently allocated session and transmitting to said all clients a new key frame to align said all clients that share the currently allocated session, wherein transmitting the new key frame includes sending to the second client device over HTTP, the new key frame that contains an entire image of the first frame buffer on the server; and

sending to the second client device over HTTP, a sequence of updates to the GUI of the application or the desktop running on the server contained in the first frame buffer and using the first state information associated with the currently allocated session.

2. The method of claim 1, further comprising:

allocating a new session having a new session connection profile when a determination is made to not share the currently allocated session;

associating the second client device with the new session when the determination is made to not share the currently allocated session; and

sending image data to the second client device in accordance with a second frame buffer and second state information associated with the new session the determination is made to not share the currently allocated session.

3. The method of claim 2 wherein allocating the new session comprises:

splitting the currently allocated session into a first new session and a second new session;

associating the first client device with the first session; and

associating the second client device with the second session.

4. The method of claim 1 wherein the determining whether to share the currently allocated session with the second client device based on the connection characteristics comprises:

determining a second consumption rate for the second client device; and

determining whether the second consumption rate for the second client device is within a determined range of a first consumption rate associated with a session connection profile of the currently allocated session.

5. The method of claim 4 wherein the first consumption rate is measured in frames per second.

6. The method of claim 1 wherein the currently allocated session is associated with the GUI that is part of a conferencing application.

7. The method of claim 1 wherein the computing system is a virtualized server computing system.

8. The method of claim 1 wherein the updates to the GUI comprise an update data frame created from the first frame buffer and the first state information associated with the currently allocated session.

9. A non-transitory computer-readable medium having contents that, when executed by one or more processors, enable a computing device to share a currently allocated session that is allocated to a first client device by performing a method comprising:

receiving, from a browser operating on a second client device, a hypertext transfer protocol (HTTP) request to remote a graphical user interface (GUI) of an application or a desktop running on a server to the second client device using HTTP requests and responses;

determining connection characteristics for the second client device;

determining whether to share the currently allocated session with the second client device based on the connection characteristics, the currently allocated session being used to remote the GUI of the application or the desktop running on the server to the first client device, wherein the second client device is distinct from the first client device, wherein the GUI is defined in a first frame buffer on the server and is associated with first state information;

associating the second client device with the currently allocated session when a determination is made to share the currently allocated session;

in response to the determination to share the currently allocated session, pausing all clients that share the currently allocated session and transmitting to said all clients a new key frame to align said all clients that share the currently allocated session, wherein transmitting the new key frame includes sending to the second client device over HTTP, the new key frame that contains an entire image of the first frame buffer on the server; and

sending to the second client device over HTTP, a sequence of updates to the GUI of the application or the desktop running on the server contained in the first frame buffer and using the first state information associated with the currently allocated session.

10. The non-transitory computer-readable medium of claim 9, the method further comprising:

allocating a new session having a new session connection profile when a determination is made to not share the currently allocated session;

associating the second client device with the new session when the determination is made to not share the currently allocated session; and

sending image data to the second client device in accordance with a second frame buffer and second state information associated with the new session when the determination is made to not share the currently allocated session.

11. The non-transitory computer-readable medium of claim 10 wherein allocating the new session comprises:

splitting the currently allocated session into a first new session and a second new session;

associating the first client device with the first session; and

associating the second client device with the second session.

12. The non-transitory computer-readable medium of claim 9 wherein the determining whether to share the currently allocated session with the second client device based on the connection characteristics comprises:

determining a second consumption rate for the second client device; and

determining whether the second consumption rate for the second client device is within a determined range of a first consumption rate associated with a session connection profile of a currently allocated session.

13. The non-transitory computer-readable medium of claim 9 wherein the computer-readable medium is a memory in the computing device.

14. The non-transitory computer-readable medium of claim 9 wherein the contents are instructions that when executed cause the computing device to perform the method.

15. A computing system for sharing a currently allocated session that is allocated to a first client device comprising:

a memory;

a module stored on the memory that is configured, when executed, to;

receive, from a browser operating on a second client device, a hypertext transfer protocol (HTTP) request to remote a graphical user interface (GUI) of an application or a desktop running on a server to the second client device using HTTP requests and responses;

determine connection characteristics for the second client device;

determine whether to share the currently allocated session with the second client device based on the connection characteristics, the currently allocated session being used to remote the GUI of the application or the desktop running on the server to the first client device, wherein the second client device is distinct from the first client device, wherein the GUI is defined in a first frame buffer on the server and is associated with first state information;

associate the second client device with the currently allocated session when a determination is made to share the currently allocated session;

in response to the determination to share the currently allocated session, pause all clients that share the currently allocated session and transmit to said all clients a new key frame to align said all clients that share the currently allocated session, wherein transmitting the new key frame includes sending to the second client device over HTTP, the new key frame that contains an entire image of the first frame buffer on the server; and

send to the second client device over HTTP, a sequence of updates to the GUI of the application or the desktop running on the server contained in the first frame buffer and using the first state information associated with the currently allocated session.

16. The computing system of claim 15 wherein the module is further configured, when executed to:

allocate a new session having a new session connection profile when a determination is made to not share the currently allocated session;

associate the second client device with the new session when the determination is made to not share the currently allocated session; and

send image data to the second client device in accordance with a second frame buffer and second state information associated with the new session when the determination is made to not share the currently allocated session.

17. The computing system of claim 15 wherein the module includes software instructions for execution in the memory of the computing system.

18. The computing system of claim 15 wherein the computing system is a server computing device and the module is a shared remote session manager.

19. The computing system of claim 15 wherein the computing system further comprises:

a server computing device that includes the memory;

a client computing system that receives updated image blocks from the server computing device.