Methods and systems for establishing, hosting and managing a screen sharing session involving a virtual environment

• US 9,268,517 B2
• Filed: 12/07/2011
• Issued: 02/23/2016
• Est. Priority Date: 12/07/2011
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Privat, Guillaume
• Primary Examiner(s): Daftuar, Saket K
• Application Number:
  US13/313,850
• Publication Number:
  US 20140040360A1
• Time in Patent Office: 1,539 Days
• Field of Search: 709/201, 709/202, 709/203, 709/204, 709/205, 709/206, 709/217, 709/218, 709/219, 709/220, 709/221, 709/222, 709/223, 709/224, 709/225, 709/226, 709/227, 709/228, 709/229, 709/230, 709/231, 709/232, 709/233, 709/234, 709/235, 709/242, 709/244, 370/466, 715/740, 715/109, 715/110, 715/4, 707/999.01, 707/E17.01, 707/E17.008, 707/E17.007, 707/E17.119, 707/705, 707/999.205, 713/150, 713/151, 713/152, 713/153
• US Class Current: 1/1
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

Techniques for establishing a screen sharing session are described. Consistent with some embodiments, a web conferencing application executing at a mobile computing device enables a user to specify the identity of a remote computer. The identity of the remote computer is communicated to a web conferencing service, directing the server operating the web conferencing service to establish a remote desktop connection with the remote computer. Once established, the web conferencing service receives from the remote computer a stream of information representing a user interface of the remote computer, and then broadcasts the user interface to all computing devices participating in the web conferencing session, while enabling the mobile computing device to manipulate the user interface of the remote computer.

Claims

1. A computer-implemented method comprising:

at a server computer;

establishing, by the server computer, a web conferencing session between a host-computing device and at least one participant-computing device, wherein the host-computing device is associated with a host of the web conferencing session and the at least one participant-computing device is associated with a participant of the web conferencing session, and wherein the host-computing device comprises at least one of a mobile phone or a tablet computer having a touch screen display;

in association with the web conferencing session, broadcasting, by the server computer, a first stream of information to the at least one participant-computing device, the first stream of information representing a first graphical user interface that is generated by the host-computing device;

in association with the web conferencing session, receiving from the host-computing device a request to establish a remote desktop connection with a remote computer in order to share a second graphical user interface that is generated by the remote computer with the at least one participant-computing device, the request comprising an identity of the remote computer, wherein the request comprising the identity of the remote computer is received from the host-computing device based on a prompt for information identifying the remote computer, wherein the remote computer is different from the host-computing device and the at least one participant-computing device;

based on the request comprising the identity of the remote computer and on authorization information received by the server computer from the host-computing device, wherein the authorization information indicates that the host of the web conferencing session is authorized to use the remote computer, establishing, by the server computer, the remote desktop connection with the remote computer, the remote desktop connection including a graphical user interface communication; and

based on the remote desktop connection, broadcasting, by the server computer, a second stream of information representing the second graphical user interface to both the host-computing device and the at least one participant-computing device.

2. The computer-implemented method of claim 1, wherein the second stream of information representing the second graphical user interface is received at the server computer over the remote desktop connection and the second stream of information is encoded and communicated from the remote computer to the server computer in accordance with a remote connection protocol, the method further comprising:

converting the second stream of information consistent with a video codec prior to broadcasting the second stream of information representing the second graphical user interface to the host-computing device and the at least one participant-computing device.

3. The computer-implemented method of claim 2, wherein:

the remote connection protocol is, or is based on, one of the following;

Remote Desktop Protocol (RDP), Independent Computing Architecture (ICA), Remote FrameBuffer (RFB), or Virtual Network Computing (VNC);

a video protocol for broadcasting the second stream of information representing the second graphical user interface is, or is based on, one of the following;

Real Time Messaging Protocol (RTMP), Real Time Media Flow Protocol (RTMFP), Real-time Transport Protocol (RTP), or Hypertext Transport Protocol (HTTP); and

the video codec is, or is based on, one of the following;

Sorenson H263, zlib, H.264, VP6, or VPA.

4. The computer-implemented method of claim 1, further comprising:

at a host interface module of the server computer, receiving from the host-computing device information representing a user input intended for a software application executing at the remote computer; and

communicating the information representing the user input to the remote computer for processing by the software application.

5. The computer-implemented method of claim 4, wherein the user input intended for the software application executing at the remote computer is received at the server computer as a result of a user interacting with a user interface for a web conferencing application executing at the host-computing device, the user interface presented via the touch screen display.

6. The computer-implemented method of claim 1, wherein the identity of the remote computer is specified as a hostname or Internet Protocol (IP) address and is received at the server computer during the web conferencing session.

7. A server to operate a web conferencing service, the server comprising:

a processor; and

a memory device in communication with the processor, the memory device for storing instructions that, when executed by the processor, cause the processor to;

establish a web conferencing session between a host-computing device and at least one participant-computing device, wherein the host-computing device is associated with a host of the web conferencing session and the at least one participant-computing device is associated with a participant of the web conferencing session, and wherein the host-computing device comprises at least one of a mobile phone or a tablet computer having a touch screen display,

in association with the web conferencing session, establish a remote desktop connection with a remote computer having a graphical user interface, wherein the remote desktop connection is based on an identity of the remote computer provided by the host-computing device, wherein the identity of the remote computer is received from the host-computing device based on a prompt for information identifying the remote computer, wherein the remote computer is different from the host-computing device and the at least one participant-computing device, and

based on the remote desktop connection, cause a stream of information representing the graphical user interface of the remote computer to be broadcast to the host-computing device and the at least one participant-computing device.

8. The server of claim 7, wherein the stream of information representing the graphical user interface is received at the server over the remote desktop connection and is encoded and communicated from the remote computer to the server in accordance with a remote connection protocol, wherein the instructions executed by the processor further cause the processor to:

convert the stream of information consistent with a video codec prior to broadcasting the stream of information representing the graphical user interface to the host-computing device and the at least one participant-computing device.

9. The server of claim 8, wherein:

the remote connection protocol is, or is based on, one of the following;

Remote Desktop Protocol (RDP), Independent Computing Architecture (ICA), Remote FrameBuffer (RFB), or Virtual Network Computing (VNC);

a video protocol for broadcasting the stream of information representing the graphical user interface is, or is based on, one of the following;

Real Time Messaging Protocol (RTMP), Real Time Media Flow Protocol (RTMFP), Real-time Transport Protocol (RTP), or Hypertext Transport Protocol (HTTP); and

the video codec is, or is based on, one of the following;

Sorenson H263, zlib, H.264, VP6, or VPA.

10. The server of claim 7, wherein the instructions executed by the processor further cause the processor to:

receive from the host-computing device information representing a user input intended for a software application executing at the remote computer; and

communicate the information representing the user input to the remote computer for processing by the software application.

11. The server of claim 10, wherein user input intended for the software application executing at the remote computer is received at the server as a result of a user interacting with a user interface for a web conferencing application executing at the host-computing device, the user interface presented via the touch screen display.

12. The server of claim 7, wherein the identity of the remote computer is specified as a hostname or Internet Protocol (IP) address and is received at the server during the web conferencing session.

13. A computer-implemented method comprising:

at a mobile computing device that is associated with a host of a web conferencing session;

presenting a user interface element via a touch screen display of the mobile computing device, the user interface element prompting for information identifying a remote computer with which a remote desktop connection is to be established and enabling a user to provide an identity of the remote computer;

receiving the information identifying the remote computer with which the remote desktop connection is to be established, the remote computer having a graphical user interface that is to be shared with the mobile computing device and at least one participant-computing device that is associated with a participant of the web conferencing session, and wherein the remote computer is different from the mobile computing device and the at least one participant-computing device;

based on receiving the information identifying the remote computer, communicating, by the mobile computing device, the information identifying the remote computer to a server operating a web conferencing service with a first command directing the web conferencing service to establish the remote desktop connection with the remote computer;

in response to the first command, receiving from the web conferencing service a stream of information being broadcast to the mobile computing device and the at least one participant-computing device, the stream of information representing the graphical user interface of the remote computer; and

presenting the graphical user interface of the remote computer on the touch screen display of the mobile computing device.

14. The computer-implemented method of claim 13, wherein the identity of the remote computer is specified as a hostname or an Internet Protocol (IP) address.

15. The computer-implemented method of claim 13, further comprising:

receiving a user input via the touch screen display of the mobile computing device;

converting the user input into a second command to be processed by the remote computer; and

communicating the second command to the web conferencing service to be forwarded to the remote computer.

16. A machine-readable storage device storing instructions, which, when executed by a processor of a host-computing device that is associated with a host of a web conferencing session, cause the host-computing device to:

present a user interface element via a touch screen display of the host-computing device, the user interface element prompting for information identifying a remote computer with which a remote desktop connection is to be established and enabling a user to provide an identity of the remote computer;

receive the information identifying the remote computer with which the remote desktop connection is to be established, the remote computer having a graphical user interface;

based on receiving the information identifying the remote computer, communicate, by the host-computing device, the information identifying the remote computer to a server operating a web conferencing service with a first command directing the web conferencing service to establish the remote desktop connection with the remote computer in order to share the graphical user interface of the remote computer with at least one participant-computing device that is associated with a participant of the web conferencing session, wherein the remote computer is different from the host-computing device and the at least one participant-computing device;

in response to the first command, receive from the web conferencing service a stream of information being broadcast to the host-computing device and the at least one participant-computing device, the stream of information representing the graphical user interface of the remote computer; and

present the graphical user interface of the remote computer on a display of the host-computing device.

17. The machine-readable storage device of claim 16, wherein the identity of the remote computer is specified as a hostname or an Internet Protocol (IP) address.

18. The machine-readable storage device of claim 16, storing additional instructions, which, when executed by the processor of the host-computing device, cause the host-computing device to:

receive user input via the touch screen display of the host-computing device;

convert the user input into a second command to be processed by the remote computer; and

communicate the second command to the web conferencing service to be forwarded to the remote computer for processing.