Method and system for browser-based control of a remote computer

• US 9,471,694 B2
• Filed: 05/30/2012
• Issued: 10/18/2016
• Est. Priority Date: 05/30/2011
• Status: Active Grant

• Current Assignee: ClearSlide Incorporated (BigTinCan Holdings Limited)
• Original Assignee: ClearSlide Incorporated (BigTinCan Holdings Limited)
• Inventors: Lieb, Adam Michael, Benton, James L.
• Primary Examiner(s): Chow, Doon
• Assistant Examiner(s): Dasgupta, Shourjo
• Application Number:
  US13/484,253
• Publication Number:
  US 20120317487A1
• Time in Patent Office: 1,602 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor

Abstract

A method and system for remote control of a presenter'"'"'s computer screen using only web browsers is described. Viewers are able to view representation of a presenter'"'"'s screen on a screen of the viewer'"'"'s device and remotely control the presenter'"'"'s screen directly from a web browser, without any downloads, plugins, or dialog boxes. Viewer control events are captured by the browser, sent to a server, and transmitted to the presenter'"'"'s computer. A program running on the presenter'"'"'s computer executes the control events, updates the presenter'"'"'s screen, and transmits images of the updated screen back to the viewers.

Claims

1. A computer-implemented method comprising:

detecting at a server a screen sharing instruction from a presenter during a synchronous presentation session in which the server is configured to transfer a sequence of presentation slides corresponding to a presentation, which is stored on the server and associated with the presenter, to one or more viewers responsive to the presenter controlling the sequence;

in response to detecting the screen sharing instruction from the presenter, transmitting by the server a presentation viewing webpage to a presenter browser, the presentation viewing webpage configured to capture images of a presenter'"'"'s screen associated with a presenter device, wherein the presentation viewing webpage includes a screen sharing applet or a plurality of web browser instructions;

receiving at the server the images of the presenter'"'"'s screen associated with the presenter device for sharing with the one or more viewers;

transmitting by the server the received images of the presenter'"'"'s screen to the one or more viewers via a viewer webpage that is suitable for loading in a viewer web browser, wherein the viewer webpage includes an embedded script that is configured to (1) display the images of the presenter'"'"'s screen without requiring an applet in the viewer web browser, and (2), when permitted, capture a plurality of control events and transmit the plurality of control events to the server;

detecting at the server an instruction allowing the one or more viewers to take control of the presenter'"'"'s screen;

receiving from a first embedded script loaded in the a web browser of a first viewer control events performed by the first viewer to remotely control the presenter'"'"'s screen, wherein the control events are performed by the first viewer in relation to what is displayed in the viewer web browser; and

transmitting by the server the control events performed by the first viewer to the screen sharing applet or another applet running in the presentation viewing webpage, wherein the screen sharing applet or another applet executes the control events on the presenter'"'"'s screen;

tracking an idle timeout period;

transmitting subsequent control events from the first viewer to the screen sharing applet or the another applet for execution on the presenter'"'"'s screen if the subsequent control events are received within the idle timeout period;

otherwise, transmitting control events received from a second viewer to the screen sharing applet or the another applet for execution if the second viewer executes control events.

2. The method of claim 1, further comprising:

receiving from the screen sharing applet or the another applet updated images of the presenter'"'"'s screen after the screen sharing applet or the another applet executes the control events on the presenter'"'"'s screen; and

transmitting the updated images to the one or more viewers via the viewer webpage.

3. The method of claim 1, further comprising persistently storing the received images of the presenter'"'"'s screen.

4. The method of claim 3, further comprising playing back the stored images of the presenter'"'"'s screen as an interactive series of images at a later time.

5. The method of claim 1, further comprising storing the received control events.

6. The method of claim 1, wherein the first viewer is one of the viewers viewing the images of the presenter'"'"'s screen.

7. The method of claim 6, further comprising maintaining statistics pertaining to sharing the presenter'"'"'s screen, wherein statistics includes at least one of how long the presenter'"'"'s screen was shared, identification of the plurality of viewers, the first viewer'"'"'s control events with the first viewer'"'"'s identification, additional control events performed by additional viewers with the additional viewers'"'"' identification.

8. The method of claim 1, further comprising:

transmitting a command to the embedded script to display a user interface message on the viewer device that the first viewer has lost control of the presenter'"'"'s screen if the first viewer is idle longer than the idle timeout period and the second viewer executes control events.

9. The method of claim 8, further comprising:

receiving from the presenter a selected viewer for controlling the presenter'"'"'s screen;

transmitting only additional control events from the selected viewer for execution on the presenter'"'"'s screen.

10. The method of claim 8, further comprising:

receiving a first input from the presenter to stop transmitting control events from the plurality of viewers;

transmitting a command to the embedded script on an interrupted viewer'"'"'s webpage to display a user interface message on the interrupted viewer'"'"'s device that the interrupted viewer has lost control of the presenter'"'"'s screen.

11. The method of claim 10, further comprising:

receiving a second input from the presenter to resume transmitting control events from the plurality of viewers.

12. The method of claim 1, further comprising:

upon receiving at the server presenter control events performed by the presenter, pre-empting any viewer'"'"'s control of the presenter'"'"'s screen;

returning control of the presenter'"'"'s screen to the presenter;

transmitting a command to the embedded script on the pre-empted viewer'"'"'s webpage to display a user interface message on the pre-empted viewer'"'"'s device that the pre-empted viewer has lost control of the presenter'"'"'s screen.

13. The method of claim 12, further comprising:

tracking a presenter idle timeout period;

transmitting additional control events from any viewer to the screen sharing applet or the another applet for execution on the presenter'"'"'s screen if the additional control events are received after the presenter idle timeout period.

14. The method of claim 1, wherein control events include one or more of:

mouse movements, mouse button clicks, mouse wheel rotations, mouse wheel clicks, and keyboard inputs.

15. The method of claim 1, wherein the images of the presenter'"'"'screen shared with the viewer only show a portion of the presenter'"'"'screen.

16. The method of claim 1, wherein the presenter and viewer web browser are software programs that can access web sites and information over a network.

17. A server system comprising:

a processor; and

a memory storing a plurality of instructions which, when executed by the processor, configure the processor to;

detect a screen sharing instruction from a presenter during a synchronous presentation session in which the server is configured to transfer a sequence of presentation slides corresponding to a presentation, which is stored on the server and associated with the presenter, to one or more viewers responsive to the presenter controlling the sequence;

in response to detecting the screen sharing instruction from the presenter, transmit a presentation viewing webpage to a presenter browser, the presentation viewing webpage configured to capture images of a presenter'"'"'s screen associated with a presenter device, wherein the presentation viewing webpage including a screen sharing applet or a plurality of web browser instructions;

receive the images of the presenter'"'"'s screen associated with the presenter device for sharing with the one or more viewers;

transmit the received images of the presenter'"'"'s screen to the one or more viewers via a viewer webpage that is suitable for loading in a viewer web browser, wherein the viewer webpage includes an embedded script that is configured to (1) display the images of the presenter'"'"'s screen without requiring an applet in the viewer web browser, and (2), when permitted, capture a plurality of control events and transmit the plurality of control events to the server;

detect an instruction allowing the one or more viewers to take control of the presenter'"'"'s screen;

receive from a first embedded script loaded in the a web browser of a first viewer control events performed by the first viewer to remotely control the presenter'"'"'s screen, wherein the control events are performed by the first viewer in relation to what is displayed in the viewer web browser;

transmit the control events performed by the first viewer to the screen sharing applet or another applet running in the presentation viewing webpage, wherein the screen sharing applet or the another applet executes the control events on the presenter'"'"'s screen;

track an idle timeout period; and

transmit subsequent control events from the first viewer to the screen sharing applet or the another applet for execution on the presenter'"'"'s screen if the subsequent control events are received within the idle timeout period;

otherwise, transmit control events received from a second viewer to the screen sharing applet or the another applet for execution if the second viewer executes control events.

18. The server of claim 17, the processor further configured to:

receive from the screen sharing applet or the another applet updated images of the presenter'"'"'s screen after the screen sharing applet or the another applet executes the control events on the presenter'"'"'s screen; and

transmit the updated images to the one or more viewers via the viewer webpage.

19. The server of claim 17, the processor further configured to persistently store the received images of the presenter'"'"'s screen.

20. The server of claim 19, the processor further configured to play back the stored images of the presenter'"'"'s screen as an interactive series of images at a later time.

21. The server of claim 17, the processor further configured to store the received control events.

22. The server of claim 17, wherein the first viewer is one of the viewers viewing the images of the presenter'"'"'s screen.

23. The server of claim 22, the processor further configured to maintain statistics pertaining to sharing the presenter'"'"'s screen, wherein statistics includes at least one of how long the presenter'"'"'s screen was shared, identification of the plurality of viewers, the first viewer'"'"'s control events with the first viewer'"'"'s identification, additional control events performed by additional viewers with the additional viewers'"'"' identification.

24. The server of claim 17, the processor further configured to:

transmit a command to the embedded script to display a user interface message on the viewer device that the first viewer has lost control of the presenter'"'"'s screen if the first viewer is idle longer than the idle timeout period and the second viewer executes control events.

25. The server of claim 24, the processor further configured to:

receive from the presenter a selected viewer for controlling the presenter'"'"'s screen;

transmit only additional control events from the selected viewer for execution on the presenter'"'"'s screen.

26. The server of claim 24, the processor further configured to:

receive a first input from the presenter to stop transmitting control events from the plurality of viewers;

transmit a command to the embedded script on an interrupted viewer'"'"'s webpage to display a user interface message on the interrupted viewer'"'"'s device that the interrupted viewer has lost control of the presenter'"'"'s screen.

27. The server of claim 26, the processor further configured to:

receive a second input from the presenter to resume transmitting control events from the plurality of viewers.

28. The server of claim 17, the processor further configured to:

upon receiving at the server presenter control events performed by the presenter, pre-empt any viewer'"'"'s control of the presenter'"'"'s screen;

return control of the presenter'"'"'s screen to the presenter;

transmit a command to the embedded script on the pre-empted viewer'"'"'s webpage to display a user interface message on the pre-empted viewer'"'"'s device that the pre-empted viewer has lost control of the presenter'"'"'s screen.

29. The server of claim 28, the processor further configured to:

track a presenter idle timeout period;

transmit additional control events from any viewer to the screen sharing applet or the another applet for execution on the presenter'"'"'s screen if the additional control events are received after the presenter idle timeout period.

30. The server of claim 17, wherein control events include one or more of:

mouse movements, mouse button clicks, mouse wheel rotations, mouse wheel clicks, and keyboard inputs.

31. The server of claim 17, wherein the images of the presenter'"'"'s screen shared with the viewer only show a portion of the presenter'"'"'s screen.

32. The server of claim 17, wherein the presenter and viewer web browser are software programs that can access web sites and information over a network.