System and Method for Effecting Control of Remote Computers

• US 20090307600A1
• Filed: 01/23/2007
• Published: 12/10/2009
• Est. Priority Date: 01/25/2006
• Status: Active Grant

• Current Assignee: Brandt Technologies Incorporated
• Original Assignee: Brandt Technologies Incorporated
• Inventors: Ward, Mark, Hannan, Dermot, Arthur, Kieran
• Granted Patent: US 8,244,806 B2
• Time in Patent Office: Days
• US Class Current: 715/740
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The invention describes a system and methodology for controlling multiple devices simultaneously from one control device. The control device is provided with a display having a plurality of windows, each having a visual representation related to the activity of the multiple devices. By relaying commands effected at the control device through a intermediary server, it is possible to simultaneously effect a corresponding processing of the same commands at each of the multiple devices. On effecting a command the multiple devices relay back, through the server, an image representative of the result of the processing of that command to the control device for display.

Claims

1. A network system configured to enable simultaneous control of a plurality of target computing devices from a single viewer computing device, the system including:

a viewer device having a display, the viewer device being configured to generate a plurality of graphical windows on the display, the viewer device being configured to be in direct communication with,

a server device, the server device being configured to be in direct communication with each of,

a plurality of client target devices, each of the plurality of target devices being configured to receive input commands from the server device and each of the plurality of target devices being configured to generate display information for forwarding to the server device, and wherein the server device is configured to receive an input effected in one of the windows of the viewer device and to replicate this input so as to provide input commands to each of the target devices and is further configured to receive the display information from the target devices resultant from the input command and relay this information for each target device to the viewer device for display as a separate window on the viewer device, and

an interpretation module being configured to effect digital image processing on the display information generated by the target devices.

2. The system as claimed in claim 1 wherein the communication between the server device and each of the target devices is through a dedicated data socket.

3. The system as claimed in claim 2 wherein the server device has two data sockets for each target device;

one socket configured for communication with the target device and one socket configured for communication with the viewer device.

4. The system as claimed in claim 3 wherein each data socket is bi-directional.

5. The system as claimed in claim 1 wherein commands relayed by the server device to each of the target devices include at least one of:

a keyboard input and supporting data,

a mouse/pointer input and supporting data,

a request for information about the SCT hardware setup,

a request for a screenshot to be taken,

a request to retrieve clipboard contents, or

a request to insert data into clipboard.

6. The system as claimed in claim 1 wherein the communications between the devices is effected through socket connections.

7. The system as claimed in claim 6 wherein each of the devices have running thereon a multi-thread software application.

8. The system as claimed in claim 7 wherein the multi-thread software applications provide a single thread for each socket connection between the viewer device and the server device corresponding with a specific target device.

9. The system as claimed in claim 7 wherein the multi-thread software applications provide a single thread for each socket connection between each target device and the server device.

10. The system as claimed in claim 1 further including an interpretation device, the interpretation device being coupled to a database having stored therein a plurality of user predefined records, the interpretation device being configured to be in communication with the server device and being configured to receive the commands relayed from the viewer device and to provide digital image processing and database look up operations on those commands so as to interpret those commands for subsequent execution on each of the target devices.

11. The system as claimed in claim 10 wherein the interpretation device is configured to perform image segmentation and image process commands received from the viewer device.

12. The system as claimed in claim 11 wherein the interpretation device is configured to provide for optical character recognition on commands received from the viewer device so as to define recognised characters resultant from images received from the viewer device.

13. The system as claimed in claim 12 wherein the viewer device and at least one of the client target devices provide displays in different language, the server device being configured to effect a translation of the recognised characters from the viewer device into a language appropriate for the target device, the translated characters being used to effect a corresponding command on the target device.

14. The system as claimed in claim 1 being configured to operate in a mimic mode, operation of the mimic mode enabling a user at the viewer device to select one of the displayed windows at the viewer device as a controller window, with commands effected in that window being replicated across each of the client target devices and the results of those commands at each of the client target devices being displayed in specific others of the displayed windows on the viewer device, each of the specific others of the displayed windows being uniquely associated with a specific client target device.

15. The system as claimed in claim 14 wherein a plurality of commands are provided, the commands provided in the form of a script, the scripts being recorded at a first instance in time and being re-playable at a later user defined instant in time.

16. The system as claimed in claim 14, being further configured, on execution of a command in the controller, of effecting the step of recording a graphic of an area surrounding that command, the graphic being generated and stored for each interaction between the user and the controller window, and being storable at the server device.

17. The system as claimed in claim 15 being further configured, on execution of a command in the controller, of effecting the step of recording a graphic of an area surrounding that command, the graphic being generated and stored for each interaction between the user and the controller window, and being storable at the server device and wherein the system further includes an interpretation device, the interpretation device being configured during playback of the script to compare the images resultant from an execution of the commands at each of the target devices with the images resultant from the original recordal of the script.

18. The system as claimed in claim 17 wherein the interpretation device is configured, on determining that a match exists between the images resultant from the original recordal of the script and the images resultant from execution of the script, of effecting a display at the client device of a successful execution of the script.

19. The system as claimed in claim 16 further including an interpretations device, the interpretation device being configured to use the images resultant from an execution of a command at the controlling device to determine the screen co-ordinates for user input on the target devices.

20. The system as claimed in claim 14 being further configured, on execution of a command in the controller, of effecting the step of recording a graphic of an area surrounding that command, the graphic being generated and stored for each interaction between the user and the controller window, the system further including an interpretations device, the interpretation device being configured to provide an analysis of the graphics associated with each command executed on the controller window and determining an appropriate command for execution on each of the target devices.

21. The system as claimed in claim 20, wherein the determination of an appropriate command includes the step of determining an equivalent region in the window associated with each test device for application of the command executed in the controller window.

22. The system as claimed in claim 21 wherein the determination of an equivalent region is effected by performance of an optical character recognition function on the window of the test device.

23. A computer implemented method of enabling simultaneous control of a plurality of target computing devices from a single viewer computing device, the method including the steps of:

providing a first software module, the first software module being executable on a viewer device having a display, the first software module being configured to generate a plurality of graphical windows on the display,

providing a second software module, the second software module being executable on a server device and providing for communication interface between the viewer device and a plurality of client target devices,

providing a third software module, the third software module being executable on one or more of the plurality of client target devices, the second target module configured to enable each of the plurality of client target devices on which it is executing to receive input commands from the server device and to generate display information for forwarding to the server device, and wherein execution of, and interface between, each of the three software modules provides for the transmission of an command effected in one of the windows of the viewer device through the server device for replication at each of the target devices and for generation of display information from the target devices resultant from the command and a relay of this information for each target device to the viewer device via the server device for display as a separate window on the viewer device to confirm replication of the command, and

providing an interpretation software module which is configured to effect digital image processing on the display information generated by the target devices.

24. A computer program having a plurality of individual modules which when run on one or more computing devices are configured to carry out the method steps of claim 23.