Method for Providing Multiple Mouse Inputs in a Remote Desktop Session

• US 20130212489A1
• Filed: 02/15/2012
• Published: 08/15/2013
• Est. Priority Date: 02/15/2012
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Ivashin, Victor, Nelson, Steve
• Granted Patent: US 8,788,950 B2
• Time in Patent Office: Days
• US Class Current: 715/753
• CPC Class Codes: G06F 2203/0382 Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A computer (host), which is communicating with an interactive whiteboard projector (client) through a remote desktop connection, launches third-party applications supporting multiple mice (i.e. drawing pens) and provides these applications with virtual mouse device and input event signals for each pen device connected on the projector. The applications will behave as if the host system were configured with multiple installed mice, though no added driver or physical connected hardware is present.

Claims

1. A method for providing multiple human interface device inputs in a remote desktop session between a client projector and a host computer, the client projector and the host computer being connected by a network, comprising:

establishing a remote desktop session between the client projector and the host computer;

in the client projector, using the processor to

capture inputs from multiple human interface devices and forward the human interface device inputs to the host computer;

in the host computer, using a processor to

receive the human interface device inputs from the client projector and store and maintain information for each client projector human interface device as a virtual device;

intercept raw input function calls from an application running on the host computer;

collect information for each host computer human interface device; and

return information for each host computer human interface device and information for each virtual device to the application running on the host computer.

2. The method as in claim 1 wherein intercepting raw input function calls comprises processing the function call with a hook handler.

3. The method as in claim 1 further comprising simulating system events for each virtual device including device arrival and device removal events.

4. The method as in claim 1 further comprising maintaining virtual device objects used to name and identify each client projector human interface device.

5. The method as in claim 1 wherein the information returned to the application includes a count and list of host computer human interface device handles and virtual device handles.

6. The method as in claim 1 wherein the inputs from the client projector human interface device include at least one of flags, button states, and coordinate information.

7. The method as in claim 1 wherein the client projector human interface devices are electronic whiteboard pens.

8. The method as in claim 1 further comprising establishing a remote desktop services virtual channel between the host computer and the client projector;

and receiving by the host computer human interface device inputs forwarded from the client projector across the remote desktop services virtual channel.

9. The method as in claim 1 wherein a virtual device is a virtual mouse.

10. A system for providing multiple human interface device inputs in a remote desktop session between a client projector and a host computer, the client projector and the host computer being connected by a network, comprising:

in the client projector, a processor that

establishes a remote desktop session between the client projector and the host computer; and

captures inputs from multiple human interface devices and forwards the human interface device inputs to the host computer;

in the host computer, a processor that

receives the human interface device inputs from the client projector and stores and maintains information for each client projector human interface device as a virtual device;

intercepts raw input function calls from an application running on the host computer;

collects information for each host computer human interface device; and

returns information for each host computer human interface device and information for each virtual device to the application running on the host computer.

11. The system as in claim 10 wherein the host computer processor intercepts raw input function calls by processing the function call with a hook handler.

12. The system as in claim 10 wherein the host computer processor or client projector processor simulates system events for each virtual device including device arrival and device removal events.

13. The system as in claim 10 wherein the host computer processor or client projector processor maintains virtual device objects used to name and identify each client projector human interface device.

14. The system as in claim 10 wherein the information returned to the application includes a count and list of host computer human interface device handles and virtual device handles.

15. The system as in claim 10 wherein the client projector human interface devices are electronic whiteboard pens.

16. The system as in claim 10 further comprising a remote desktop services virtual channel between the host computer and the client projector for receiving by the host computer human interface device inputs forwarded from the client projector.

17. One or more tangible, non-transitory computer-readable media embodying instructions executable by a computer to perform a method for providing multiple human interface device inputs in a remote desktop session between a client projector and a host computer, the client projector and the host computer being connected by a network, the method comprising:

establishing a remote desktop session between the client projector and the host computer;

in the client projector, using the processor to

capture inputs from multiple human interface devices and forward the human interface device inputs to the host computer;

in the host computer, using a processor to

receive the human interface device inputs from the client projector and store and maintain information for each client projector human interface device as a virtual device;

intercept raw input function calls from an application running on the host computer;

collect information for each host computer human interface device; and

return information for each host computer human interface device and information for each virtual device to the application running on the host computer.

18. The one or more tangible, non-transitory computer-readable media of claim 17, wherein intercepting raw input function calls comprises processing the function call with a hook handler.

19. The one or more tangible, non-transitory computer-readable media of claim 17, wherein the method further comprises simulating system events for each virtual device including device arrival and device removal events.

20. The one or more tangible, non-transitory computer-readable media of claim 17, wherein the method further comprises maintaining virtual device objects used to name and identify each client projector human interface device.