Using a Touch-Sensitive Display of a Mobile Device with a Host Computer

• US 20120075204A1
• Filed: 09/27/2010
• Published: 03/29/2012
• Est. Priority Date: 09/27/2010
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Murray, Abraham, Faller, Jeremy
• Application Number:
  US12/891,771
• Publication Number:
  US 20120075204A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2209/544 Remote
• CPC Class Codes: G06F 2209/545 Gui
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04H 60/80 characterised by transmission among terminal devices
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals

Abstract

A touch-sensitive display of a mobile device is used to control applications executing on a host computer. A communications link is established between the host computer and the mobile device. A graphical user interface (GUI) from the host computer is delegated to the touch-sensitive display of the mobile device via the communications link. The mobile device is adapted to show the delegated GUI on the touch-sensitive display of the mobile device, wherein a user can interact with the displayed GUI. The host computer receives data describing the user interactions with the delegated GUI shown on the touch-sensitive display of the mobile device via the communications link. The host computer executes an instruction on the host computer based in part on the received data describing the user interaction.

Claims

1. A computer-implemented method of using a touch-sensitive display of a mobile device with a host computer, comprising:

establishing a communications link between the host computer and the mobile device;

delegating a mirrored graphical user interface (GUI) at a first resolution from the host computer to the touch-sensitive display of the mobile device via the communications link, wherein the mobile device is adapted to show the delegated mirrored GUI on the touch-sensitive display of the mobile device at a second resolution different than the first resolution;

receiving data describing a user interaction with the delegated GUI shown on the touch-sensitive display of the mobile device via the communications link; and

executing an instruction on the host computer based at least in part on the received data describing the user interaction.

2. The computer implemented method of claim 1, wherein establishing a communications link comprises establishing a wireless point-to-point communications link between the host computer and the mobile device.

3. The computer-implemented method of claim 1, wherein establishing a communications link comprises:

establishing a communications link between the host computer and a plurality of mobile devices using a multicast network protocol.

4. The computer-implemented method of claim 1, further comprising registering the touch-sensitive display of the mobile device as an input/output (I/O) device for the host computer.

5. The computer-implemented method of claim 4, wherein the registering registers the touch-sensitive display of the mobile device at a display primitives layer, wherein the host computer can send image rendering and accelerating commands to the mobile device at the display primitives layer.

6. The computer-implemented method of claim 1, further comprising:

receiving updated resolution information associated with a mobile device responsive to a change in orientation of the mobile device; and

updating the GUI responsive to the updated resolution information.

7. The computer-implemented method of claim 1, wherein receiving data describing a user interaction with the delegated GUI comprises receiving gesture-based controls performed by a user on a touch-sensitive display of the mobile device.

8. The computer-implemented method of claim 1, wherein the first resolution is greater than the second resolution, and wherein the mobile device is adapted to allow a user to zoom into the delegated mirrored GUI via a user interaction with the touch-sensitive display.

9. The computer-implemented method of claim 1, further comprising:

generating a customized GUI adapted to the touch-sensitive display; and

delegating the customized GUI to the touch-sensitive display of the mobile device, wherein a user of the mobile device can use the customized GUI to control the host computer.

10. The computer-implemented method of claim 1, wherein the data describing the user interaction with the delegated GUI indicate that a user requested a task be performed by an application executing on the host computer and executing an instruction on the host computer comprises:

interacting with the application executing on the host computer to perform the requested task.

11. The computer-implemented method of claim 1, further comprising:

delegating a task from the host computer to the mobile device responsive to the data describing the user interaction with the delegated GUI.

12. A non-transitory computer-readable storage medium encoded with executable computer program code for using a touch-sensitive display of a mobile device with a host computer, the computer program code comprising program code for:

establishing a communications link between the host computer and the mobile device;

delegating a mirrored graphical user interface (GUI) at a first resolution from the host computer to the touch-sensitive display of the mobile device via the communications link, wherein the mobile device is adapted to show the delegated mirrored GUI on the touch-sensitive display of the mobile device at a second resolution different than the first resolution;

receiving data describing a user interaction with the delegated GUI shown on the touch-sensitive display of the mobile device via the communications link; and

executing an instruction on the host computer based at least in part on the received data describing the user interaction.

13. The non-transitory computer-readable storage medium of claim 12, wherein establishing a communications link comprises establishing a wireless point-to-point communications link between the host computer and the mobile device.

14. The non-transitory computer-readable storage medium of claim 12, wherein establishing a communications link comprises:

establishing a communications link between the host computer and a plurality of mobile devices using a multicast network protocol.

15. The non-transitory computer-readable storage medium of claim 12, further comprising registering the touch-sensitive display of the mobile device as an input/output (I/O) device for the host computer.

16. The non-transitory computer-readable storage medium of claim 12, wherein the registering registers the touch-sensitive display of the mobile device at a display primitives layer, wherein the host computer can send image rendering and accelerating commands to the mobile device at the display primitives layer.

17. The non-transitory computer-readable storage medium of claim 12, further comprising:

receiving updated resolution information associated with a mobile device responsive to a change in orientation of the mobile device; and

updating the GUI responsive to the updated resolution information.

18. The non-transitory computer-readable storage medium of claim 12, wherein receiving data describing a user interaction with the delegated GUI comprises receiving gesture-based controls performed by a user on a touch-sensitive display of the mobile device.

19. The non-transitory computer-readable storage medium of claim 12, wherein the first resolution is greater than the second resolution, and wherein the mobile device is adapted to allow a user to zoom into the delegated mirrored GUI via a user interaction with the touch-sensitive display.

20. The non-transitory computer-readable storage medium of claim 12, further comprising:

generating a customized GUI adapted to the touch-sensitive display; and

delegating the customized GUI to the touch-sensitive display of the mobile device, wherein a user of the mobile device can use the customized GUI to control the host computer.

21. The non-transitory computer-readable storage medium of claim 12, wherein the data describing the user interaction with the delegated GUI indicate that a user requested a task be performed by an application executing on the host computer and executing an instruction on the host computer comprises:

interacting with the application executing on the host computer to perform the requested task.

22. The non-transitory computer-readable storage medium of claim 12, further comprising:

delegating a task from the host computer to the mobile device responsive to the data describing the user interaction with the delegated GUI.

23. A computer for using a touch-sensitive display of a mobile device with a host computer, comprising:

a non-transitory computer-readable storage medium storing executable computer program instructions comprising instructions for;

establishing a communications link between the host computer and the mobile device;

delegating a mirrored graphical user interface (GUI) at a first resolution from the host computer to the touch-sensitive display of the mobile device via the communications link, wherein the mobile device is adapted to show the delegated mirrored GUI on the touch-sensitive display of the mobile device at a second resolution different than the first resolution;

receiving data describing a user interaction with the delegated GUI shown on the touch-sensitive display of the mobile device via the communications link; and

executing an instruction on the host computer based at least in part on the received data describing the user interaction.

24. The computer of claim 23, wherein establishing a communications link comprises establishing a wireless point-to-point communications link between the host computer and the mobile device.

25. The computer of claim 23, wherein establishing a communications link comprises:

establishing a communications link between the host computer and a plurality of mobile devices using a multicast network protocol.

26. The computer of claim 23, further comprising registering the touch-sensitive display of the mobile device as an input/output (I/O) device for the host computer.

27. The computer of claim 26, wherein the registering registers the touch-sensitive display of the mobile device at a display primitives layer, wherein the host computer can send image rendering and accelerating commands to the mobile device at the display primitives layer.

28. The computer of claim 23, further comprising:

receiving updated resolution information associated with a mobile device responsive to a change in orientation of the mobile device; and

updating the GUI responsive to the updated resolution information.

29. The computer of claim 23, wherein receiving data describing a user interaction with the delegated GUI comprises receiving gesture-based controls performed by a user on a touch-sensitive display of the mobile device.

30. The computer of claim 23, wherein the first resolution is greater than the second resolution, and wherein the mobile device is adapted to allow a user to zoom into the delegated mirrored GUI via a user interaction with the touch-sensitive display.

31. The computer of claim 23, further comprising:

generating a customized GUI adapted to the touch-sensitive display; and

delegating the customized GUI to the touch-sensitive display of the mobile device, wherein a user of the mobile device can use the customized GUI to control the host computer.

32. The computer of claim 23, wherein the data describing the user interaction with the delegated GUI indicate that a user requested a task be performed by an application executing on the host computer and executing an instruction on the host computer comprises:

interacting with the application executing on the host computer to perform the requested task.

33. The computer of claim 23, further comprising:

delegating a task from the host computer to the mobile device responsive to the data describing the user interaction with the delegated GUI.