Enhanced input using touch screen

• US 8,446,363 B1
• Filed: 06/07/2011
• Issued: 05/21/2013
• Est. Priority Date: 12/30/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Queru, Jean-Baptiste Maurice
• Primary Examiner(s): DINH, DUC Q
• Application Number:
  US13/154,853
• Time in Patent Office: 714 Days
• Field of Search: 345/156, 345169-181, 345 11- 13, 345 21- 23
• US Class Current: 345/156
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Provided are methods and systems for enhanced input using a touch screen, as well as computer programs encoded on computer storage devices and configured to perform the actions of the methods. One or more applications executing on a mobile device receive a user input through the touch screen of the mobile device, without displaying information identifying a command associated with the user input on the touch screen. The one or more applications then determine the command associated with the received user input and display a result of applying the command on an external display that is connected to the mobile device.

Claims

1. A computer-implemented method comprising:

defining, by an application executing on a mobile device that (i) has a touch screen on which a first user interface is displayed, and (ii) is operatively coupled to, and provides a different, second user interface for display on, an external display, two or more non-overlapping input regions on the touch screen;

displaying, by the application executing on the mobile device, a border around each of the non-overlapping input regions in the first user interface on the touch screen, without displaying information that explicitly identifies a respective command associated with each input region in the first user interface on the touch screen;

receiving, by the application executing on the mobile device, a user input at a first input region from the two or more non-overlapping input regions on the touch screen;

determining, by the application executing on the mobile device, a command associated with the user input at the first input region; and

outputting, by the application executing on the mobile device, and for display at the external display, an updated second user interface, the updated second user interface being based on execution of the command.

2. The method of claim 1, wherein the two or more input regions are defined by the application before the user input is received.

3. The method of claim 1, comprising:

identifying a state of the application;

wherein determining the command further comprises determining the command associated with the state of the media player application executing on the mobile device.

4. The method of claim 1, comprising displaying information identifying the application in the first user interface on the touch screen.

5. The method of claim 1, comprising displaying information identifying one or more gestures associated with each respective command.

6. The method of claim 1, wherein the application comprises a navigation application.

7. The method of claim 1, wherein the application comprises a gaming application.

8. A mobile device comprising:

an external display interface through which the mobile device is operatively coupled to, and provides a second user interface for display on, an external display;

a touch screen on which a first user interface is displayed;

one or more processors; and

a non-transitory computer-readable storage medium coupled to the one or more processors having instructions stored thereon which, if executed by the one or more processors, cause the one or more processors to perform operations comprising;

defining, by an application executing on the mobile device, two or more nonoverlapping input regions on the touch screen;

displaying, by the application executing on the mobile device, a border around each of the non-overlapping input regions in the first user interface on the touch screen, without displaying information identifying a respective command associated with each input region in the first user interface on the touch screen;

receiving, by the application executing on the mobile device, a user input at a first input region from the two or more non-overlapping input regions on the touch screen;

determining, by the application executing on the mobile device, a command associated with the user input at the first input region; and

outputting, by the application executing on the mobile device, and for display at the external display, an updated second user interface, the updated second user interface being based on execution of the command.

9. The device of claim 8, wherein the two or more input regions are defined by the application before the user input is received.

10. The device of claim 8, wherein the operations comprise:

identifying a state of the application;

wherein determining the command further comprises determining the command associated with the state of the application executing on the mobile device.

11. The device of claim 8, wherein the operations comprise displaying information identifying the application in the first user interface on the touch screen.

12. The device of claim 8, wherein the operations comprise displaying information identifying one or more gestures associated with each respective command.

13. The device of claim 8, wherein the application comprises a navigation application.

14. The device of claim 8, wherein the application comprises a gaming application.

15. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising:

defining, by an application executing on a mobile device that (i) has a touch screen on which a first user interface is displayed, and (ii) is operatively coupled to, and provides a different, second user interface for display on, an external display, two or more non-overlapping input regions on the touch screen;

displaying, by the application executing on the mobile device, a border around each of the non-overlapping input regions in the first user interface on the touch screen, without displaying information that explicitly identifies a respective command associated with each input region in the first user interface on the touch screen;

receiving, by the application executing on the mobile device, a user input at a first input region from the two or more non-overlapping input regions on the touch screen;

determining, by the application executing on the mobile device, a command associated with the user input at the first input region; and

outputting, by the application executing on the mobile device, and for display at the external display, an updated second user interface, the updated second user interface being based on execution of the command.

16. The medium of claim 15, wherein the two or more input regions are defined by the application before the user input is received.

17. The medium of claim 15, wherein the operations comprise:

identifying a state of the application;

wherein determining the particular command further comprises determining the particular command associated with the state of the media player application executing on the mobile device.

18. The medium of claim 15, wherein the operations comprise displaying information identifying the application in the first user interface on the touch screen.

19. The medium of claim 15, wherein the operations comprise displaying information identifying one or more gestures associated with each respective command.

20. The medium of claim 15, wherein the application comprises a navigation application.