Translating user interaction with a touch screen into input commands

• US 8,432,367 B2
• Filed: 11/19/2009
• Issued: 04/30/2013
• Est. Priority Date: 11/19/2009
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Li, Yang, Cleron, Michael A., Hackborn, Dianne K.
• Primary Examiner(s): Haley, Joseph
• Assistant Examiner(s): LEE, NICHOLAS J
• Application Number:
  US12/621,759
• Publication Number:
  US 20110115721A1
• Time in Patent Office: 1,258 Days
• Field of Search: 345173-176
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Systems and techniques for translating user interaction with a touch screen into input commands. In one aspect, a touch screen system includes a touch screen graphical display, a command interpreter configured to identify modifier interactions with the graphical display and, in response to identification of the modifier interaction, modify the interpretation of other interaction with the graphical display, one or more persistent data storage devices. The data storage devices store a first set of rules for interpreting user interaction with the graphical display and a second set of rules for interpreting user interaction with the graphical display. The first set of rules interpret motion across a map or a proper subset of a collection of information as a scrolling or panning command. The second set of rules interpret the motion as a glyph. The command interpreter is configured to modify the interpretation of the other interaction by switching between interpretation under the first set of rules and interpretation under the second set of rules.

Claims

1. A method comprising:

identifying, with a touch screen system of a computing device, a first input entered over a selectable object displayed on a touch screen graphical display of the touch screen system;

determining, with the touch screen system, whether the first input entered over the selectable object matches a predetermined type of input associated with selection of the selectable object; and

in response to determining that the first input entered over the selectable object does not match a predetermined type of input associated with selection of the selectable object, switching, by the computing device, into a glyph input mode that does not involve interaction by the first input with the selectable object, and by which a user of the computing device is enabled by the computing device to provide input by tracing glyphs on the touch screen graphical display.

2. The method of claim 1, further comprising:

after switching the computing device into the glyph input mode, identifying with the touch screen system, a second input on the touch screen graphical display; and

interpreting, with the computing device, the second input as a glyph input.

3. The method of claim 1, wherein the first input comprises contact with the touch screen graphical display at a first location on the touch screen display that overlaps in time with contact at a second location on the touch screen graphical display.

4. The method of claim 2, wherein interpreting the second input as a glyph input comprises interpreting the second input under a set of rules tailored to the identification of alphanumeric characters.

5. The method of claim 1, wherein the selectable object comprises a user-selectable icon on the touch screen graphical display.

6. The method of claim 2, wherein interpreting the second input as a glyph input comprises disabling of finger dragging interactions as scrolling or panning commands.

7. The method of claim 1, further comprising the touch screen system pinning the touch screen graphical display in response to determining that the first input over the selectable object does not match a predetermined type of input associated with selection of the selectable object.

8. The method of claim 7, wherein pinning the touch screen graphical display comprises maintaining all images presented on the graphical display completely immobile.

9. The method of claim 1, further comprising the touch screen system changing to a new translation mode in response to determining that the first input over the selectable object does not match a predetermined type of input associated with selection of the selectable object.

10. The method of claim 9, wherein the new translation mode comprises a glyph translation mode tailored to interpret user interaction involving multiple finger drags across the touch screen graphical display as glyphs.

11. A touch screen system comprising:

a touch screen graphical display;

a command interpreter configured to identify modifier interactions with the graphical display and, in response to identification of the modifier interaction, modify the interpretation of other interaction with the graphical display; and

one or more persistent data storage devices, the data storage devices storing a first set of rules for interpreting user interaction with the graphical display and a second set of rules for interpreting user interaction with the graphical display, the first set of rules interpreting motion across a map or a proper subset of a collection of information as a scrolling or panning command, the second set of rules interpreting the motion as a glyph,

wherein the command interpreter is configured to modify the interpretation of the other interaction by switching between interpretation under the first set of rules and interpretation under the second set of rules in response to determining that a first input over a selectable object on the touch screen graphical display does not match a type of input associated with selection of the selectable object.

12. The touch screen system of claim 11, further comprising a collection of map information stored at the one or more persistent data storage devices.

13. The touch screen system of claim 11, further comprising a hand-held housing mounting the touch screen graphical display.

14. The touch screen system of claim 11, wherein the command interpreter is further configured to identify contact on a lateral side of the touch screen graphical display as modifier interactions.

15. The touch screen system of claim 11, wherein the command interpreter is further configured to identify stationary contact followed by a timely second contact as modifier interactions.

16. The touch screen system of claim 11, wherein the second set of rules comprises rules for interpreting the motion as a custom glyph.

17. The touch screen system of claim 11, wherein the command interpreter is further configured to identify a pinning command, the pinning command disabling the touch screen system from interpreting a finger dragging input on the touch screen graphical display as a scroll command or as a pan command.

18. The touch screen system of claim 11, wherein:

the touch screen system further comprises a clock; and

the command interpreter is configured to start a timer that relies on the clock in response to identification of a stationary contact with the graphical display.

19. The touch screen system of claim 18, wherein the command interpreter is configured to identify a modifier interaction in response to a second user interaction being received before the timer reaches a threshold period.

20. The touch screen system of claim 18, wherein the threshold period is within 15% of one second.

21. The touch screen system of claim 18, wherein the command interpreter is configured to interpret the stationary contact as a zoom-in command in response to a failure to receive a second user interaction before the timer reaches a threshold period.

22. The touch screen system of claim 18, wherein the command interpreter is configured to interpret the stationary contact as a command directing that that further details regarding an entry contacted by the stationary contact in response to a failure to receive a second user interaction before the timer reaches a threshold period.

23. A touch screen system comprising:

a touch screen graphical display;

means for translating user interaction with a selectable object on the touch screen graphical display into commands that determine which of two different input modes are used, based on a determination of whether the user interaction matches a type of input associated with selection of the selectable object; and

one or more persistent data storage devices storing rules accessible by the means for translating, wherein the rules comprise a first set of rules for interpreting user interaction with the graphical display that is used when the touch screen system is in a first input mode and a second set of rules for interpreting user interaction with the graphical display that is used when the touch screen system is in a second input mode, wherein the second set of rules interprets inputs on the touch screen graphical display as glyph inputs, and wherein the second mode is used in response to determining that an input over the selectable object does not match a type of input associated with selection of the selectable object.

24. The touch screen system of claim 23, wherein the means for translating comprises:

a clock; and

a timer that relies on the clock and configured to start in response to identification of a stationary contact with the touch screen graphical display.