Handling touch inputs based on user intention inference

• US 9,652,132 B2
• Filed: 01/28/2013
• Issued: 05/16/2017
• Est. Priority Date: 01/27/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Tabone, Ryan
• Primary Examiner(s): Sitta, Grant
• Assistant Examiner(s): BOGALE, AMEN W
• Application Number:
  US13/752,342
• Publication Number:
  US 20150212580A1
• Time in Patent Office: 1,569 Days
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Users can navigate and manipulate content, such as by scrolling a document or selecting content in the document, by using various touch inputs that indicate a behavior that the user is trying to perform. In order to improve the user interface experience for a user, embodiments analyze touch inputs to determine when a user would like to perform a navigational jump and then execute such a jump, based on the specific touch inputs involved.

Claims

1. A computer-implemented method for handling one or more touch inputs on a computing device, the method comprising:

displaying at least a portion of application content on a display associated with the computing device;

receiving one or more touch inputs from a user at an input device associated with the computing device;

determining the one or more touch inputs comprise a first gesture and a second gesture performed in succession, wherein the first gesture comprises a drawing gesture which selects a portion of the application content defining a unit of application content, the defined unit of application content being a structure or area of the application content;

determining the second gesture has a criteria of movement that satisfies a predetermined criteria;

determining, in response to the second gesture having the criteria of movement satisfying the predetermined criteria, a plurality of units of the application content based on the second gesture, the determined plurality of units being determined in increments of the defined unit of application content, the determined plurality of units comprising a portion of the application content that is different than the selected portion of the application content; and

changing the display of the application content by selecting the determined plurality of units, or scrolling the application content according to the determined plurality of units.

2. The method of claim 1, wherein each touch input is associated with a speed and trajectory, and wherein the predetermined criteria comprises at least one of a predetermined velocity and a predetermined direction.

3. The method of claim 1, wherein each touch input is associated with a speed and trajectory, and wherein the predetermined criteria comprises a velocity or acceleration curve.

4. The method of claim 1, wherein the one or more touch inputs comprise a plurality of swipes across the display performed in succession.

5. The method of claim 4, further comprising:

determining an overall navigation direction based on the direction of a swipe of the greatest magnitude, the magnitude being determined by at least one of a length of the swipe and a velocity of the swipe.

6. The method of claim 1, wherein the one or more touch inputs comprise two or more swipes across the display, each having a trajectory and direction within a predefined tolerance of each other.

7. The method of claim 1, wherein the drawing gesture diagonally crosses over the selected portion of the application content.

8. The method of claim 1, wherein the selected portion is a paragraph of the application content.

9. The method of claim 1, wherein changing the display of the application content comprises visually selecting a number of paragraphs for manipulation based on the determined plurality of units and a direction of the second gesture.

10. The method of claim 1, wherein changing the display of the application content comprises scrolling the application content according to the determined plurality of units.

11. The method of claim 1, wherein changing the display of the application content comprises changing a zoom level for the application content.

12. A non-transitory machine-readable medium having machine-executable instructions stored thereon, which when executed by a machine or computer cause the machine or computer to perform a method, comprising:

displaying, on a display coupled to the machine or computer, at least a portion of application content, the application content comprising a plurality of units of content;

receiving one or more touch inputs from a user at an input device associated with the machine or computer;

determining a plurality of gestures performed in succession from the one or more touch inputs, wherein a first gesture of the plurality of gestures comprises a drawing gesture selecting a portion of the application content defining a unit of application content, the defined unit of application content being a structure or an area of the application content;

determining a plurality of units of the application content based on a criteria of movement associated with a second gesture of the plurality of gestures, wherein the determined plurality of units are determined in increments of the defined unit of application content and comprises a portion of the application content that is different than content within the area of the application content; and

changing the display of the application content by selecting the determined plurality of units of content, or scrolling the application content according to the determined plurality of units of content.

13. The non-transitory machine-readable medium of claim 12, wherein the unit of content comprises an image or paragraph of text on a web page displayed by a web browser.

14. The non-transitory machine-readable medium of claim 12, wherein the unit of content comprises one or more features of the application content that are related to how the content is displayed in a particular environment.

15. The non-transitory machine-readable medium of claim 12, wherein a number of the plurality of units of application content is determined based on at least one of a length of the second gesture, a velocity of the second gesture, an acceleration of the second gesture, and a trajectory of the second gesture.

16. The non-transitory machine-readable medium of claim 12, wherein changing the display comprises performing a navigational jump that produces updated content from original content.

17. The non-transitory machine-readable medium of claim 12, further comprising:

determining that an acceleration or a velocity or a trajectory of the second gesture satisfies a predetermined criteria before the plurality of units of application content is determined or the display is changed.

18. The non-transitory machine-readable medium of claim 12, changing the display of the application content comprises:

determining, based on one or more of the plurality of gestures, whether to change the display of the application content by scrolling the determined plurality of units of content or by selecting the determined plurality of units.

19. A system, comprising:

an input device;

a display screen;

a processor; and

a memory having instructions thereon that, when executed by the processor, cause a computing device to;

display application content on the display screen;

receive one or more touch inputs from a user at the input device;

determine a series of gestures from the one or more touch inputs;

determine the series of gestures satisfies a predetermined criteria;

determine a plurality of units of the application content based on a first gesture and a second gesture of the series of gestures, the first gesture selecting a portion of the application content defining a first unit of the units and the second gesture defining a number of the determined plurality of units, including units that are different than the first unit, the plurality of units being determined in increments of the defined first unit of application content based on at least one of a length of the second gesture, a velocity of the second gesture, an acceleration of the second gesture, and a trajectory of the second gesture; and

perform a navigational jump that produces updated content from original content, the navigational jump comprising a selection of the determined plurality of units, or scrolling the application content according to the determined plurality of units.

20. The system of claim 19, wherein the instructions further cause the computing device to:

determine the first gesture encircles a user-selected portion of the application content; and

determine the first unit based on the user-selected portion.