Detection of pan and scaling during multi-finger touch interactions

• US 9,910,579 B2
• Filed: 04/15/2013
• Issued: 03/06/2018
• Est. Priority Date: 04/15/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Pollock, Nathan, Gust, Lauren, Batricevic, Uros
• Primary Examiner(s): Al Kawsar, Abdullah
• Assistant Examiner(s): Samwel, Daniel
• Application Number:
  US13/862,489
• Publication Number:
  US 20140310625A1
• Time in Patent Office: 1,786 Days
• Field of Search: 715700-866
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

In one embodiment, a graphical display device may use a set of one or more thresholds to remove a scaling motion from a panning input using multiple fingers. The graphical display device may receive a user input in a user movement interface having at least a first bio-point 210 and a second bio-point 210. The graphical display device may detect a panning motion from the user input. The graphical display device may filter out a scaling motion from the user input based on a scaling threshold. The graphical display device may present a pan of a graphical user interface to a user.

Claims

1. A machine-implemented method, comprising:

receiving a user input in a user movement interface having at least a first bio-point and a second bio-point;

detecting a panning motion indicating a linear motion of a visual frame from the user input, wherein a linear velocity indicates a linear speed of the linear motion;

detecting a changing distance between the first bio-point and the second bio-point representing a scaling motion indicating at least one of an expansion and a contraction of the visual frame, wherein a radial velocity indicates a radial speed of the scaling motion;

calculating a radial differential between a first value for the changing distance between the first bio-point and the second bio-point at a first time and a second value for the changing distance between the first bio-point and the second bio-point at a second time;

comparing the radial differential to a differential threshold;

determining a velocity ratio of the radial velocity to the linear velocity;

comparing the velocity ratio to a ratio threshold;

removing the scaling motion from the user input and presenting a pan of a graphical user interface to a user based on the panning motion and the removing of the scaling motion when either the radial differential is below the differential threshold or the velocity ratio is below the ratio threshold; and

presenting a pan and scale of the graphical user interface to the user when the radial differential is above the differential threshold and the velocity ratio is above the ratio threshold.

2. The method of claim 1, further comprising:

wherein receiving the user input includes receiving at least a third bio-point;

wherein detecting the changing distance further comprises determining an input shape based on at least the first bio-point, the second bio-point, and the third bio-point in the user input, the input shape having an input radius that represents the scaling motion such that the radial velocity indicates a speed of change of the input radius;

determining a center point of the input shape; and

calculating the linear velocity based on linear movement of the center point of the input shape.

3. The method of claim 1, further comprising:

determining an input shape based on at least the first bio-point and the second bio-point;

determining a center point of the input shape;

calculating the panning motion based on movement of the center point of the input shape.

4. The method of claim 1, further comprising:

calculating the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

comparing the radial differential to the differential threshold; and

wherein removing the scaling motion from the user input is further based on the radial differential being below the differential threshold.

5. The method of claim 1, further comprising:

calculating the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

comparing the radial differential to the differential threshold; and

wherein removing the scaling motion from the user input is further based on the radial differential being above the differential threshold.

6. The method of claim 3, further comprising:

calculating the radial velocity for the input shape.

7. The method of claim 6, further comprising:

calculating the velocity ratio based on a center point velocity and the radial velocity.

8. The method of claim 1, further comprising:

detecting a panning vector from the panning motion; and

railing the panning motion along the panning vector.

9. The method of claim 1, further comprising:

railing the panning motion along a panning vector.

10. The method of claim 1, further comprising:

determining, based on the comparing, that the velocity ratio is above the ratio threshold;

calculating the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

comparing the radial differential to the differential threshold; and

wherein removing the scaling motion from the user input is further based on the radial differential being below the differential threshold.

11. The method of claim 1, further comprising:

maintaining a subsequent scaling motion from the user input at least based on a subsequent velocity ratio being above the ratio threshold; and

removing a subsequent scaling motion from the user input at least based on the subsequent velocity ratio being below the ratio threshold.

12. A tangible machine-readable medium having a set of instructions detailing a method stored thereon that when executed by one or more processors cause the one or more processors to perform the method, the method comprising:

receiving a user input in a user movement interface having at least a first bio-point and a second bio-point;

calculating a panning motion indicating a linear motion of a visual frame from the user input based on a center point movement of an input shape from at least the first bio-point and the second bio-point, wherein a linear velocity indicates a linear speed of the linear motion;

detecting a changing distance between the first bio-point and the second bio-point representing a scaling motion indicating at least one of an expansion and a contraction of the visual frame, wherein a radial velocity indicates a radial speed of the scaling motion;

calculating a radial differential between a first value for the changing distance between the first bio-point and the second bio-point at a first time and a second value for the changing distance between the first bio-point and the second bio-point at a second time;

comparing the radial differential to a differential threshold;

determining a velocity ratio of the radial velocity to the linear velocity;

comparing the velocity ratio to a ratio threshold;

removing the scaling motion from the user input and presenting a pan of a graphical user interface to a user based on the panning motion and the removing of the scaling motion when either the radial differential is below the differential threshold or the velocity ratio is below the ratio threshold; and

presenting a pan and scale of the graphical user interface to the user when the radial differential is above the differential threshold and the velocity ratio is above the ratio threshold.

13. The tangible machine-readable medium of claim 12, wherein the method further comprises:

calculating the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

comparing the radial differential to the differential threshold; and

wherein removing the scaling motion from the user input is further based on the radial differential being below the differential threshold.

14. The tangible machine-readable medium of claim 13, wherein the method further comprises:

maintaining a differential history for optimizing the differential threshold.

15. The tangible machine-readable medium of claim 12, wherein the method further comprises:

maintaining a ratio history for optimizing the ratio threshold.

16. A graphical display device, comprising:

an input device configured to receive a user input having at least a first bio-point and a second bio-point;

a processor configured to

detect a panning motion indicating a linear motion of a visual frame from the user input,

determine an input shape based on the first bio-point and the second bio-point, determine a center point of the input shape,

detecting a changing distance between the first bio-point and the second bio-point representing a scaling motion indicating at least one of an expansion and a contraction of the visual frame, wherein a radial velocity indicates a radial speed of the scaling motion;

calculate a radial differential between a first value for the changing distance between the first bio-point and the second bio-point at a first time and a second value for the changing distance between the first bio-point and the second bio-point at a second time;

compare the radial differential to a differential threshold;

calculate a velocity ratio based on a center point velocity of the center point and the radial velocity of the input shape,

compare the velocity ratio with a ratio threshold, and

remove a scaling motion indicating at least one of an expansion and a contraction of the visual frame from the user input and presenting a pan of a graphical user interface to a user based on the panning motion and the removing of the scaling motion when either the radial differential is below the differential threshold or the velocity ratio is below the ratio threshold; and

a display configured to present a pan and scale of the graphical user interface to the user when the radial differential is above the differential threshold and the velocity ratio is above the ratio threshold.

17. The graphical display device of claim 16, wherein the input device is at least one of a touch screen, a track pad, and a gesture recognition interface.

18. The graphical display device of claim 16, wherein the processor is further configured to:

calculate the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

compare the radial differential to the differential threshold; and

remove the scaling motion from the user input further based on the radial differential being below the differential threshold.

19. The graphical display device of claim 16, wherein the processor is further configured to:

calculate the radial differential between the first value for the changing distance between the first bio-point and the second bio-point at the first time and the second value for the changing distance between the first bio-point and the second bio-point at the second time;

compare the radial differential to the differential threshold; and

remove the scaling motion from the user input further based on the radial differential being above the differential threshold.