Distance-time based hit-testing for displayed target graphical elements

• US 9,639,265 B2
• Filed: 09/03/2010
• Issued: 05/02/2017
• Est. Priority Date: 09/03/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Peterson, Andrew Douglas, Stall, Jeffrey, Badger, Eric Norman
• Primary Examiner(s): SUN, LI P
• Application Number:
  US12/876,036
• Publication Number:
  US 20120056819A1
• Time in Patent Office: 2,433 Days
• Field of Search: 715800, 715863, 715865
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

The described embodiments allow for the association of an interaction with a target in a display. One embodiment includes detecting an interaction with an area associated with a graphical element in a display, detecting a later interaction displaced from the area, and associating the later interaction with a target in the display based at least on the time between the interaction with the area and the later interaction. User interactions with one or more displayed hit targets are based on corresponding time-varying hit zones. In response to unlimited user interaction with a hit target, subsequent user selections are validated based on a time-varying hit zone that is typically extended with respect to the previously selected hit target. The extended selection zone can overlap one or more other hit targets to favor re-selection of the individually selected hit target. The extended selection zone generally decreases as a function of time from prior selections of a hit zone.

Claims

1. A computer-implemented method, comprising:

detecting an initial interaction within an initial static area associated with a first displayed target graphical element on a screen;

detecting a subsequent interaction at a location displaced from the initial static area associated with the first displayed target graphical element;

calculating a hit distance between the initial static area and the subsequent interaction;

associating the subsequent interaction with a second displayed target based on an elapsed time between the initial interaction and the subsequent interaction, the associating comprising;

determining whether the hit distance between the initial static area and the subsequent interaction is less than or equal to a predefined distance;

if the hit distance between the initial static area and the subsequent interaction is less than or equal to a predefined distance, evaluating whether the subsequent interaction is located within a first dynamic selection zone associated with the first displayed target, wherein the first dynamic selection zone comprises a dynamic time based boundary that is activated upon the initial interaction and gradually changes size according to an equation, and wherein the equation is based on the elapsed time and on one or more of the following variables;

a device type, size of the screen, a display context, size of the static area, and motion of the screen;

if the hit distance between the initial static area and the subsequent interaction is not less than or equal to the predefined distance, performing a standard search to evaluate whether the subsequent interaction is located within a static selection zone associated with the second displayed target.

2. The computer-implemented method of claim 1, wherein the standard search comprises a tree search.

3. The computer-implemented method of claim 1, wherein the size of the first dynamic selection zone decreases based on the equation.

4. The computer-implemented method of claim 1, further comprising:

prior to determining whether the hit distance between the initial static area and the subsequent interaction is less than or equal to a predefined distance, determining if a flag is set indicating that one or more dynamic selections zones are activated.

5. The computer-implemented method of claim 1, wherein the first displayed target graphical element comprises an on screen keyboard.

6. The computer-implemented method of claim 1, wherein the first displayed target graphical element is associated with a messaging send button and the second displayed target is associated with a screen keyboard.

7. The computer-implemented method of claim 1, wherein the visual appearance of the second displayed target remains unchanged in size.

8. The computer-implemented method of claim 1, wherein the equation is based on an adjustable scaled slope modifier (“

m”

), a time duration between interaction events (“

t”

), and a starting point (“

b”

).

9. The computer-implemented method of claim 8, wherein the equation is d=mt+b.

10. A method, comprising:

detecting a user selection of a first displayed target;

defining at least one time-varying inflated selection zone that is associated with the first displayed target and not visible to the user, in response to detection of the selection of the first displayed target;

reducing inadvertent transmission of email or other messages by defining at least one time-varying deflated selection zone not visible to the user and associated with a second displayed target associated with a send or transmit action, in response to detection of the selection of the first displayed target, wherein the at least one time-varying deflated selection zone comprises a first dynamic time based boundary that gradually changes size according to a first equation; and

detecting a subsequent user selection of the first displayed target based on the at least one time-varying inflated selection zone, the detecting the subsequent user selection comprising;

validating that an interaction at a location displaced from the first displayed target is within the time-varying inflated selection zone, wherein the time-varying inflated selection zone comprises a second dynamic time based boundary that gradually changes size according to a second equation, and wherein both the first and second equations are based on an elapsed time between the user selection of the first displayed target and the interaction at the location displaced from the first displayed target, and one or more of the following variables;

a device type, size of the screen, a display context, size of the displayed target, and motion of the screen.

11. The method of claim 10, wherein the at least one time-varying inflated selection zone is larger than an initial selection zone associated with the first displayed target.

12. The method of claim 11, wherein the initial selection zone corresponds to a static boundary of the first displayed target.

13. The method of claim 10, wherein the time-varying inflated selection zone gradually decreases based on the function of time between the user selection of the first displayed target and the interaction at the location displaced from the first displayed target.

14. The method of claim 10, wherein the time varying inflated selection zone is defined based on at least one of a display screen size, a user interaction location, and an interaction mass.

15. The method of claim 10, wherein the visual appearance of the second displayed target remains unchanged in size.

16. The computer-implemented method of claim 10, wherein the equation is based on an adjustable scaled slope modifier (“

m”

) and a time duration between interaction events (“

t”

).

17. A computing device comprising:

a touch screen;

a processor; and

a memory storing code that when executed causes the processor to;

recognize a first contact with a primary graphical image displayed on the touch screen, wherein the primary graphical image relates to a character or item in a game;

recognize a second contact with the touch screen displaced from the primary graphical image;

determine whether one or more dynamic selection zones are active; and

if the one or more dynamic selection zones are active, evaluate the location of the second contact with respect to a dynamic time-varying boundary activated upon the first contact and related to the primary graphical image to determine if the location of the second contact is within the dynamic time-varying boundary;

if the one or more dynamic selection zones are not active, evaluate the location of the second contact with respect to one or more static boundaries, each related to a secondary graphical image;

wherein the size of the primary graphical image is independent from the time-varying boundary related to the primary graphical image;

wherein the time-varying boundary is not visible;

wherein the time-varying boundary gradually changes size according to an equation, and wherein the equation is based on an elapsed time between the first and the second contact and one or more of the following variables;

a type of the computing device, size of the touch screen, a display context, and motion of the touch screen; and

wherein, based on the checking, if the location of the second contact is within the time-varying boundary, then the target is the primary graphical image.