Edge-based hooking gestures for invoking user interfaces

• US 9,760,242 B2
• Filed: 09/10/2015
• Issued: 09/12/2017
• Est. Priority Date: 01/06/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Nan, Jennifer, Satterfield, Jesse Clay, Robinson, Zach, Jarrett, Robert, Miner, Patrice L.
• Primary Examiner(s): Shiberou, Mahelet
• Application Number:
  US14/850,347
• Publication Number:
  US 20150378554A1
• Time in Patent Office: 733 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

Presented herein are techniques for invoking user interfaces in graphical computing environments involving “hooking” gestures applicable to an edge of a display. These gestures involve positioning a pointer near an edge of the display depicting the environment, and then moving the cursor to a second location that is distanced from but near the first location (e.g., moving the pointer into a corner of the display, and then toward the center of the display, or to a midpoint of an adjacent edge of the display), resulting in the presentation of the user interface under the pointer at the second location. Variations include presenting a preview of the user interface (e.g., a subset of a user interface menu) at the second location while the pointer is in the first location, and refraining from presenting the user interface upon failing to complete the gesture or receiving extraneous input before completing the gesture.

Claims

1. A method of assisting a user in launching an application within a graphical user environment of a device having a processor, a display, and a pointing device associated with a pointer, the method comprising:

executing, on the processor, instructions that cause the device to;

responsive to detecting a positioning of the pointer at a first location within a first threshold distance of an edge of the display, wherein the edge is not visually associated with a user interface element, and absent a detection of a pointer click event during the positioning at the first location, enter a user interface suggestion mode by presenting, at a second location within a second threshold distance of the edge of the display, an application menu comprising a visual indicator of an application; and

responsive to detecting, while in the user interface suggestion mode, a movement of the pointer into the application menu and toward the second location and absent a detection of a pointer click event, invoke the application that is associated with the visual indicator.

2. The method of claim 1, wherein:

the first location comprising a location within a threshold distance a corner of the display adjoining two selected edges of the display; and

the second location comprising a midpoint of a selected edge.

3. The method of claim 1, wherein:

executing the instructions further causes the device to position a non-visible detection region at the first location; and

detecting the positioning further comprises;

detecting a movement of the pointer into the non-visible detection region.

4. The method of claim 1, wherein executing the instructions further causes the device to, responsive to entering the user interface suggestion mode and prior to detecting the movement of the pointer into the application menu, present a preview of the application menu at the second location.

5. The method of claim 4, wherein:

the application menu further comprises a user interface region extending to the edge of the display; and

the preview further comprises a portion of the user interface region and not extending to the edge of the display.

6. The method of claim 4, wherein executing the instructions further causes the device to present the preview responsive to detecting a hovering, for a hover duration, of the pointer at the first location.

7. The method of claim 1, wherein executing the instructions further causes the device to, responsive to failing to detect the movement of the pointer into the application menu within a gesture completion duration from entering the user interface suggestion mode, cancel the user interface suggestion mode.

8. The method of claim 1, wherein executing the instructions further causes the device to, responsive to detecting input other than the movement of the pointer into the application menu during the user interface suggestion mode, cancel the user interface suggestion mode.

9. The method of claim 1, wherein:

the computing environment presents a visual control presented within the first threshold distance of the edge and that is not associated with the edge of the display; and

executing the instructions further causes the device to, responsive to canceling the user interface suggestion mode, send the input to the visual control.

10. The method of claim 1, wherein the computing environment presents a logical display comprising at least two logical display spaces presented by a display of the device.

11. The method of claim 10, wherein detecting the positioning of the pointer at the first location further comprising:

detecting a movement of the pointer from within the logical display space of a display to the first location within the first threshold distance of an edge of the logical display space of the display.

12. The method of claim 10, wherein:

a first edge of a first logical display space presented by a first display positioned, within the logical display, adjacent to a second edge of a second logical display space presented by a second display; and

detecting the positioning of the pointer at the first location further comprises;

detecting the positioning of the pointer within an edge region comprising;

a first region portion near the first edge of the first logical display space; and

a second region portion near the second edge of the second logical display space having a second region portion edge that is adjacent to a first region portion edge of the first region portion.

13. The method of claim 12, wherein executing the instructions further causes the device to:

responsive to detecting a first hovering, for a first hover duration, of the pointer in the first region portion, present the application menu at the second location; and

responsive to detecting a second hovering, for a second hover duration that is different from the first hover duration, of the pointer in the second region portion, remove the application menu from the second location.

14. The method of claim 12, wherein executing the instructions further causes the device to, responsive to detecting the positioning of the pointer within the edge region:

present a first visual indicator of a first application at the second location within the first logical display space; and

present a second visual indicator of a second application at a third location that is within the second logical display space.

15. The method of claim 1, wherein:

the pointer is associated with a pointing input mode selected from a pointing input mode set comprising;

an absolute pointing input mode, and

a relative pointing input mode; and

entering the user interface suggestion mode further comprises;

responsive to detecting a positioning of the pointer at a first location within the first threshold distance of the edge of the display while the pointer is associated with a relative pointing input mode, enter the user interface suggestion mode.

16. The method of claim 15, wherein executing the instructions further causes the device to, responsive to detecting, while the pointer is associated with an absolute pointing input mode, input at a position of the pointing device corresponding to the first location, present the visual indicator of the application on the display.

17. A device that presents a graphical user environment and assists a user in launching an application within the graphical user environment, the device comprising:

a processor;

a pointing device that receives pointer input from the user;

a display that presents a pointer within the graphical user environment, wherein the pointer is responsive to the pointer input received from the user; and

a memory storing instructions that, when executed by the processor, cause the device to;

responsive to detecting a positioning of the pointer at a first location within a first threshold distance of an edge of the display, wherein the edge is not visually associated with a user interface element, and absent a detection of a pointer click event during the positioning at the first location, enter a user interface suggestion mode by presenting, at a second location within a second threshold distance of the edge of the display, an application menu comprising a visual indicator of an application; and

responsive to detecting, while in the user interface suggestion mode, a movement of the pointer into the application menu and toward the second location and absent a detection of a pointer click event, invoke the application that is associated with the visual indicator.

18. A device that presents a graphical user environment and assists a user in launching an application within the graphical user environment, the device comprising:

a processor;

a pointing device that receives pointer input from the user;

a display that presents a pointer within the graphical user environment, wherein the pointer is responsive to the pointer input received from the user; and

a memory storing instructions that, when executed by the processor, cause the device to;

detect a hook gesture of the pointer, wherein the hook gesture comprises;

a first positioning of the pointer at a first location within a first threshold distance of an edge of the display that is not visually associated with a user interface element, and

following the first positioning of the pointer, a movement of the pointer toward a second location that is within a second threshold distance of the edge of the display;

during the first positioning and absent a detection of a pointer click during the first positioning;

enter a user interface suggestion mode, and

present, at the second location, an application menu comprising a visual indicator of an application; and

responsive to the movement of the pointer toward the second location during the user interface suggestion mode, invoke the application that is associated with the visual indicator of the application.

19. The device of claim 18, wherein detecting the first positioning of the pointer comprising the hook gesture further comprises:

detecting a hovering of the pointer at the first location for at least a hover duration.

20. The device of claim 18, wherein presenting the visual indicator of the application at the first location further comprises:

presenting, at the first location, a preview of a user interface of the application.