Dynamically populating a display and entering a selection interaction mode based on movement of a pointer along a navigation path

• US 10,691,324 B2
• Filed: 06/03/2015
• Issued: 06/23/2020
• Est. Priority Date: 06/03/2014
• Status: Active Grant

• Current Assignee: Flow Laboratories
• Original Assignee: Flow Laboratories
• Inventors: Van Der Westhuizen, Willem Morkel, Du Plessis, Filippus Lourens Andries
• Primary Examiner(s): Blaufeld, Justin R.
• Application Number:
  US15/313,098
• Publication Number:
  US 20170108998A1
• Time in Patent Office: 1,847 Days
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An electronic device and a method of display and interaction in a user interface is provided. The method includes: providing a display region and control region of a user interface; initiating the display of a number of interactive items in the display region; upon receiving a predefined interaction from a pointer, tracking the position or movement of the pointer and dynamically populating the display region with a subset of interactive items based on the position or movement of the pointer. In response to detecting a substantial change of direction of the pointer or in response to the pointer crossing a selection threshold, a selection interaction mode is entered in which a user can individually interact with the interactive items populating the display region.

Claims

1. A method of display and interaction in a user interface of an electronic device, comprising the steps of:

providing a display region of the user interface on a display of the electronic device, the display region comprising a two-dimensional region located in an x-y plane of the display of the electronic device;

providing a control region of the user interface, wherein the control region includes a navigation region within the control region, the control region comprising a three-dimensional region above the display region that extends perpendicularly from the x-y plane of the display of the electronic device along a z-axis measuring three or more points of distance above the x-y plane of the electronic device, where a second point is further from the x-y plane than a third point, but closer to the x-y plane than a first point;

receiving a predefined interaction from a pointer of a user;

in response to receiving the predefined interaction from a pointer of a user, initiating display of a number of interactive items in the display region;

tracking one or both of position and movement of the pointer within the control region above the display region on the display of the electronic device;

in response to the pointer moving in a first direction along a navigation path along the z-axis of the control region in the navigation region within the control region above the display region on the display of the electronic device without the pointer contacting the display of the electronic device, dynamically populating the display region by progressively adding interactive items or progressively removing interactive items from the number of interactive items displayed in the display region as the pointer moves in the first direction along the navigation path, wherein the number of interactive items populating the display region at a given time is based on the movement of the pointer in the first direction along the navigation path;

checking, at each point along the z-axis passed by the navigation path, whether the pointer'"'"'s movement is a substantial reversal of direction of the pointer'"'"'s movement or position by the pointer moving in a second direction along the z-axis of the control region that is opposite to the first direction;

detecting a substantial reversal of direction in the pointer'"'"'s movement at the first point of the z-axis or at the third point of the z-axis; and

in response to detecting a substantial reversal of direction of the pointer'"'"'s movement, entering a selection interaction mode in which no further interactive items are added to or removed from the display region, where interactive items in the selection interaction mode each have a priority dynamically determined from their respective distances from the pointer and interactive items populating the display region are dynamically resized and repositioned relative to each other based on their priorities.

2. The method as claimed in claim 1, wherein the navigation path is a predefined axis in the control region, and wherein movement of the pointer in the first direction along the predefined axis causes the display region to be dynamically populated by progressively adding interactive items or progressively removing interactive items from the number of interactive items displayed in the display region, and wherein the substantial reversal of direction of the pointer'"'"'s movement along the predefined axis is movement of the pointer in the second direction along the predefined axis that is opposite to the first direction.

3. The method as claimed in claim 2, wherein the predefined axis is the z-axis.

4. The method as claimed in claim 1, wherein the predefined interaction is the pointer entering the navigation region.

5. The method as claimed in claim 1, wherein the predefined interaction is selection of a physical or virtual button of the user interface.

6. The method as claimed in claim 5, wherein the button is a home button of the user interface.

7. The method as claimed in claim 1, including the step of:

in response to determining that the pointer has reached a terminal threshold of the navigation region, removing all interactive items from the display region, overriding the selection interaction mode, and causing a home screen to be displayed.

8. The method as claimed in claim 7, wherein the terminal threshold is reached when the pointer is moved beyond an end point of the navigation region.

9. The method as claimed in claim 1, wherein the navigation region includes a plurality of category thresholds each being associated with a category that includes a subset of interactive items, and wherein dynamically populating the display region includes determining that the pointer has reached a particular category threshold, designating the category threshold as an active threshold, and populating the display region with interactive items associated with the category corresponding to the active threshold.

10. The method as claimed in claim 9, wherein movement or change in position of the pointer in the navigation region causes the display region to cycle through the subsets of interactive items, and entering the selection interaction mode includes allowing the user to individually interact with the subset of interactive items corresponding to the active threshold.

11. The method as claimed in claim 1, wherein the interactive items include one or more of:

information elements, objects, actions, applications and events.

12. The method as claimed in claim 1, wherein the pointer of a user is selected from:

a cursor provided by the user interface, a pointing tool of the user, or a finger of the user.

13. The method as claimed in claim 1, wherein the electronic device is one of:

a mobile phone, a handheld computer, a personal computer, a television and a gaming controller.

14. A method as claimed in claim 1, wherein the navigation path is a predefined path in the navigation region.

15. A method as claimed in claim 1, wherein the navigation path is defined by the movement of the pointer in the navigation region.

16. The method as claimed in claim 1, wherein the pointer of the user is a single pointer.

17. An electronic device comprising:

a processor;

a non-transitory computer-readable medium having instructions encoded thereon that, when executed by the processor, cause the processor to;

provide a control region of a user interface, wherein the control region includes a navigation region within the control region, the control region and the control region comprising a three-dimensional region above a display region that extends perpendicularly from an x-y plane of a display of the electronic device along a z-axis determining a distance along the x-y plane of the display of the electronic device;

receive a predefined interaction from a pointer of a user;

display of a number of interactive items in the display region of the user interface on the display of the electronic device in response to receiving the predefined interaction, the display region comprising a two-dimensional region located in the x-y plane of the display of the electronic device;

track one or both of position and movement of the pointer within the control region above the display region on the display of the electronic device;

in response to the pointer moving in a first direction along a navigation path along the z-axis of the control region in the navigation region within the control region above the display region on the display of the electronic device without the pointer contacting the display of the electronic device, dynamically populate the display region by progressively adding interactive items or progressively removing interactive items from the number of interactive items displayed in the display region as the pointer moves in the first direction along the navigation path, wherein the number of interactive items populating the display region at a given time is based on the movement of the pointer in the first direction along the navigation path in the navigation region;

detect a substantial reversal of direction of the pointer'"'"'s movement along the navigation path by the pointer moving in a second direction along the z-axis of the control region that is opposite to the first direction along each point in the navigation path within the control region independent of distance of the pointer from the display region; and

enter a selection interaction mode in which no further interactive items are added to or removed from the display region, where interactive items in the selection interaction mode each have a priority dynamically determined from their respective distances from the pointer and interactive items populating the display region are dynamically resized and repositioned relative to each other based on their priorities, in response to detecting the substantial reversal of the direction of the pointer'"'"'s movement along the navigation path.

18. A computer program product for display and interaction in a user interface comprising a non-transitory computer-readable medium having stored computer-readable program code for performing the steps of:

providing a display region of the user interface on a display of an electronic device, the display region comprising a two-dimensional region located in an x-y plane of the display of the electronic device;

providing a control region of the user interface, wherein the control region includes a navigation region within the control region, the control region comprising a three-dimensional region above the display region that extends perpendicularly from the x-y plane of the display of the electronic device along a z-axis determining a distance above the x-y plane of the display of the electronic device;

in response to receiving a predefined interaction from a pointer of a user, initiating display of a number of interactive items in the display region;

tracking one or both of position and movement of the pointer within the control region above the display region on the display of the electronic device;

in response to the pointer moving in a first direction along a navigation path along the z-axis of the control region in the navigation region within the control region above the display region on the display of the electronic device without the pointer contacting the display of the electronic device, dynamically populating the display region by progressively adding interactive items or progressively removing interactive items from the number of interactive items displayed in the display region as the pointer moves in the first direction along the navigation path, wherein the number of interactive items populating the display region at a given time is based the movement of the pointer in the first direction along the navigation path; and

in response to detecting a substantial reversal of direction of the pointer'"'"'s movement along the navigation path by the pointer moving in a second direction along the z-axis of the control region that is opposite to the first direction along each point in the navigation path within the control region independent of distance of the pointer from the display region, entering a selection interaction mode in which no further interactive items are added to or removed from the display region, where interactive items in the selection interaction mode each have a priority dynamically determined from their respective distances from the pointer and interactive items populating the display region are dynamically resized and repositioned relative to each other based on their priorities.