User interface with z-axis interaction

• US 8,860,672 B2
• Filed: 05/26/2010
• Issued: 10/14/2014
• Est. Priority Date: 05/26/2010
• Status: Active Grant

• Current Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Original Assignee: T-Mobile USA, Inc. (Deutsche Telekom AG)
• Inventors: Ewing, Richard Alan Jr., Mann, Jonathan L., Panchal, Prarthana H., Kuncl, Parker Ralph, Hinds, Joshua J., Biller, Gabriel Alexander
• Primary Examiner(s): HARRIS, DOROTHY H
• Application Number:
  US12/788,145
• Publication Number:
  US 20110291945A1
• Time in Patent Office: 1,602 Days
• Field of Search: 345/173, 345/175
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user interface presents a plurality of items configured as a stack in a display of a device. The stack is scrollable in a direction oblique to a plane of the display for successively viewing the items in the stack. Some implementations provide for control of the user interface based on input from a finger position sensor or a slider.

Claims

1. A method comprising:

presenting a plurality of first items in a user interface on a display of a device, the first items being presented as a first stack;

scrolling the first items of the first stack in a direction oblique to a plane of the display for successively displaying the items, wherein;

the first stack appears to flow outward with respect to the plane of the display in response to scrolling in a first direction;

the first stack appears to flow inward with respect to the plane of the display in response to scrolling in a second direction; and

determining a position of a finger spatially separated from the device, the position of the finger being used in conjunction with activation of an input mechanism for interacting with the user interface in three dimensions, wherein

movement of the finger is determined based on an initial position of the finger that is established in response to actuation of at least one touch or pressure sensor on an exterior of the device;

the initial position of the finger includes at least an initial spatial separation of the finger from the device along a z-axis defined with respect to a plane of the display

a speed of scrolling is controlled by a distance that a finger is moved toward or away from the plane of the display, wherein the distance is determined with respect to the initial spatial separation of the finger from the device;

receiving a selection of one of the first items of the first stack; and

in response to the selection of one of the first items of the first stack, presenting a plurality of second items in the user interface, the second items being hierarchically related to the first item and being presented in a second stack scrollable in the direction oblique to the plane of the display, wherein;

the second stack appears to flow outward with respect to the plane of the display in response to scrolling in the first direction; and

the second stack appears to flow inward with respect to the plane of the display in response to scrolling in the second direction.

2. The method according to claim 1, further comprising:

sensing a position of the device;

detecting tilting of the device relative to the position; and

performing the scrolling in response to the tilting.

3. The method according to claim 1, further comprising:

sensing movement of a finger of a user sliding along a surface of the device; and

performing the scrolling in response to movement of the finger.

4. The method according to claim 1, wherein

the first items are representations of applications present on the device;

and

the second items are representations of a data type of an application that corresponds to the selected one of the first items.

5. The method according to claim 1, further comprising:

presenting a plurality of stacks of items including the first stack of the first items and a third stack of third items; and

moving a focus of the user interface in a direction corresponding to the plane of the display between a presentation of the first stack and a presentation of the third stack.

6. The method according to claim 5, wherein the user interface is configured to continually successively display each of the plurality of stacks in a loop by scrolling a focus of the user interface from the first stack to a stack immediately adjacent to the first stack, pause for a predetermined period of time at each stack, and move the focus to a next adjacent stack.

7. A device comprising:

a display;

a processor in communication with computer-readable storage media;

a user interface component, maintained in the computer-readable storage media and executed on the processor, to present a user interface on the display, the user interface being interactive in three dimensions;

an input mechanism for providing a user-activated input signal to the processor;

at least one touch or pressure sensor on an exterior of the device;

a finger position component executed on the processor for determining a position of a finger spatially separated from the device, the position of the finger being used in conjunction with activation of the input mechanism for interacting with the user interface in the three dimensions, wherein;

movement of the finger is determined based on an initial position of the finger that is established in response to actuation of the at least one touch or pressure sensor,

the initial position of the finger includes at least an initial spatial separation of the finger from the device along a direction of a z-axis defined with respect to a plane of the display,

the interface displays a plurality of items in a stack, the stack comprising a displayed item and a plurality of items behind the displayed item,

movement of the finger toward or away from the device causes the user interface to scroll through one or more of the items in the stack along the direction of the z-axis,

a speed of the scrolling is controlled by a distance that the finger is moved toward or away from the plane of the display along the direction of the z-axis, and

the distance is determined with respect to the initial spatial separation of the finger from the device.

8. The device according to claim 7, wherein the speed of the scrolling in a first direction along the z-axis is reduced in response to detecting a change in spatial separation of the finger from the device associated with movement of the finger in a second direction along the z-axis, wherein the change in spatial separation is determined with respect to the initial spatial separation of the finger from the device.

9. The device according to claim 7, wherein a scrolling direction is reversed from a first direction along the z-axis to a second direction along the z-axis in response to detecting a change in spatial separation of the finger from the device associated with movement of the finger in the second direction along the z-axis, wherein the change in spatial separation is determined with respect to the initial spatial separation of the finger from the device.

10. The device according to claim 7, further comprising a planar display, wherein determining lateral movement of the finger relative to a plane of the display causes the user interface to pan a focus of the user interface in a direction relative to the lateral movement.

11. The device according to claim 7, further comprising at least one sensor for sensing the movement of the finger relative to the device, the at least one sensor comprising at least one of:

a front facing camera;

an image capture sensor in conjunction with an infrared light source;

or

a non-touch capacitive sensor.

12. One or more tangible computer readable storage media devices containing instructions to be executed by a processor for implementing a user interface, the user interface comprising:

a plurality of stacks, each stack comprising a plurality of items in the stack, each stack comprising a first item and a plurality of items behind the first item; and

a control component for enabling displaying movement of the stacks in a z-axis direction defined with respect to a plane of a display, the control component to perform at least one of;

in response to navigation in a first direction with respect to the plane of the display, moving the stack outward with respect to the plane of the display along the z-axis direction;

or

in response to navigation in a second direction with respect to the plane of the display, moving the stack inward with respect to the plane of the display;

wherein navigation in the first direction and the second direction comprises;

determining a position of a finger spatially separated from the device, the position of the finger being used in conjunction with activation of an input mechanism for interacting with the user interface in three dimensions, wherein;

movement of the finger is determined based on an initial position of the finger that is established in response to actuation of at least one touch or pressure sensor on an exterior of the device;

the initial position of the finger includes at least an initial spatial separation of the finger from the device along a z-axis defined with respect to a plane of the display;

wherein a speed of movement of the stacks is controlled by a distance that the finger is moved toward or away from the plane of the display along the z-axis direction and the distance is determined with respect to the initial spatial separation of the finger from the device.

13. The one or more tangible computer readable storage media devices according to claim 12, wherein

a focus of the user interface includes display of at least one of the stacks;

and

a stack is movable in a direction in the plane of the display to view an adjacent stack.

14. The one or more tangible computer readable storage media devices according to claim 13, wherein each stack in the plurality of stacks is successively looped through and displayed for a predetermined amount of time in the focus of the user interface.

15. The one or more tangible computer readable storage media devices according to claim 12, wherein following movement along the z-axis within a stack, the user interface is configured to enable lateral movement to an item of an adjacent stack.

16. The one or more tangible computer readable storage media devices according to claim 15, wherein the item of the adjacent stack is at an equivalent hierarchical level.

17. The one or more tangible computer readable storage media devices according to claim 15, wherein the item of the adjacent stack is a first item of the adjacent stack.