THREE OR HIGHER DIMENSIONAL GRAPHICAL USER INTERFACE FOR TV MENU AND DOCUMENT NAVIGATION

• US 20110179376A1
• Filed: 01/21/2010
• Published: 07/21/2011
• Est. Priority Date: 01/21/2010
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Lee, Chuen-Chien, Berestov, Alexander
• Application Number:
  US12/691,609
• Publication Number:
  US 20110179376A1
• Time in Patent Office: Days
• US Class Current: 715/779
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A three or more dimensional (3⁺D) graphical user interface (GUI) uses detected three dimensional (3D) hand movements or other input devices to navigate a displayed two dimensional (2D), three dimensional, or 3⁺D representation of a corresponding menu, document, or data set. Specific hand motions may be used that correspond to navigational commands, including, but not limited to: up, down, left, right, select, exit, back, new search, start, close, and deselect. The GUI displays two initially perpendicular axes, with additional axes sufficiently off angle that their navigation is apparent, rather than hidden. The 3⁺D GUI may be used for navigating large complex data sets, such as search results, document library storage, or simpler data sets, such as TV menus, music selection, photographs, videos, etc.

Claims

1. A graphical user interface (GUI), comprising:

a display device;

means for displaying a three or higher dimensional (3⁺D) graphical user interface (GUI) on the display device; and

means for controlling the GUI.

2. The GUI of claim 1, wherein the means for controlling comprises:

movements of a hand.

3. The GUI of claim 2, wherein the movements of the hand comprise:

positional movements in three dimensions.

4. The GUI of claim 2, wherein the movements of the hand comprise:

a signed GUI command.

5. The GUI of claim 4, wherein the signed GUI command is selected from one of a group of commands consisting of:

go left, go right, go up, go down, select, exit, previous selection, escape, and go diagonally.

6. The GUI of claim 2, comprising:

a detector that detects movements of the hand.

7. The GUI of claim 3, wherein the movements in three dimensions comprises:

movements in a Cartesian space.

8. The GUI of claim 2, wherein the movements of the hand comprise:

movements selected from a group of movements consisting of;

pitch, roll, yaw, and combinations of the foregoing.

9. The GUI of claim 1, wherein the means for displaying the 3⁺D GUI comprises:

a substantially horizontal selection bar, comprising a selected horizontal element;

a substantially vertical selection bar that depends on the selected horizontal element, comprising a selected vertical element; and

a substantially angled selection bar that depends on both the selected horizontal element and the selected vertical element, comprising a selected angled element.

10. The GUI of claim 1, wherein the means for displaying the 3⁺D GUI comprises:

a first selection bar, comprising a selected first element;

a substantially orthogonal second selection bar that depends on the selected first element, comprising a selected second element; and

a substantially third selection bar (that is linearly dependent on the first selection bar and the second selection bar, but visually distinct from the first selection bar and the second selection bar) that depends on both the selected first element and the selected second element, comprising a selected third element.

11. The GUI of claim 10, comprising:

a fourth selection bar (substantially orthogonal to the third selection bar), comprising a selected fourth element;

wherein the selected fourth element depends on the selected first element, the selected second element, and the selected third element.

12. The GUI of claim 10, wherein orthogonality is taken in one or more of the following coordinate systems consisting of:

Cartesian, cylindrical, spherical, parabolic, parabolic cylindrical, paraboloidal, oblate spheroidal, prolate spheroidal, ellipsoidal, elliptical cylindrical, toroidal, bispherical, bipolar cylindrical, and conical.

13. The GUI of claim 10, wherein orthogonality is taken in a three dimensional (3D) space.

14. The GUI of claim 10, wherein orthogonality is taken in a four dimensional (4D) space.

15. A method of navigating a graphical user interface (GUI), comprising:

providing a display;

displaying on the display a substantially horizontal selection bar;

highlighting a currently selected horizontal element; and

optionally traversing the horizontal selection bar, wherein the currently selected horizontal element is changed.

16. The method of navigating GUI, of claim 15, comprising:

displaying on the display a substantially vertical selection bar that depends on the currently selected horizontal element; and

optionally traversing the vertical selection bar, wherein a currently selected vertical element is changed.

17. The method of navigating GUI, of claim 16 comprising:

displaying a first substantially diagonal selection bar that depends on the currently selected vertical element; and

optionally traversing the diagonal selection bar, wherein a currently selected first diagonal element is changed.

18. The method of navigating GUI, of claim 17 comprising:

displaying on the display a second substantially diagonal selection bar that depends on the currently selected first diagonal element; and

optionally traversing the second substantially diagonal selection bar, wherein a currently selected second diagonal element is changed.

19. A computer readable medium capable of storing the steps of claim 15.

20. A computer capable of executing the steps of claim 15.

21. A graphical user interface (GUI) apparatus that displays representations of three or more dimensions, comprising:

(a) a display device, comprising;

a first selection bar, comprising a selected first element;

a substantially orthogonal second selection bar that depends on the selected first element, comprising an optionally selected second element; and

a substantially third selection bar (that is linearly dependent upon the first selection bar and the second selection bar, but visually distinct from the first selection bar or the second selection bar) that depends on both the selected first element and the selected second element, comprising an optionally selected third element; and

(b) a detector that detects movements of a hand as GUI commands;

(c) wherein the GUI commands

control navigation of the first selection bar, the second selection bar, and the third selection bar, and

select the selected first element, the optionally selected second element, and the optionally selected third element.

22. The GUI apparatus of claim 21, wherein the movements of the hand comprise positional movements in three dimensions.

23. The GUI apparatus of claim 21, wherein the GUI commands are selected from one of a group of commands consisting of:

go left, go right, go up, go down, select, exit, previous selection, escape, and go diagonally.

24. The GUI apparatus of claim 21, wherein the movements of the hand in three dimensions comprises movements in a Cartesian space.

25. The GUI apparatus of claim 21, wherein the movements of the hand comprise movements selected from a group of movements consisting of:

pitch, roll, yaw, and combinations of the foregoing.

26. The GUI apparatus of claim 21, comprising:

a fourth selection bar (visually independent from the third selection bar, as well as the first and second selection bars), comprising an optionally selected fourth element;

wherein the selected fourth element depends on the selected first element, the optionally selected second element, and the optionally selected third element;

wherein the GUI commands further

control navigation of the fourth selection bar, and

select the optionally selected fourth element.

27. A graphical user interface (GUI), comprising:

a display device;

means for displaying a three or higher dimensional (3⁺D) graphical user interface (GUI) on the display device; and

a remote controller, whereby the GUI is controlled.

28. The GUI of claim 27, wherein the remote controller comprises one or more diagonal buttons, whereby a third or higher dimensional selection bar is navigated in the 3⁺D GUI.

29. The GUI of claim 28, wherein the remote controller may issue one or more commands selected from one of a group of commands consisting of:

go left, go right, go up, go down, select, exit, previous selection, escape, and go diagonally.

30. The GUI of claim 27, wherein the remote controller comprises:

one or more sensors that detects positional movements in three dimensions.

31. The GUI of claim 30, wherein the remote controller comprises one or more sensors that detects movements selected from a group of movements consisting of:

pitch, roll, yaw, and combinations of the foregoing.

32. The GUI of claim 27, wherein the display device is selected from a group of display devices consisting of:

a TV, a flat screen monitor, a three dimensional TV, a holographic 3D TV, an anaglyphic 3D TV (viewed with passive red-cyan glasses), a polarization 3D TV (viewed with passive polarized glasses), an alternate-frame sequencing 3D TV (viewed with active shutter glasses/headgear), and an autostereoscopic 3D TV (viewed without glasses or headgear).