Multi-dimensional data visualization, navigation, and menu systems

• US 9,426,193 B2
• Filed: 06/05/2015
• Issued: 08/23/2016
• Est. Priority Date: 10/14/2014
• Status: Active Grant

• Current Assignee: GravityNav, Inc.
• Original Assignee: GravityNav, Inc.
• Inventors: Goodman, Jay
• Primary Examiner(s): To, Jennifer
• Assistant Examiner(s): Fortino, Ashley
• Application Number:
  US14/732,591
• Publication Number:
  US 20160105475A1
• Time in Patent Office: 445 Days
• Field of Search: 715/753
• US Class Current: 1/1
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

Described herein are systems, media, and methods for providing an application that receives information for a plurality of items and utilizes the information to generate a navigable multi-dimensional list of items, wherein the list of items is navigable by at least three navigation modes comprising touch scroll and rotation, joystick scroll and rotation, gyroscopic scroll and rotation. As such, the application allows a user to efficiently and effectively visualize, navigate, create, and share large amounts of data.

Claims

1. A computer-implemented system comprising:

a. a processing device comprising a gyroscope, an operating system configured to perform executable instructions, and a memory;

b. a computer program including instructions executable by the processing device to create an application comprising;

i. a software module configured to receive information for a plurality of items;

ii. a software module configured to utilize the information to generate a navigable multi-dimensional list of items;

the items in the list of items arranged in the X-axis, Y-axis, and Z-axis based on one or more sorting factors;

wherein at least one sorting factor is selected from;

a characteristic of the items, metadata associated with the items, a preference of a user, a behavior of the user, or a combination thereof;

provided that the list of items is navigable by at least three navigation modes comprising touch scroll and rotation, joystick scroll and rotation, gyroscopic scroll and rotation;

wherein, in response to a first user interaction, the Z-axis position of a selected item is arranged to the front and the list of items presents an isolated enlarged version of the selected item;

wherein, in response to a second user interaction, the list of items presents item details and item options for the selected item; and

iii. a software module configured to present a joystick graphical user interface element, the joystick graphical user interface element being modal with a first mode wherein the joystick allows the user to display an administrative menu and a second mode wherein the joystick allows the user to navigate the list of items with yaw, pitch, and roll controls.

2. The system of claim 1, wherein the items comprise document files, media files, applications, icons, links, bookmarks, communications, contacts or folders, archives, or compilations of the same.

3. The system of claim 2, wherein the media files comprise photos, videos, sound files, music files, or e-books.

4. The system of claim 1, wherein the sorting factor is alphabet, chronology, location, people, file type, color, or metadata.

5. The system of claim 1, wherein the items in the list of items are randomly arranged in the Z-axis.

6. The system of claim 1, wherein the items in the list of items are hierarchically arranged in the Z-axis.

7. The system of claim 1, wherein the software module configured to receive information for a plurality of items presents an interface allowing the user to select one or more sources for the items or a list of items.

8. The system of claim 7, wherein the source is the local storage of the processing device.

9. The system of claim 7, wherein the source is a remote service.

10. The system of claim 9, wherein the remote service is a cloud computing-based service.

11. The system of claim 9, wherein the remote service is Facebook, Instagram, Twitter, Vine, Pinterest, Tumblr, LinkedIn, Dropbox, Box, Flickr, Google Drive, iCloud, Youtube, Vimeo, SkyDrive, Mega, Hightail, Imgur, Photobucket, Picasa, Reddit, 4Chan, GitHub, WhatsApp, Viber, Line, WeChat, Paper, FlipBoard, Gmail, Yahoo Mail, iCloud Mail, Facebook Messenger, Outlook, Aol Mail, Mail.com, Uber, Lyft, or Ello.

12. The system of claim 1, wherein the touch scroll and rotation comprises the user interacting with a touchscreen of processing device through drag and flick gestures applied to the list of items to vertically scroll the list and horizontally rotate the list.

13. The system of claim 1, wherein the joystick scroll and rotation comprises the user interacting with a touchscreen of processing device to manipulate a graphical joystick element to vertically scroll the list and horizontally rotate the list.

14. The system of claim 1, wherein the gyroscopic scroll and rotation comprises the user manually rotating the processing device to vertically scroll the list and manipulate the list in yaw, pitch, and roll orientations.

15. The system of claim 1, wherein the navigation modes further comprise eye tracking scroll and rotation, wherein the user vertically scrolls the list and horizontally rotates the list via eye movements.

16. The system of claim 1, wherein the navigation modes further comprise head tracking scroll and rotation, wherein the user vertically scrolls the list and horizontally rotates the list via head movements.

17. The system of claim 1, wherein the navigation modes further comprise hand gesture tracking scroll and rotation, wherein the user vertically scrolls the list and horizontally rotates the list via hand gestures.

18. The system of claim 1, wherein the navigation modes provide a parallaxed multi-dimensional display of the elements within the list.

19. The system of claim 1, wherein the item options comprise one or more selected from the group consisting of:

share, delete, add to a secondary list, apply a visual effect or look, and apply audio.

20. The system of claim 1, wherein the first user interaction is selected from the group consisting of:

tap, double-tap, long hold, push, pull, flick, swipe, on an item in the list of items, or a combination thereof.

21. The system of claim 1, wherein the second user interaction is selected from the group consisting of:

a gyro-gesture, a touchscreen gesture, and combinations thereof.

22. The system of claim 1, wherein the administrative menu is displayed on a plurality of three-dimensional objects, the objects manipulable in three-dimensions as a single unit.

23. The system of claim 1, wherein the processing device is a mobile device and the application is a mobile application.

24. The system of claim 1, wherein the joystick, in the second mode, further allows the user to reset the calibration point of the gyroscope of the processing device.

25. The system of claim 1, wherein the application further comprises a software module configured to allow a user to select one or more items from the list of items and to associate the selected items to form a collection.

26. The system of claim 25, wherein the collection is collaborative and is shared with at least one other user who can edit the collection.

27. The system of claim 1, wherein the application further comprises a software module configured to export a video file comprising screen capture video of a user interacting with the application.

28. The system of claim 1, wherein the navigable multi-dimensional list of items is user-configurable to provide audio or haptic user feedback.

29. Non-transitory computer-readable storage media encoded with a computer program including instructions executable by a processor to create an application comprising:

a. a software module configured to receive information for a plurality of items;

b. a software module configured to utilize the information to generate a navigable multi-dimensional list of items;

the items in the list of items arranged in the X-axis, Y-axis, and Z-axis based on one or more sorting factors;

wherein at least one sorting factor is selected from;

a characteristic of the items, metadata associated with the items, a preference of a user, a behavior of the user, or a combination thereof;

provided that the list of items is navigable by at least three navigation modes comprising touch scroll and rotation, joystick scroll and rotation, gyroscopic scroll and rotation;

wherein, in response to a first user interaction, the Z-axis position of a selected item is arranged to the front and the list of items presents an isolated enlarged version of the selected item;

wherein, in response to a second user interaction, the list of items presents item details and item options for the selected item; and

c. a software module configured to present a joystick graphical user interface element, the joystick graphical user interface element being modal with a first mode wherein the joystick allows the user to display an administrative menu and a second mode wherein the joystick allows the user to navigate the list of items with yaw, pitch, and roll controls.

30. A computer-implemented method for visualizing and navigating a menu system comprising:

a. receiving, by a computer, information for a plurality of items;

b. utilizing, by the computer, the information to generate a navigable multi-dimensional list of items;

the items in the list of items arranged in the X-axis, Y-axis, and Z-axis based on one or more sorting factors;

wherein at least one sorting factor is selected from;

a characteristic of the items, metadata associated with the items, a preference of a user, a behavior of the user, or a combination thereof;

provided that the list of items is navigable by at least three navigation modes comprising touch scroll and rotation, joystick scroll and rotation, gyroscopic scroll and rotation;

c. presenting, by the computer, in response to a first user interaction, an isolated enlarged version of a selected item, wherein the Z-axis position of the selected item is arranged to the front of the list of items;

d. presenting, by the computer, in response to a second user interaction, item details and item options for the selected item; and

e. presenting, by the computer, a joystick graphical user interface element, the joystick graphical user interface element being modal with a first mode wherein the joystick allows the user to display an administrative menu and a second mode wherein the joystick allows the user to navigate the list of items with yaw, pitch, and roll controls.