Using perspective to visualize data

• US 10,290,147 B2
• Filed: 08/11/2015
• Issued: 05/14/2019
• Est. Priority Date: 08/11/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Geselowitz, Lewey, Fitzgibbon, Andrew, Banks, Richard, Horn, Stephanie
• Primary Examiner(s): Broome, Said
• Application Number:
  US14/823,260
• Publication Number:
  US 20170046872A1
• Time in Patent Office: 1,372 Days
• Field of Search: None
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data

Abstract

A system is provided that allows a user to visualize data. A dataset that includes a plurality of data items arranged in a two-dimensional (2D) format is received. A request to visualize the dataset in three dimensions is then received. A three-dimensional (3D) visualization of the dataset is then generated based on this request. This 3D visualization adds a third dimension to the 2D arrangement of data items, where the extent of the third dimension is commensurate with the type and value of the data items. This 3D visualization includes an initial depiction of the dataset which is generated from a point of view that is specified by this request. The initial depiction of the dataset is then displayed on a display device of the system in lieu of the dataset itself.

Claims

1. A system for allowing a user to visualize data, comprising:

a computing device comprising a display device; and

a computer program having program modules executable by the computing device, the computing device being directed by the program modules of the computer program to;

receive a dataset of data items, wherein each data item represents a particular data type and the dataset as a whole comprises data items that collectively represent a plurality of different data types, and wherein each data item is associated with a 2D region in a 2D arrangement of the data items;

receive a request to visualize the dataset in three dimensions;

generate a three-dimensional (3D) visualization of the dataset based on the request, the 3D visualization adding a third dimension to at least some of the data items of the 2D arrangement of the data items, an extent of the third dimension for a data item being commensurate with a type and a value of the data item, the 3D visualization comprising an initial 3D depiction of the dataset that is generated from a point of view that is specified by the request;

display the initial 3D depiction of the dataset on the display device in lieu of the dataset itself, wherein the initial 3D depiction of the dataset is manipulatable;

receive a request to manipulate the initial 3D depiction of the dataset, wherein the request specifies at least one data operation to be performed with respect to the initial 3D depiction;

perform the at least one data operation with respect to the initial 3D depiction to create a manipulated 3D depiction of the dataset, wherein performing the at least one data operation comprises moving at least one data item to a different 2D region in the 2D arrangement of the data items; and

display the manipulated 3D depiction of the dataset instead of the initial 3D depiction of the dataset.

2. The system of claim 1, wherein the point of view is either precisely or substantially orthogonal to the 2D arrangement of the data items and thus appears to be a 2D depiction of the dataset.

3. The system of claim 1, wherein the point of view is not precisely or substantially orthogonal to the 2D arrangement of the data items.

4. The system of claim 1, wherein the request to manipulate the initial 3D depiction of the dataset changes the point of view along a path of rotation, and the manipulated 3D depiction of the dataset is generated from a different point of view.

5. The system of claim 4, wherein the path of rotation is either pre-defined, or controlled by the user interactively.

6. The system of claim 4, wherein:

whenever the request to manipulate the initial 3D depiction of the dataset selects one of the data items, the path of rotation is oriented around the selected data item; and

whenever the request to manipulate the initial 3D depiction of the dataset does not select one of the data items, the path of rotation is oriented around a centroid of the initial 3D depiction of the dataset that is displayed on the display device.

7. The system of claim 1, wherein the 2D arrangement of the data items comprises a plurality of columns and one or more rows, and whenever the manipulation request selects one or more of the columns, the manipulated 3D depiction of the dataset adds the third dimension to just the data items in the selected one or more columns.

8. The system of claim 1, wherein the at least one data operation comprises at least one of:

a data sorting operation, or

a data filtering operation, or

a data graphing operation, or

a data editing operation.

9. The system of claim 1, wherein, whenever the point of view from which a given depiction of the dataset is generated is not precisely or substantially orthogonal to the 2D arrangement of the data items, intensities of the data items in the 2D arrangement of the data items are determined based on distances from the point of view to the data items, an intensity for a particular data item decreasing as a distance from the point of view to the particular data item increases.

10. The system of claim 1, wherein the 2D arrangement of the data items comprises a plurality of columns and one or more rows, and an extent of the third dimension is determined for each column independently.

11. The system of claim 1, wherein one or more of the data items comprises a text string, and an extent of the third dimension for each text string is determined using a prescribed scoring function comprising one of:

an alphabetic scoring function, or

a frequency of occurrence scoring function.

12. The system of claim 1, wherein the program module for displaying the initial 3D depiction of the dataset on the display device in lieu of the dataset itself comprises a program module for displaying the value of each of the data items on top of the third dimension that is added thereto.

13. A system for allowing a user to visualize data, comprising:

a computing device comprising a display device;

one or more different user input mechanisms that are utilized by the user to input requests into the computing device; and

a computer program having program modules executable by the computing device, the computing device being directed by the program modules of the computer program to;

receive a dataset of data items, wherein each data item represents a particular data type and the dataset as a whole comprises data items that collectively represent a plurality of different data types, and wherein each data item is associated with a 2D region in a 2D arrangement of the data items;

receive a request to visualize the dataset in three dimensions;

generate a three-dimensional (3D) visualization of the dataset based on the request, the 3D visualization adding a third dimension to at least some of the data items of the 2D arrangement of the data items, the 3D visualization comprising an initial 3D depiction of the dataset that is generated from a point of view that is specified by the request;

display the initial 3D depiction of the dataset on the display device in lieu of the dataset itself, wherein the initial 3D depiction of the dataset is manipulatable;

receive a request to manipulate the initial 3D depiction of the dataset, wherein the request specifies at least one data operation to be performed with respect to the initial 3D depiction;

perform the at least one data operation with respect to the initial 3D depiction to create a manipulated 3D depiction of the dataset, wherein performing the at least one data operation comprises moving at least one data item to a different 2D region in the 2D arrangement of the data items; and

display a revised depiction of the dataset on the display device in lieu of the dataset itself, the revised depiction being based on the manipulated 3D depiction of the dataset.

14. The system of claim 13, wherein the one or more different user input mechanisms comprise one or more of:

a physical keyboard that is either integrated into the computing device or externally connected thereto;

or

a mouse that is externally connected to the computing device;

or

a handheld remote controller that is externally connected to the computing device;

or

a trackpad that is either integrated into the computing device or externally connected thereto.

15. The system of claim 13, wherein the computing device is touch-enabled, and the one or more different user input mechanisms comprise one or more of:

finger-based screen-contacting gestures that are made by the user;

or

stylus-based screen-contacting gestures that are made by the user.

16. The system of claim 13, wherein the computing device is voice-enabled, and the one or more different user input mechanisms comprise speech that the user utters.

17. The system of claim 13, wherein the computing device is vision-enabled, and the one or more different user input mechanisms comprise one or more of:

gaze-based gestures that are made by the user;

or

hand-based in-air gestures that are made by the user.

18. The system of claim 13, wherein the computing device is motion-enabled, and the one or more different user input mechanisms comprise movements of the computing device that are made by the user.

19. A computer-implemented process for generating a dataset depiction, comprising:

receiving a dataset of data items, wherein each data item represents a particular data type and the dataset as a whole comprises data items that collectively represent a plurality of different data types, and wherein each data item is associated with a 2D region in a 2D arrangement of the data items;

receiving a request to visualize the dataset in three dimensions;

generating a three-dimensional (3D) visualization of the dataset based on the request, the 3D visualization adding a third dimension to at least some of the data items of the 2D arrangement of the data items, the extent of the third dimension for a data item being commensurate with a type and a value of the data item, the 3D visualization comprising an initial 3D depiction of the dataset;

displaying the initial 3D depiction of the dataset on a display device in lieu of the dataset itself, wherein the initial 3D depiction of the dataset is manipulatable;

receiving a request to manipulate the initial 3D depiction of the dataset, wherein the request specifies at least one data operation to be performed with respect to the initial 3D depiction;

performing the at least one data operation with respect to the initial 3D depiction to create a manipulated 3D depiction of the dataset; and

displaying the manipulated 3D depiction of the dataset instead of the initial 3D depiction of the dataset.