System for organizing and visualizing display objects

• US 8,402,382 B2
• Filed: 04/18/2007
• Issued: 03/19/2013
• Est. Priority Date: 04/21/2006
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Agarawala, Anand, Balakrishnan, Ravin
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): Durkin, James T
• Application Number:
  US12/293,198
• Publication Number:
  US 20090307623A1
• Time in Patent Office: 2,162 Days
• Field of Search: 715/765, 715/775, 715/808, 715/810, 715/848, 715/766, 715/847, 345173-179
• US Class Current: 715/765
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor

Abstract

A method, system and computer program for organizing and visualizing display objects within a virtual environment is provided. In one aspect, attributes of display objects define the interaction between display objects according to pre-determined rules, including rules simulating real world mechanics, thereby enabling enriched user interaction. The present invention further provides for the use of piles as an organizational entity for desktop objects. The present invention further provides for fluid interaction techniques for committing actions on display objects in a virtual interface. A number of other interaction and visualization techniques are disclosed.

Claims

1. A method comprising:

generating, by a computing device, display objects for display in a virtual environment, the display objects representing one or more collections of data;

receiving, at a touch-based input device operatively coupled to the computing device, a user input comprising a gesture that at least partially encloses a group of the display objects representing the one or more collections of data, wherein the gesture intersects with a selection icon, wherein the selection icon is generated for display in response to detecting at least a portion of the gesture and prior to the gesture intersecting with the selection icon, wherein each display object of the group of display objects at least partially enclosed by the gesture is displaced at a different position in the virtual environment;

determining, by the computing device, a distance between first and second end points of the gesture;

selecting, by the computing device and after determining that the gesture intersects with the selection icon, an option associated with the distance from a plurality of options associated with a range of distances, wherein the distance is included in the range of distances; and

in response to determining that the gesture intersects with the selection icon, generating, by the computing device and based at least in part on the selected option, the group of display objects for display in an axial alignment, wherein each display object of the group of display objects is stacked in the axial alignment, such that display objects of the group of display objects appear to be stacked on top of each other.

2. The method of claim 1, wherein the virtual environment is a virtual desktop and the display objects are icons, each icon representing one of:

a file;

a directory; and

an application program.

3. The method of claim 1, wherein an appearance of the display objects is defined by attributes of the one or more collections of data.

4. The method of claim 1, wherein the virtual environment is a virtual two-dimensional or virtual three-dimensional desktop.

5. The method of claim 1, wherein the one or more collections of data are digital files selected from the group consisting of text, documents, images, audio, web pages, web content, web search results, products in an online store, services in an online store, videos, and software programs and file system directories.

6. The method of claim 1, wherein the touch-based input device comprises a digital pen or a touch-sensitive surface.

7. The method of claim 1, further comprising:

enabling real-time user interaction with the display objects in the virtual environment, wherein the user interaction with the display objects in the virtual environment is defined by pre-determined mechanics rules.

8. The method of claim 7, wherein attributes of the display objects define the user interaction according to the mechanics rules.

9. The method of claim 7, wherein the mechanics rules include simulation rules selected from the group consisting of gravity, position of the display objects, mass of the display objects, velocity of the display objects, friction between the display objects, collisions between the display objects and rigidity of the display objects.

10. The method of claim 7, wherein the user interaction includes piling of the display objects in the virtual environment.

11. The method of claim 10, wherein the piling includes pile-to-pile interactions, intra-pile interaction, pile widgets, hierarchical piles, transition between unpiled and piled display objects, and piling of arbitrarily sized display objects.

12. The method of claim 7, wherein the user interaction comprises the user input received at the touch-based input device.

13. The method of claim 1, further comprising:

receiving, at the touch-based input device associated with the computing device, a second user input comprising a second gesture to select the group of the display objects representing the one or more collections of data;

in response to receiving the second user input, generating for display in the virtual environment, by the computing device, one or more widgets associated with one or more display operations, wherein each of the one or more display operations generates for display the group of display objects in a different pre-defined configuration;

receiving, at the touch-based input device associated with the computing device, a third user input comprising a third gesture to select one of the one or more widgets; and

in response to receiving the third user input, generating for display in the virtual environment, by the computing device, the selected group of display objects in one of the different pre-defined configurations based at least in part on the third user input.

14. The method of claim 1, wherein the user input is a first user input, the gesture is a first gesture, and the distance is a first distance, the method further comprising:

receiving, at the touch-based input device associated with the computing device, a second user input comprising a second gesture that at least partially encloses the group of display objects stacked in the axial alignment;

determining, by the computing device, a second distance between first and second end points of the second gesture, wherein the first distance is different than the second distance;

selecting, by the computing device, an option associated with the second distance from the plurality of options associated with the range of distances, wherein the second distance is included in the range of distances; and

generating, by the computing device based at least in part on the selected option, the group of display objects for display, wherein each display object of the group of display objects is displaced at a different position in the virtual environment.

15. The method of claim 14, further comprising:

determining, by the computing device, a selection of the second distance within the range of distances, wherein a degree of displacement of the group of display objects at different positions in the virtual environment is based at least in part on the second distance within the range of distances.

16. The method of claim 1, further comprising:

determining, by the computing device, a selection of the distance within the range of distances, wherein a degree of axial alignment of the group of display objects in the virtual environment is based at least in part on the second distance within the range of distances.

17. The method of claim 1, further comprising:

determining, by the computing device, a centroid of the at least partially enclosed group of the display objects; and

generating for display, by the computing device and at the touch-based input device, the selection icon at the centroid of the at least partially enclosed group of the display objects.

18. A system comprising:

a touch-based input device;

a computer; and

an application loaded on the computer, the application being operable to provide instructions to the computer that;

generate display objects for display in a virtual environment, the display objects representing one or more collections of data;

receive at the touch-based input device a user input comprising a gesture that at least partially encloses a group of the display objects representing the one or more collections of data, wherein the gesture intersects with a selection icon, wherein the selection icon is generated for display in response to detecting at least a portion of the gesture and prior to the gesture intersecting with the selection icon, wherein each display object of the group of display objects at least partially enclosed by the gesture is displaced at a different position in the virtual environment;

determine a distance between first and second end points of the gesture;

select, after determining that the gesture intersects with the selection icon, an option associated with the distance from a plurality of options associated with a range of distances, wherein the distance is included in the range of distances; and

in response to determining that the gesture intersects with the selection icon, generate, based at least in part on the selected option, the group of display objects for display in an axial alignment, wherein each display object of the group of display objects is stacked in the axial alignment, such that display objects of the group of display objects appear to be stacked on top of each other.

19. A non-transitory computer-readable medium comprising instructions that, when executed, cause a processor to:

generate display objects for display in a virtual environment, display objects representing one or more collections of data;

receive, at a touch-based input device operatively coupled to the computing device, a user input comprising a gesture that at least partially encloses a group of the display objects representing the one or more collections of data, wherein the gesture intersects with a selection icon, wherein the selection icon is generated for display in response to detecting at least a portion of the gesture and prior to the gesture intersecting with the selection icon, wherein each display object of the group of display objects at least partially enclosed by the gesture is displaced at a different position in the virtual environment;

determine a distance between first and second end points of the gesture;

select, by the computing device and after determining that the gesture intersects with the selection icon, an option associated with the distance from a plurality of options associated with a range of distances, wherein the distance is included in the range of distances; and

in response to determining that the gesture intersects with the selection icon, generate, based at least in part on the selected option, the group of display objects for display in an axial alignment, wherein each display object of the group of display objects is stacked in the axial alignment, such that display objects of the group of display objects appear to be stacked on top of each other.