Method and apparatus for providing a three-dimensional task gallery computer interface

• US 10,042,512 B2
• Filed: 09/10/2014
• Issued: 08/07/2018
• Est. Priority Date: 04/06/1999
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Robertson, George G., Czerwinski, Mary P., Hinckley, Kenneth P., Risden, Kirsten C., Robbins, Daniel C., van Dantzich, Maarten R.
• Primary Examiner(s): VU, THANH T
• Application Number:
  US14/482,324
• Publication Number:
  US 20150058791A1
• Time in Patent Office: 1,427 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

The present invention provides a three-dimensional user interface for a computer system that allows a user to combine and store a group of windows as a task. The image of each task can be positioned within a three-dimensional environment such that the user may utilize spatial memory in order remember where a particular task is located.

Claims

1. A computer-implemented method comprising:

generating a user interface display that includes a visual representation of a three-dimensional space having at least;

a ceiling display area that visually represents a ceiling in the three-dimensional space,

a floor display area that visually represents a floor in the three-dimensional space, and

a stage display area that visually represents a stage that is spaced apart from the floor in the three-dimensional space;

generating a task display element having a first image that represents a task associated with an application, wherein the task display element

is at a first location in the three-dimensional space apart from the stage display area, and

has an inactive state;

based on a user input associated with the first image,

modifying the user interface display to

visually move the task display element from the first location to a second location in the stage display area, and

include a second image that represents the task at the first location in the three-dimensional space, wherein the second image is displayed after the first image is moved to the stage display area and has a dimmed appearance relative to the first image; and

automatically changing the task display element from the inactive state to an active state at the second location; and

based on user interaction with the task display element having the active state at the second location, performing a computing action that is associated with the task in the application.

2. The computer-implemented method of claim 1, wherein the display element comprises a representation of a plurality of windows, the user interaction with the display element comprises a user input that manipulates the windows and interacts with an application through the windows.

3. The computer-implemented method of claim 2, wherein the stage display area is positioned at a hallway display area forming by the floor display area, the ceiling display area, and the side wall display areas.

4. The computer-implemented method of claim 1, wherein the three-dimensional space has first and second side wall display areas, and the stage display area extends between the first and second side wall display areas.

5. The computer-implemented method of claim 1, wherein generating a display element at the first location comprises displaying a stand display element beneath the display element.

6. The computer-implemented method of claim 5, wherein moving the task display element comprising leaving the stand display element at the first location such that the stand display element is displayed beneath the second image at the first location.

7. The computer-implemented method of claim 1, wherein receiving a user input comprises receiving a user selection input that selects the task display element, the method further comprising:

modifying, in response to the user selection input, a visual appearance of the first image to indicate user selection of the task.

8. The computer-implemented method of claim 7, wherein modifying the visual appearance of the first image comprises at least one of:

modifying a border of the first image;

modifying a background of the first image; and

providing the first image with a textual cue.

9. The computer-implemented method of claim 1, wherein the stage display element is positioned at an end wall display area formed by the floor display area, the ceiling display area, and at least one side wall display area, and wherein moving the task display element to the second location comprises:

expanding the first image to fill substantially all of the end wall display area.

10. A computer-implemented method comprising:

generating a user interface display that includes a visual representation of a three-dimensional space having at least;

a ceiling display element that visually represents a ceiling in the three-dimensional space, and

a floor display element that visually represents a floor in the three-dimensional space;

generating a task image that represents a task associated with an application;

generating a stand display element that represents a stand beneath the task image in the three-dimensional space, the stand display element visually connecting the task image to the floor display element;

expanding the stand display element as the task image is moved away from the floor display element toward the ceiling display element, such that the stand display element continues to visually connect the task image to the floor display element;

based on detecting that the task image has reached a ceiling display area proximate the ceiling display element, removing the stand display element from beneath the task image; and

based on user interaction with the task image, performing a computing action that is associated with the task in the application.

11. The method of claim 10, wherein the task image comprises a representation of at least one window.

12. The method of claim 10, and further comprising:

after the task image reaches the ceiling display image, displaying the task image with a bottom of the task image leaning toward an end wall display element of the three-dimensional space.

13. A computing system comprising:

a processor; and

memory storing instructions executable by the processor, wherein the instructions, when executed, configure the computing system to;

generate a user interface display that includes a visual representation of a three-dimensional space having at least;

a ceiling display area that visually represents a ceiling in the three-dimensional space,

a floor display area that visually represents a floor in the three-dimensional space, and

a stage display area that visually represents a stage that is spaced apart from the floor in the three-dimensional space;

generate a task display element having a first image that represents a task associated with an application, wherein the task display element is at a first location in the three-dimensional space apart from the stage display area;

based on a user input associated with the first image, modify the user interface display to

visually move the task display element from the first location to a second location in the stage display area, and

include a second image that represents the task at the first location in the three-dimensional space, wherein the second image is displayed after the first image is moved to the stage display area and has a dimmed appearance relative to the first image; and

based on user interaction with the task display element at the second location, perform a computing action that is associated with the task in the application.

14. The computing system of claim 13, wherein the display element at the first location has an inactive state, and the instructions configure the computing system automatically change the display element from the inactive state to an active state at the second location.

15. The computing system of claim 13, wherein

the three-dimensional space has first and second side wall display areas, and the stage display area extends between the first and second side wall display area, and

the stage display area is positioned at a hallway display area formed by the floor display area, the ceiling display area, and the side wall display area.

16. The computing system of claim 13, wherein the instructions configure the computing system to display a stand display element beneath the display element at the first location.

17. The computing system of claim 16, wherein the instructions configure the computing system to move the task display element by leaving the stand display element at the first location such that the stand display element is displayed beneath the second image at the first location.

18. The computing system of claim 13, wherein the instructions configure the computing system to receive a user selection input that selects the task display element, and modify, in response to the user selection input, a visual appearance of the first image to indicate user selection of the task.

19. The computing system of claim 18, wherein modifying the visual appearance of the first image comprises at least one of:

modifying a border of the first image;

modifying a background of the first image; and

providing the first image with a textual cue.

20. The computing system of claim 13, wherein the stage display element is positioned at an end wall display area formed by the floor display area, the ceiling display area, and at least one side wall display area, and wherein the task display element is moved to the second location by expanding the first image to fill substantially all of the end wall display area.