System and method for providing three-dimensional graphical user interface

• US 9,696,868 B2
• Filed: 02/05/2015
• Issued: 07/04/2017
• Est. Priority Date: 09/13/2005
• Status: Active Grant

• Current Assignee: SpaceTime3D, Inc.
• Original Assignee: SpaceTime3D, Inc.
• Inventors: Bakhash, Ezra Eddie
• Primary Examiner(s): Lee, Ting
• Application Number:
  US14/614,708
• Publication Number:
  US 20150149965A1
• Time in Patent Office: 880 Days
• CPC Class Codes: G06F 16/26 Visual data mining; Browsing structured data
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Methods and systems are provided for an improved three-dimensional graphical user interface. In one embodiment, the method generally comprises: receiving a plurality of inputs from a user and opening a plurality of applications in response thereto, wherein outputs from each application are displayed (e.g., individually) within a two-dimensional space. The method further comprises allowing a user to switch between the plurality of applications by generating images of each output, and displaying those images (e.g., collectively) within a three-dimensional space. The user can then interact with a particular application by selecting a corresponding one of the images displayed within the three-dimensional space. In one embodiment, the method further comprises replacing the output(s) in two-dimensional space with the images in three-dimensional space, and replacing the images in three-dimensional space with the output from the selected application in two-dimensional space.

Claims

1. A method for using a two-dimensional (2D) space to selectively interact with a plurality of applications open on a device and a three-dimensional (3D) immersive space to switch between said plurality of application, said device having a fixed resolution display, comprising:

receiving a plurality of inputs from a user, said plurality of inputs comprising at least first, second, and third inputs;

opening said plurality of applications in response to said plurality of inputs, said plurality of applications comprising at least first, second, and third applications, wherein for each one of said plurality of applications (i) an object is generated having application-specific data, (ii) said object is displayed in said 2D space on said fixed resolution display, and (iii) said user is allowed to modify at least a portion of said application-specific data by interacting with said object;

allowing a user to switch between said plurality of application, comprising;

generating at least a plurality of images, said plurality of images comprising at least first, second, and third images, wherein said first image is an image of at least a portion of a first object generated by said first application and having first application-specific data, said second image is an image of at least a portion of a second object generated by said second application and having second application-specific data, and said third image is an image of at least a portion of a third object generated by said third application and having third application-specific data;

replacing all objects corresponding to said plurality of applications that are visible in said 2D space with said plurality of images, said plurality of images being displayed in said 3D immersive space and in an order based on a last time that said user one of (i) opened said first application and interacted with said first object, (ii) opened said second application and interacted with said second object, and (iii) opened said third application and interacted with said third object, wherein a first one in said order is displayed in a foreground of said 3D immersive space, a second one in said order is displayed in a background of said 3D immersive space behind at least said first one in said order, and a third one in said order is displayed in said background of said 3D immersive space behind at least said second one in said order;

allowing said user to move said plurality of images, wherein (i) movement of one of said plurality of images results in movement of all of said plurality of images, and (ii) continued movement in one direction of one of said plurality of images results in a perception to said user that said one of said plurality of images is moved off of said fixed resolution display; and

allowing said user to delete at least one of said plurality of images from said 3D immersive space, wherein deletion of said second one in said order results in said third one in said order being moved to a location in said 3D immersive space where said second one in said order was located prior to said deletion; and

allowing said user to interact with one of said first, second, and third applications, comprising;

receiving a selection from said user of one of said plurality of images corresponding to one of said plurality of applications;

replacing said plurality of images within said 3D immersive space with one of said first, second, and third objects corresponding to said one of said plurality of applications within said 2D space in response to said selection;

receiving at least one interaction by said user with said one of said first, second, and third objects within said 2D space; and

modifying said one of said first, second, and third application-specific data in response to said at least one interaction.

2. The method of claim 1, wherein said step of displaying said plurality of images on said display device further comprises displaying said plurality of images together with a plurality of icons, wherein each one of said plurality of images has a corresponding one of said plurality of icons.

3. The method of claim 1, wherein said step of displaying said plurality of images on said display device further comprises displaying said plurality of images together with a plurality of descriptions, wherein each one of said plurality of images has a corresponding one of said plurality of descriptions.

4. The method of claim 1, further comprising the step of storing in a database data linking each one of said plurality of images with a corresponding one of said plurality of applications and a corresponding one of said order in which said plurality of images are displayed on said display device.

5. The method of claim 1, wherein a reduction in size of an object or portion thereof is used to depict said object or portion thereof as being behind at least one other object or other portion of said object.

6. The method of claim 1, further comprising the steps of:

displaying a fourth image on said display device, said fourth image being an image of a desktop having at least one other application; and

allowing said user to open said other application by allowing said user to select said fourth image, replacing said fourth image with said desktop in response to said selection, receiving an interaction from said user with said other application, and opening said other application in response to said interaction.

7. The method of claim 1, wherein each one of said plurality of applications comprises a web browser application, and each one of said first, second, and third objects comprises a web browser window.

8. The method of claim 7, further comprising the steps of:

displaying at least fourth and fifth images in a second 3D immersive space, wherein said fourth image is an image of said plurality of images within said 3D immersive space and said fifth image is an image of at least a portion of a fourth object generated by a fourth application previously opened by said user; and

allowing said user to interact with said one of said first, second, and third applications by selecting said fourth image, selecting said one of said plurality of images corresponding to said one of said plurality of applications, and interacting with said one of said first, second, and third objects corresponding to said one of said plurality of applications.

9. The method of claim 1, wherein said step of replacing said plurality of images with one of said first, second, and third objects, further comprises enlarging a size of at least said one of said plurality of images before replacing said one of said plurality of images with said one of said first, second, and third objects, thereby simulating movement of said one of said plurality of images in a z-axis of said display device.

10. A system for using a two-dimensional (2D) space to selectively interact with at least one of a plurality of applications open on a computing device and a three-dimensional (3D) space to switch between said plurality of application, comprising:

a display device;

at least one input device;

at least one processor operatively coupled to said display device and said at least one input device; and

a memory device comprising executable code for;

receiving a plurality of inputs from a user, said plurality of inputs comprising at least first, second, and third inputs;

opening said plurality of applications in response to said plurality of inputs, said plurality of applications comprising at least first, second, and third applications, wherein for each one of said plurality of applications (i) an object is generated having application-specific data, (ii) said object is displayed in said 2D space on said fixed resolution display, and (iii) said user is allowed to modify at least a portion of said application-specific data by interacting with said object;

allowing a user to switch between said plurality of application, comprising;

generating at least a plurality of images, said plurality of images comprising at least first, second, and third images, wherein said first image is an image of at least a portion of a first object generated by said first application and having first application-specific data, said second image is an image of at least a portion of a second object generated by said second application and having second application-specific data, and said third image is an image of at least a portion of a third object generated by said third application and having third application-specific data;

replacing said object corresponding to one of said plurality of applications that is being interacted with by said user in said 2D space with said plurality of images, said plurality of images being displayed in said 3D space and in an order based on a last time that said user one of (i) opened said first application and interacted with said first object, (ii) opened said second application and interacted with said second object, and (iii) opened said third application and interacted with said third object, wherein a first one in said order is displayed in a foreground of said 3D space in front of at least said second one in said order, said second one in said order is displayed in said 3D space behind at least said first one in said order, and a third one in said order is displayed in said 3D space behind at least said second one in said order;

allowing said user to move said plurality of images, wherein (i) movement of one of said plurality of images results in movement of all of said plurality of images, and (ii) continued movement in one direction of one of said plurality of images results in a perception to said user that said one of said plurality of images is moved off of said fixed resolution display; and

allowing said user to delete at least one of said plurality of images from said 3D space, wherein deletion of said second one in said order results in said third one in said order being moved to a location in said 3D space where said second one in said order was located prior to said deletion; and

allowing said user to interact with one of said first, second, and third applications, comprising;

receiving a selection from said user of one of said plurality of images corresponding to one of said plurality of applications;

replacing said plurality of images within said 3D space with one of said first, second, and third objects corresponding to said one of said plurality of applications within said 2D space in response to said selection;

receiving at least one interaction by said user with said one of said first, second, and third objects within said 2D space; and

modifying said one of said first, second, and third application-specific data in response to said at least one interaction.

11. The system of claim 10, wherein said step of displaying said plurality of images on said display device further comprises displaying said plurality of images together with a plurality of icons and a plurality of descriptions, wherein each one of said plurality of images has a corresponding one of said plurality of icons and a corresponding one of said plurality of descriptions.

12. The system of claim 10, further comprising periodically replacing at least one of said plurality of images with at least one other image, said other image showing at least one change to application specific data of a corresponding to one of said plurality of applications while said plurality of images are being displayed in said 3D space.

13. The system of claim 12, further comprising the step of receiving a request from said user to switch from said 2D space to said 3D space, wherein said step of replacing said object in said 2D space with said plurality of images further comprises replacing said object in said 2D space with said plurality of images in response to receiving said request to switch from said 2D space to said 3D space.

14. The system of claim 10, wherein a reduction in size of an object or portion thereof is used to depict said object or portion thereof as being behind at least one other object or other portion of said object.

15. The system of claim 10, wherein said executable code is further configured to:

display a fourth image on said display device in said 3D space, said fourth image being an image of a desktop having at least one other application; and

allow said user to open said other application by allowing said user to select said fourth image, replacing said fourth image with said desktop in response to said selection, receiving an interaction from said user with said other application, and opening said other application in response to said interaction.

16. The system of claim 10, wherein each one of said plurality of applications comprises a web browser application, and each one of said first, second, and third objects comprises a web browser window.

17. The system of claim 16, wherein said executable code is further configured to:

display at least fourth and fifth images in a second 3D space, wherein said fourth image is an image of said plurality of images within said 3D space and said fifth image is an image of at least a portion of a fourth object generated by a fourth application previously opened by said user; and

allow said user to interact with said one of said first, second, and third applications by selecting said fourth image, selecting said one of said plurality of images corresponding to said one of said plurality of applications, and interacting with said one of said first, second, and third objects corresponding to said one of said plurality of applications.

18. The system of claim 10, wherein said step of replacing said plurality of images with one of said first, second, and third objects, further comprises enlarging a size of at least said one of said plurality of images before replacing said one of said plurality of images with said one of said first, second, and third objects, thereby simulating movement of said one of said plurality of images in a z-axis of said display device.

19. A method for using a two-dimensional (2D) space to selectively interact with at least one of a plurality of applications open on a device and a three-dimensional (3D) space to switch between said plurality of application, comprising:

receiving a plurality of inputs from a user, said plurality of inputs comprising at least first, second, and third inputs;

opening said plurality of applications in response to said plurality of inputs, said plurality of applications comprising at least first, second, and third applications, wherein for each one of said plurality of applications (i) an output is generated having application-specific data, (ii) displaying said output in said 2D space on said fixed resolution display, and (iii) allowing said user to modify at least a portion of said application-specific data by interacting with said output;

allowing a user to view information on said plurality of application, comprising;

generating at least a plurality of images, said plurality of images comprising at least first, second, and third images, wherein said first image is an image of at least a portion of a first object generated by said first application and having first application-specific data, said second image is an image of at least a portion of a second object generated by said second application and having second application-specific data, and said third image is an image of at least a portion of a third object generated by said third application and having third application-specific data;

replacing said output corresponding to one of said plurality of applications that is being interacted with by said user in said 2D space with said plurality of images, said plurality of images being displayed in said 3D space and in an order based on a last time that said user one of (i) opened said first application and interacted with said first object, (ii) opened said second application and interacted with said second object, and (iii) opened said third application and interacted with said third object, wherein said 3D space comprises at least a foreground and a background, a first one in said order is displayed in said foreground, and second and third ones in said order are displayed in one of a foreground and a background;

allowing said user to move said plurality of images, wherein (i) movement of one of said plurality of images results in movement of all of said plurality of images, and (ii) continued movement in one direction of one of said plurality of images results in a perception to said user that said one of said plurality of images is moved off of said fixed resolution display; and

allowing said user to delete at least one of said plurality of images from said 3D space, wherein deletion of said second one in said order results in said third one in said order being moved to a location in said 3D space where said second one in said order was located prior to said deletion; and

allowing said user to interact with one of said first, second, and third applications, comprising;

receiving a selection from said user of one of said plurality of images corresponding to one of said plurality of applications;

replacing said plurality of images within said 3D space with one of said first, second, and third outputs corresponding to said one of said plurality of applications within said 2D space in response to said selection;

receiving at least one interaction by said user with said one of said first, second, and third outputs within said 2D space; and

modifying said one of said first, second, and third application-specific data in response to said at least one interaction.

20. The method of claim 19, wherein said step of replacing said plurality of images with one of said first, second, and third objects, further comprises enlarging a size of at least said one of said plurality of images before replacing said one of said plurality of images with said one of said first, second, and third objects, thereby simulating movement of said one of said plurality of images in a z-axis of said display device.