Widgets displayed and operable on a surface of a volumetric display enclosure

• US 7,554,541 B2
• Filed: 06/28/2002
• Issued: 06/30/2009
• Est. Priority Date: 06/28/2002
• Status: Expired due to Fees

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Kurtenbach, Gordon Paul, Balakrishnan, Ravin, Fitzmaurice, George William
• Primary Examiner(s): Pappas; Peter-Anthony
• Application Number:
  US10/183,945
• Publication Number:
  US 20040001111A1
• Time in Patent Office: 2,559 Days
• Field of Search: 345/424, 345/633, 345/848, 345/850, 345/852, 345/863, 345/782, 345/653, 345/665, 345/680, 345/650, 345/661, 345/676
• US Class Current: 345/424
• CPC Class Codes: G02B 30/50 the image being built up from image elements distributed over a 3D volume, e.g. voxels
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

The present invention is a system that places 2D user interface widgets in optimal positions in a 3D volumetric display where they can be easily used based on the knowledge user have about traditional 2D display systems. The widgets are placed on a shell or outer edge surface of a volumetric display, in a ring around the outside bottom of the display, in a vertical or horizontal plane within the display and/or responsive to the users focus of attention. Virtual 2D widgets are mapped to volumetric voxels of the 3D display system. This mapping includes any mapping between a 2D representation or virtual display map of the widget to the corresponding voxels. For example, a 2D texture map of the widget image may be mapped into voxels. Control actions in the 3D volume initiated by conventional control devices, such as a mouse or a touch sensitive dome enclosure surface, are mapped to controls of the widgets and appropriate control functions are performed.

Claims

1. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible; and

allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled pointer position capable of being located anywhere in the volumetric display to a two-dimensional interface virtual map.

2. A process as recited in claim 1, wherein the producing comprises positioning the user interface on an outermost edge of the volumetric display within the volumetric display.

3. A process as recited in claim 1, wherein the producing comprises positioning the interface responsive to a users eye gaze.

4. A process as recited in claim 3, wherein the producing comprises positioning the interface responsive to a users focus of attention.

5. A process as recited in claim 1, wherein the producing comprises mapping a 2D interface representation into a 3D interface in the display.

6. A process as recited in claim 1, wherein the producing comprises drawing the interface in three dimensions using three-dimensional drawing primitives

7. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible; and

allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled pointer position in the volumetric display to a two-dimensional interface virtual map,

wherein the producing comprises mapping a 2D interface representation into a 3D interface in the display, and

wherein the producing comprises mapping a two-dimensional interface representation to voxels in the volumetric display.

8. A process as recited in claim 7, wherein the mapping comprises assigning 2D texture of the interface to each voxel.

9. A process as recited in claim 8, wherein when the interface has a thickness of more than one voxel, the assigning comprising:

determining whether a voxel intersects a 3D interface surface;

mapping the 2D texture when an intersection occurs comprising;

mapping the intersecting voxel to a user interface texture map local surface position;

sampling texture of the texture map at the local surface position; and

assigning the texture of the sample to the voxel.

10. A process as recited in claim 7, further comprising mapping control inputs of the volumetric display to controls of the representation.

11. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible, and mapping control inputs of the volumetric display to controls of the interface; and

allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled pointer position in the volumetric display to a two-dimensional interface virtual map.

12. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible, comprising;

mapping a two-dimensional interface representation to voxels in the volumetric display where the interface has a thickness of more than one voxel producing an interface having a physical three-dimensional volume;

assigning 2D texture of the interface to each voxel, the assigning comprising;

determining whether a voxel intersects a 3D interface surface; and

mapping the 2D texture when an intersection occurs comprising;

mapping the intersecting voxel to a user interface texture map local surface position;

sampling texture of the texture map at the local surface position;

assigning the texture of the sample to the voxel; and

mapping control inputs of the volumetric display to controls of the representation; and

allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled pointer position in the volumetric display to a two-dimensional interface virtual map.

13. An apparatus, comprising:

a volumetric display system for generating and displaying a physical three-dimensional volumetric scene and having a cursed exterior surface portion;

an input system inputting a three-dimensional control input for a user interface; and

a computer system receiving the control input for the user interface, mapping a two-dimensional representation of the interface to voxels within the display system producing an interface having a physical three-dimensional volume which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible and mapping the three-dimensional control input to the two-dimensional representation, and allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled pointer position in the volumetric display to a two-dimensional interface virtual map.

14. A computer readable storage encoded with a computer program for controlling a computer by a process, the program comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion and producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible and determining whether a control of the interface has been activated by mapping a user controlled pointer position in the volumetric display to a two-dimensional interface virtual map and allowing a user to operate the two-dimensional graphical user interface.

15. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible; and

allowing a user to operate the two-dimensional graphical user interface by determining whether a control of the interface has been activated by mapping a user controlled voxel pointer position coordinates in the volumetric display to coordinate positions of a two-dimensional interface virtual map when a selection device has been activated.

16. A process, comprising:

generating and displaying a volumetric display having a physically curved exterior surface portion;

producing a two-dimensional graphical user interface having a physical three-dimensional volume within the volumetric display and which, when positioned in association with the curved exterior surface portion, is produced to physically and visibly conform to the curved exterior surface portion, such that the conformed physical volume is physically curved within the three-dimensional volume, while maintaining its shape simultaneously from any plurality of different points of view outside the volumetric display where the interface is visible; and

allowing a user to interact with the two-dimensional graphical user interface to activate the control by mapping a user controlled voxel pointer position in the volumetric display to a two-dimensional interface virtual map for the control when a selection device indicating a control operation has been activated.