Multi-planar volumetric display system and method of operation using psychological vision cues

• US 6,466,185 B2
• Filed: 08/20/2001
• Issued: 10/15/2002
• Est. Priority Date: 04/20/1998
• Status: Expired due to Term

• Current Assignee: Lightspace Technologies, Inc. (LC-Tec Holding AB)
• Original Assignee: Vizta 3D, Inc.
• Inventors: Sullivan, Alan, Snuffer, John
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Eisen, Alexander
• Application Number:
  US09/933,424
• Publication Number:
  US 20020113752A1
• Time in Patent Office: 421 Days
• Field of Search: 345/4-6, 345/419, 345/422, 345/424, 345/431
• US Class Current: 345/6
• CPC Class Codes: G02B 30/52 the 3D volume being constructed from a stack or sequence of 2D planes, e.g. depth sampling systems
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/395 with depth sampling, i.e. the volume being constructed from a stack or sequence of 2D image planes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A multi-planar volumetric display system and method generate volumetric three-dimensional images using a multi-surface optical device including a plurality of individual optical elements corresponding to a plurality of image depths. An image projector selectively projects images on respective optical elements to generate a volumetric three-dimensional image viewable in the multi-surface optical device. Psychological vision cues are added during generation of the three-dimensional image to enhance depth perception when viewing the three-dimensional image. A floating-image generator may project the three-dimensional image having enhanced depth to generate a second volumetric three-dimensional image viewable as floating in space.

Claims

1. A system for displaying a volumetric three dimensional image of a three-dimensional scene having a virtual depth D_V, comprising:

(a) a controller for generating data representing a series of two dimensional slices at varying depths through said three dimensional scene;

(b) a multi-surface optical device having a physical depth D_D including a plurality of optical elements; and

(c) an image projector responsive to said data for selectively projecting said series of two dimensional slices on respective optical elements of said multi-surface optical device to display a first volumetric three dimensional image viewable in the multi-surface optical device, wherein the virtual depth D_V of said three dimensional scene is mapped to correspond to the physical depth D_D of said multi-surface optical device; and

(d) a projector for projecting the first volumetric three dimensional image formed in the multi-surface optical device to generate a second volumetric three dimensional image viewable in a space outside of said multi-surface optical device.

2. The system of claim 1 wherein the virtual depth D_V of said three dimensional scene is mapped to the physical depth D_D of said multi-surface optical device by a linear relationship.

3. The system of claim 1 wherein the virtual depth D_V of said three dimensional scene is mapped to the physical depth D_D of said multi-surface optical device by a non-linear relationship.

4. The system of claim 1 wherein said plurality of optical elements are equally spaced along a depth axis.

5. The system of claim 1 wherein said plurality of optical elements are unequally spaced along a depth axis.

6. The system of claims 4 and 5 wherein a depth within said first three dimensional image is further mapped to correspond to one of said plurality of optical elements.

7. A system for displaying a volumetric three dimensional image of a three dimensional scene, comprising:

(a) a controller for generating data representing a series of two dimensional slices at varying depths through a selected portion of a three dimensional scene, said selected portion corresponding to a maximum virtual depth value Z_MAX and minimum virtual depth value Z_MIN;

(b) a multi-surface optical device including a plurality of optical elements arranged; and

(c) an image projector responsive to said data for projecting said series of two dimensional slices onto respective optical elements of said multi-surface optical device to display a first volumetric three dimensional image viewable in the multi-surface optical device, wherein the slice associated with said minimum virtual depth value Z_MIN is projected onto a forward optical element of said multi-surface optical device, and the slice associated with said maximum depth value Z_MAX is projected onto a rearward optical element of said multi-surface optical device, with remaining slices being projected onto respective optical elements therebetween.

8. The system of claim 7 wherein portions of said three dimensional scene which lie beyond the maximum virtual depth value Z_MAX are displayed as two-dimensional images on a rearward optical element.

9. The system of claim 7 wherein the values of Z_MAX and Z_MIN are assigned interactively by a viewer.

10. The system of claim 7 wherein the values of Z_MAX and Z_MIN are assigned by a viewer during application startup.

11. The system of claims 8 and 9 wherein the slice associated with said minimum depth value Z_MIN is projected onto the forwardmost optical element of said multi-surface optical device and the slice associated with said maximum depth value Z_MAX is projected onto the rearmost optical element of said multi-surface optical device.

12. The system of claims 7 and 8 further including a floating image generator for projecting the first volumetric three dimensional image formed in the multi-surface optical device to generate a second volumetric three dimensional image viewable as floating in space at a location outside of the multi-surface optical device.

13. A method for generating a volumetric three dimensional image of a three dimensional scene, the method comprising the steps of:

(a) generating data representing a series of two dimensional slices at varying depths through a selected portion of said three dimensional scene, said selected portion corresponding a maximum depth value Z_MAX and minimum depth value Z_MIN; and

(b) projecting the series of two dimensional slices on respective optical elements of a multi-surface optical device to display a first volumetric three dimensional image viewable in said multi-surface optical device, wherein the slice corresponding to said minimum depth value Z_MIN is projected onto a forward optical element of said multi-surface optical device, and the slice generated at said maximum depth value Z_MAX is projected onto a rearward optical element of said multi-surface optical device, with remaining slices being projected onto respective optical elements therebetween.

14. The method of claim 13 wherein portions of said three dimensional scene which lie beyond the maximum depth value Z_MAX are projected as two-dimensional images onto a rearward optical element.

15. The method of claim 13 wherein the values of Z_MAX and Z_MIN are assigned interactively by a viewer.

16. The method of claim 13 wherein the values of Z_MAX and Z_MIN are assigned by a viewer during application startup.

17. The method of claims 13 and 14 wherein the slice corresponding to said minimum depth value Z_MIN is projected onto the forwardmost optical element of said multi-surface optical device and the slice corresponding to said maximum depth value Z_MAX is projected onto the rearmost optical element of said multi-surface optical device.

18. The method of claims 13 and 14 further including the step of projecting the first volumetric three dimensional image from the multi-surface optical device to generate a second volumetric three dimensional image viewable as floating in space at a location outside of the multi-surface optical device.

19. A system for generating volumetric three dimensional images comprising:

(a) a controller for rendering a three dimensional scene to provide at least one psychological vision cue and for generating a series of two dimensional slices through said rendered three dimensional scene;

(b) an optical device onto which said two dimensional slices can be projected; and

(c) an image projector for selectively projecting the series of two dimensional slices on said optical device to generate a first volumetric three dimensional image wherein said at least one psychological vision cue causes the apparent depth of said first volumetric three dimensional image to exceed the physical depth of said optical device.

20. The system of claim 19 wherein said at least one psychological cue is provided by including shading in said rendered three dimensional scene.

21. The system of claim 19 wherein said at least one psychological cue is provided by including shadows in said rendered three dimensional scene.

22. The system of claim 19 wherein said at least one psychological cue is provided by occluding portions of said rendered three dimensional scene.

23. The system of claim 19 wherein said at least one psychological cue is provided by including forced perspective in said rendered three dimensional scene.

24. The system of claim 19 wherein said at least one psychological cue is provided by decreasing resolution in surface textures of more distant portions of said rendered three dimensional scene.

25. The system of claim 19 wherein said at least one psychological cue is provided by increasing haziness of more distant portions of said rendered three dimensional scene.

26. The system of claim 19 wherein said at least one psychological cue is a provided by shifting the color of more distant portions of said rendered three dimensional scene towards blue.

27. The system of claim 19 wherein said at least one psychological cue is added by reducing the brightness of more distant portions of said rendered three dimensional scene.

28. The system of claim 19 wherein said at least one psychological cue is provided by reducing the focus of more distant portions of said rendered three dimensional scene.

29. The system of claim 19 wherein said optical device includes a plurality of optical elements.

30. The system of claim 29 wherein said plurality of optical elements are arranged along a depth axis.

31. The system of claim 19 further including a floating image generator for projecting the first volumetric three dimensional image from the optical device to generate a second volumetric three dimensional image viewable as floating in space at a location outside of the optical device.

32. A method for generating a volumetric three dimensional images of a three dimensional scene, the method comprising the steps of:

(a) rendering said three dimensional scene so as to provide at least one psychological vision cue;

(b) generating image data corresponding to a set of two dimensional image slices through said three dimensional scene;

(c) providing said image data corresponding to said set of two dimensional slices of said three dimensional scene to an image projector; and

(d) selectively projecting each of said two dimensional slices from the image projector onto an optical device to generate a first volumetric three dimensional image, wherein said at least one psychological vision cue causes the apparent depth of said first volumetric three dimensional image to exceed the physical depth of said optical device.

33. The method of claim 32 wherein said at least one psychological cue is provided by adding shading during rendering of said three dimensional scene.

34. The method of claim 32 wherein said at least one psychological cue is provided by adding shadows during rendering of said three dimensional scene.

35. The method of claim 32 wherein said at least one psychological cue is provided by occluding portions of said scene during rendering of said three dimensional scene.

36. The method of claim 32 wherein said at least one psychological cue is provided by adding forced perspective during rendering of said three dimensional scene.

37. The method of claim 32 wherein said at least one psychological cue is provided during rendering by decreasing resolution in surface textures of more distant portions of said three dimensional scene.

38. The method of claim 32 wherein said at least one psychological cue is provided during rendering by increasing haziness of more distant portions of said three dimensional scene.

39. The method of claim 32 wherein said at least one psychological cue is a provided during rendering by shifting the color of more distant portions of said three dimensional scene towards blue.

40. The method of claim 32 wherein said at least one psychological cue is provided during rendering by reducing the brightness of more distant portions of said three dimensional scene.

41. The method of claim 32 wherein said at least one psychological cue is provided during rendering by reducing the focus of more distant portions of said three dimensional scene.

42. The method of claim 32 wherein said optical device includes a plurality of optical elements.

43. The method of claim 42 wherein said plurality of optical elements are arranged along a depth axis.

44. The method of claim 32 further including a floating image generator for projecting the first volumetric three dimensional image to generate a second volumetric three dimensional image viewable as floating in space at a location outside of the optical device.

45. A method for generating a volumetric three dimensional image using a multi-surface optical device comprising a plurality of optical elements, said method including the steps of:

(a) rendering a three dimensional scene having a depth axis;

(b) generating data corresponding to a set of two dimensional image slices at varying depths through said three dimensional scene, each of said two dimensional image slices being defined by a plurality of tridels each having a depth coordinate (z);

(c) mapping the depth coordinate z of each of said tridels into a corresponding depth coordinate z′

within said multi-surface optical device;

(d) mapping the depth coordinate z′

of each of said tridels to at least one voxel having a depth coordinate k corresponding to one of said plurality of optical elements;

(e) selectively projecting said voxels at said depth coordinate k onto a corresponding optical element to generate a first volumetric three dimensional image viewable in the multi-surface optical device.

46. The method of claim 45 further including the step of projecting the first volumetric three dimensional image to form a second volumetric three dimensional image viewable in a space outside of said multi-surface optical device.