Synthetic environment employing a craft for providing user perspective reference

• US 5,680,524 A
• Filed: 09/23/1996
• Issued: 10/21/1997
• Est. Priority Date: 04/21/1994
• Status: Expired due to Fees

• Current Assignee: Sandia Corporation (Martin Marietta Corporation)
• Original Assignee: Sandia Corporation (Martin Marietta Corporation)
• Inventors: Peterson, Craig A., Maples, Creve
• Primary Examiner(s): Zimmerman, Mark K.
• Application Number:
  US08/717,743
• Time in Patent Office: 393 Days
• Field of Search: 395/119, 395/121, 395/127, 395/135
• US Class Current: 345/427
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence

Abstract

A multi-dimensional user oriented synthetic environment system allows application programs to be programmed and accessed with input/output device independent, generic functional commands which are a distillation of the actual functions performed by any application program. A shared memory structure allows the translation of device specific commands to device independent, generic functional commands. Complete flexibility of the mapping of synthetic environment data to the user is thereby allowed. Accordingly, synthetic environment data may be provided to the user on parallel user information processing channels allowing the subcognitive mind to act as a filter, eliminating irrelevant information and allowing the processing of increase amounts of data by the user. The user is further provided with a craft surrounding the user within the synthetic environment, which craft, imparts important visual referential an motion parallax cues, enabling the user to better appreciate distances and directions within the synthetic environment. Display of this craft in close proximity to the user'"'"'s point of perspective may be accomplished without substantially degrading the image resolution of the displayed portions of the synthetic environment.

Claims

1. A method of aiding the user in apparent movement through an N-dimensional visual environment defined by N-dimensional data where N is greater than 2, in which a user may move apparent position and perspective comprising:

a) providing an N-dimensional visual environment defined by N-dimensional data in which a user may move apparent position and perspective substantially continuously in any desired direction;

b) displaying the N-dimensional visual environment including those features present in the environment from any selected user perspective, said step of displaying producing a perspective image of said environment;

c) moving the user perspective substantially continuously through the n-dimensional visual environment, when and as desired;

d) displaying a three dimensional craft having an identifiable front; and

e) locating the craft over the environment displayed from the desired user perspective so that the user'"'"'s viewpoint originates from within said craft so that the user can use said craft as a perspective reference;

said step c) of moving user perspective moving both viewpoint and user perspective independently of craft orientation so that user perspective is independent of craft orientation or travel direction.

2. The method of claim 1 further comprising;

f) imparting relative motion between said user'"'"'s viewpoint and said N-dimensional environment so that said user'"'"'s viewpoint travels along a travel path within said N-dimensional environment; and

g) aligning the craft so that the front of said craft extends along the travel path from said user'"'"'s viewpoint as said craft moves along the travel path while surrounding said user'"'"'s viewpoint.

3. The method of claim 2 further comprising;

h controlling the user perspective independent of movement of said craft along the travel path to thereby decouple the direction of travel of the viewpoint along the travel path from the user perspective.

4. The method of claim 3 wherein changes of user perspective produced by said step h) simulate head motion and, coupled with the corresponding apparent shifts in the position and direction of the craft and the features present in said environment provide motion parallax clues to the user to aid in a determination of distance and direction to the features in said environment.

5. The method of claim 3 wherein said step d) of displaying comprises configuring right and left sides of said craft as a plurality of converging lines which converge at the front of said craft and which, when said step h) controls the user perspective to be substantially transverse to said travel path, impart to the user information relating to the relative direction of the user perspective with respect to the travel path.

6. The method of claim 2 wherein said step f) is performed by using a user input device to manipulate the N-dimensional visual environment about said craft to transport the user'"'"'s viewpoint around said environment.

7. The method of claim 1 wherein said step d) of displaying a craft displays said craft in at least three dimensions.

8. A method of aiding the user in apparent movement through an N-dimensional visual environment defined by N-dimensional data where N is greater than 2 in which a user may move apparent position and perspective comprising:

a) providing an N-dimensional visual environment defined by N-dimensional data in which a user may move apparent position and perspective substantially continuously in any desired direction;

b) displaying a craft having at least three identifiable dimensions and an identifiable front superimposed on said N-dimensional visual environment;

c) locating the craft so that the user'"'"'s viewpoint originates from within said craft so that the user can use said craft as a perspective reference; and

d) controllably moving user perspective substantially continuously, as desired, through the N-dimensional visual environment from the user'"'"'s viewpoint independent of movement of said craft along the travel path to thereby decouple the direction of travel of the viewpoint along the travel path from the user perspective, said step d) of moving user perspective moving both viewpoint and user perspective independently of craft orientation so that user perspective is independent of craft orientation or travel direction.

9. In a system having a N-dimensional visual environment in which a user may move apparent position and perspective, a method of aiding the user in apparent movement through said environment comprising:

a) developing an environment video display frame of a selected view of the N-dimensional visual environment including those features present in the environment, said environment video display frame being derived from an environment viewing volume defined at least in part by a selected user viewpoint and a selected user perspective;

b) developing a craft video display frame of a three-dimensional image of a craft, said craft video display frame being derived from a craft viewing volume defined at least in part by the selected user viewpoint and the selected user perspective; and

c) overlaying said environment video display frame and said craft video display frame on a selected visual display to display both said craft and said selected view of the N-dimensional environment.

10. The method of claim 9 wherein said step c) of overlaying displays both said environment video display frame and said craft video display frame on the selected visual display without substantially degrading the image of said environment video display frame.

11. The method of claim 10 wherein said selected user perspective has a viewing axis and views the N-dimensional visual environment from the selected user viewpoint using a selected viewing angle, said step a) of developing including,

i) identifying the features of the environment within the viewing angle,

ii) defining environment least and greatest distance planes orthogonal to the viewing axis and closely bracketing the features identified in said step i),

iii) developing a shaped environment viewing volume defined by the least and greatest environment distance planes and the selected viewing angle as said environment viewing volume,

iv) projecting the shaped environment viewing volume along said viewing axis within said N-dimensional visual environment to define an environment viewing area, and

v) assembling a perspective image for display by overlaying plural sections of said environment viewing area taken transversely to said viewing axis over a single display image to produce a display image with apparent perspective as said environment video display frame.

12. The method of claim 11 wherein said selected user perspective has a viewing axis and views the N-dimensional visual environment from the selected user viewpoint using a selected viewing angle, said step b) of developing including,

i) defining craft least and greatest distance planes orthogonal to the viewing axis and closely bracketing the craft,

ii) developing a shaped craft viewing volume defined by the craft least and greatest distance planes and the selected viewing angle,

iii) projecting the craft shaped viewing volume along said viewing axis within said N-dimensional visual environment to define a craft viewing area, and

iv) assembling a perspective image for display by overlaying plural sections of said viewing craft area taken transversely to said viewing axis over a single display image to produce a display image of said craft with apparent perspective as said craft video display frame.

13. The method of claim 12 wherein said shaped environment viewing volume and shaped craft viewing volume are each a frusto-pyramidal volumes defined by the selected user viewpoint as the apex of the pyramid, the selected viewing angle defining the sides of the pyramid, and the least and greatest distance planes defining the frustum and base of the frusto-pyramidal volume.

14. The method of claim 9 wherein said craft has an identifiable front.

15. The method of claim 9 wherein said craft viewing volume does not fall within said environment viewing volume.

16. The method of claim 15 wherein said craft displayed from said craft video display frame provides the user an apparent inertial frame of reference.

17. The method of claim 16 wherein said craft video display frame does not substantially occlude significant portions of the environmental features within said environment video display frame.

18. The method of claim 9 wherein said craft video display frame does not substantially occlude significant portions of the environmental features within said environment video display frame.