Method of using multiple perceptual channels to increase user absorption of an N-dimensional presentation environment

• US 5,914,720 A
• Filed: 09/23/1996
• Issued: 06/22/1999
• Est. Priority Date: 04/21/1994
• Status: Expired due to Fees

• Current Assignee: The United States of America As Represented By The Secretary of Agriculture, United States Department Of Health And Human Services
• Original Assignee: Sandia Corporation (Martin Marietta Corporation)
• Inventors: Peterson, Craig A., Maples, Creve
• Primary Examiner(s): Zimmerman, Mark K.
• Application Number:
  US08/717,742
• Time in Patent Office: 1,002 Days
• Field of Search: 395/153, 395/154, 395/155, 395/157, 395/806, 395/807, 395/119, 395/978, 345/302, 345/419, 345/427, 345/978, 345/156
• US Class Current: 345/419
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: Y10S 715/978 Audio interaction as part of an operator interface

Abstract

A multi-dimensional user oriented synthetic environment system allows application programs to be programmed and accessed with input/output device independent, generic functional commands which are a distillation of the actual functions performed by any application program. A shared memory structure allows the translation of device specific commands to device independent, generic functional commands. Complete flexibility of the mapping of synthetic environment data to the user is thereby allowed. Accordingly, synthetic environment data may be provided to the user on parallel user information processing channels allowing the subcognitive mind to act as a filter, eliminating irrelevant information and allowing the processing of increase amounts of data by the user. The user is further provided with a craft surrounding the user within the synthetic environment, which craft, imparts important visual referential an motion parallax cues, enabling the user to better appreciate distances and directions within the synthetic environment. Display of this craft in close proximity to the user'"'"'s point of perspective may be accomplished without substantially degrading the image resolution of the displayed portions of the synthetic environment.

Claims

1. A method of examining and manipulating any data of three or more dimensions using a synthetic environment data accessing program surrounding and interfacing with said data comprising:

a) providing a user with desired input/output devices producing input device commands and responding to output device commands;

b) a user manipulating said input devices to generate input device commands;

c) translating the input device commands into device independent input commands independent of device characteristic or type for enabling/disabling functionality within said synthetic environment data accessing program or said data;

d) the user navigating through said data or manipulating portions of said data using said device independent input commands;

e) at least one of said data and said synthetic environment data accessing program developing device independent output commands independent of device characteristic or type including data perception output commands intended to supply the user with information about said data;

f) said synthetic environment data accessing program translating said device independent output commands into output device commands;

g) said output devices responding to said output device commands and supplying the user with a user perceivable representation of said data;

said user, by supplying input device commands, navigating through said data, exploring said data and manipulating said data as desired independent of said data or input/output device type to thereby improve user understanding of said data;

wherein said data may include one or more application programs.

2. The method of claim 1 wherein said output devices are selected from the group consisting of visual displays, sound generators, and force or tactile feedback devices.

3. The method of claim 1 wherein said data is multi-variant data.

4. The method of claim 1, wherein said data models a physical system.

5. The method of claim 1, wherein said synthetic environment data accessing program includes a shared memory for storing said device independent input and output commands.

6. The method of claim 1, wherein said output commands include output commands representative of image data for display to the user.

7. The method of claim 1, wherein said synthetic environment data accessing program maps the device independent input and output commands to desired input device commands and output device commands so that said steps c) and f) of translating may be easily adapted to available input/output devices.

8. The method of claim 7, wherein said synthetic environment data accessing program maps the device independent output commands to output commands associated with desired output devices intended to communicate to plural user senses.

9. The method of claim 1, wherein said output devices include a visual display, said method further comprising overlying synthetic environment data accessing program generated perceptual information over the data generated perceptual information to enhance the understanding of said data.

10. The method of claim 9, wherein the synthetic environment data accessing program generated perceptual information includes adding a craft into the viewed scene.

11. The method of claim 10, wherein said method includes the step of storing and accessing one or more library programs which are independent of said data and supplied through the synthetic environment data accessing program.

12. The method of claim 11, wherein said library programs include correlation filters and transformations.

13. The method of claim 11, wherein said synthetic environment data accessing program generated perceptual data includes a visual image of a craft positioned around the user perspective of the data.

14. The method of claim 13, wherein said library programs include a tether program which couples the craft to a selected object within said data so that said craft moves with said object.

15. The method of claim 13, wherein said craft has walls on which additional data may be displayed.

16. A synthetic environment data accessing system including a synthetic environment data accessing program surrounding and interfacing with data of three or more dimensions for enabling the examination and manipulation of said data comprising:

input/output devices producing input device commands and responding to output device commands;

an input device handler translating the input device commands into device independent input commands independent of device characteristic or type for enabling/disabling functionality within said synthetic environment data accessing program or said data;

a shared memory storing said device independent input commands;

at least one of said data and said synthetic environment data accessing program developing device independent output commands independent of device characteristic or type including data perception output commands intended to supply the user with information about said data and supplying said device independent output commands to said shared memory;

an output device handler translating said device independent output commands stored in said shared memory into output device commands, said output devices responding to said output device commands and supplying the user with a user perceivable representation of said data;

said user, by supplying input device commands, navigating through said data, exploring said data and manipulating said data as desired independent of said data or input/output device type to thereby improve user understanding of said data;

wherein said data may include one or more application programs.

17. The synthetic environment data accessing system of claim 16, wherein said data is multi-variant data.

18. The synthetic environment data accessing system of claim 16 wherein said data models a physical system.

19. The synthetic environment data accessing system of claim 16, wherein said synthetic environment data accessing program maps the device independent output commands to output commands associated to desired output devices intended to communicate with different user senses.

20. The synthetic environment data accessing system of claim 16, wherein said output devices include a visual display, said system further comprising overlying synthetic environment data accessing program generated perceptual information over the data generated perceptual information to enhance the understanding of said data.

21. The synthetic environment data accessing system of claim 16, wherein the synthetic environment data accessing program adds a craft into the viewed scene.

22. The synthetic environment data accessing system of claim 21, further comprising one or more library programs which are independent of said data and supplied through the synthetic environment data accessing program.

23. The synthetic environment data accessing system of claim 22, wherein said library programs include correlation filters and transformations.

24. The synthetic environment data accessing system of claim 23, wherein said synthetic environment data accessing program generated perceptual data includes a visual image of a craft positioned around the user perspective of the data.

25. The synthetic environment data accessing system of claim 24, wherein said library programs include a tether program which couples the craft to a selected object within said data so that said craft moves with said object.

26. The synthetic environment data accessing system of claim 16, wherein said output devices are selected from the group consisting of visual displays, sound generators, and force or tactile feedback devices.