Three-dimensional computer image variable perspective display system

• US 5,367,614 A
• Filed: 04/01/1992
• Issued: 11/22/1994
• Est. Priority Date: 04/01/1992
• Status: Expired due to Fees

• Current Assignee: Grumman Aerospace Corporation (Northrop Grumman Corporation)
• Original Assignee: Grumman Aerospace Corporation (Northrop Grumman Corporation)
• Inventors: Bisey, Robert P.
• Primary Examiner(s): RICHARDSON, ROBERT
• Application Number:
  US07/861,479
• Time in Patent Office: 965 Days
• Field of Search: 359/479, 395/119, 395/155, 395/162, 367/140, 367/129, 434/44, 364/578
• US Class Current: 345/419
• CPC Class Codes: G01S 5/186 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G01S 5/22 Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements G01S5/28 takes precedence

Abstract

A three-dimensional computer image variable perspective display system provides for the real-time perspective control of a three-dimensional computer generated image controlled by the head movements of a computer operator viewing the image. The system includes an ultrasonic transmitter module worn on the head of the computer operator, a set of ultrasonic receivers mounted on or near the computer display monitor, and a computer interface unit. The ultrasonic transmitter transmits sound waves towards the display monitor which are detected by the ultrasonic receivers and processed by the computer interface unit. The computer interface unit calculates the elapsed times between the transmission and reception of the sound waves and converts this information into digital data words. The quantative magnitude of these data words represent in direct proportion, the instantaneous distance between the ultrasonic transmitter and the ultrasonic receivers. This distance information interacts with rotational axis algorithms used to control the three-dimensional display to cause the image to change it'"'"'s perspective view in correspondence to the movement of the computer operator'"'"'s head, in a manner exactly analogous to viewing three-dimensional objects in nature.

Claims

1. Apparatus for controlling the perspective view of computer generated graphical images in proportion to the head movements of a computer operator viewing the images on a computer monitor, comprising:

only a single transmitter, mounted relative to the computer operator'"'"'s head for movement therewith for transmitting ultrasonic signals of a given frequency and at predetermined intervals;

a plurality of individual ultrasonic receivers, mounted relative to said computer monitor and being arranged in a geometrical pattern surrounding said computer monitor, for receiving the ultrasonic signals from said transmitting means; and

measuring means, connected to each of said plurality of individual ultrasonic receivers, for converting said signals received by each of said plurality of individual ultrasonic receivers into a plurality of data signals representative of the instantaneous distance between the computer operator'"'"'s head and said computer monitor.

2. The apparatus of claim 1, further comprising processing means, receiving said plurality of data signals, for altering the perspective view of said graphical image displayed on said computer monitor based upon the instantaneous distance between the computer operator and said computer monitor.

3. The apparatus of claim 2, wherein said transmitting means comprises a miniaturized audio frequency ultrasonic transmitter module mounted on a headband worn by the computer operator and positioned to direct radiated ultrasonic acoustic energy directly towards said computer monitor.

4. The apparatus of claim 2, wherein said plurality of individual ultrasonic receivers comprise three audio frequency ultrasonic microphones arranged in a triangular configuration surrounding said computer monitor.

5. The apparatus of claim 4, wherein said measuring means comprises three channels, one for each of said three audio frequency ultrasonic microphones, wherein each of said three channels comprises identical hardware comprising an analog section and a digital section, said analog section including signal conditioning means and means for converting an analog signal from its associated ultrasonic microphone into a pulse suitable for digital processing, and said digital section including means for converting said pulse into a binary word representative of the instantaneous distance along one axis in a three-dimensional coordinate system between the computer operator'"'"'s head and said computer monitor, each of said three channels corresponding to a different axis in the three-dimensional coordinate system.

6. The apparatus of claim 5, wherein said measuring means further comprises an ultrasonic audio oscillator/amplifier for generating said ultrasonic signals of a given frequency and at predetermined intervals for transmission by said transmitting means.

7. The apparatus of claim 6, wherein said measuring means further comprises a control means for controlling the operation of said measuring means and ensuring a correct sequential transfer of said binary words to said processing means.

8. The apparatus of claim 7, wherein said processing means receives said binary words and reconstructs the instantaneous position of the computer operator'"'"'s head relative to said computer monitor in three-dimensional space, said processing means having means for converting said instantaneous position into signals which interact with the X, Y, and Z rotational axis algorithms of the graphics software resident in the computer to alter the perspective view of said graphical image.

9. Apparatus for controlling the perspective view of computer generated, three-dimensional graphic images in direct proportion to the head movements of a computer operator viewing the images on a computer monitor, comprising:

only a single transmitter, mounted relative to the computer operator'"'"'s head for movement therewith, for transmitting bursts of ultrasonic audio signals of a given frequency and at predetermined intervals;

three individual ultrasonic receivers, mounted relative to said computer monitor and being arranged in a triangular configuration surrounding said computer monitor, for receiving the ultrasonic audio signals from said transmitting means;

measuring means, connected to said three individual ultrasonic receivers, for measuring the elapsed times between the transmission of the bursts of ultrasonic audio signals and the receipt of the bursts of ultrasonic audio signals by each of said three individual ultrasonic receivers, wherein the elapsed times are dependent upon the orientation of the computer operator'"'"'s head relative to said computer monitor and represent in direct proportion, the instantaneous distance between the computer operator'"'"'s head and said computer monitor, said measuring means having means for generating three data signals corresponding to said instantaneous distance in a three-dimensional coordinate system; and

processing means, interfaced with said measuring means for receiving said three data signals, for updating the perspective view of said computer generated, three-dimensional graphic images in direct correspondence to the movement of the computer operator'"'"'s head based upon the three data signals.

10. The apparatus of claim 9, wherein said transmitting means comprises a miniaturized audio frequency ultrasonic transmitter module mounted on a headband worn by said computer operator, and positioned to direct its radiated ultrasonic acoustic energy directly towards said computer monitor.

11. The apparatus of claim 10, wherein said ultrasonic transmitter module is connected to said measuring means by a two-conductor transmitter signal wire which carries said ultrasonic audio signals for transmission to said ultrasonic transmitter module.

12. The apparatus of claim 10, wherein said ultrasonic transmitter module further includes a miniature, battery operated radio frequency receiver for receiving radio frequency triggering signals which cause said ultrasonic transmitter module to transmit ultrasonic audio signals.

13. The apparatus of claim 10, wherein said ultrasonic transmitter module further includes an infrared receiver for receiving infrared triggering signals which cause said ultrasonic transmitter module to transmit ultrasonic audio signals.

14. The apparatus of claim 9, wherein said three individual ultrasonic receivers comprise three audio frequency ultrasonic microphones having their sensitive receiving axis directed towards-the computer operator'"'"'s head.

15. The apparatus of claim 14, wherein said three audio frequency ultrasonic microphones are mounted on a front bezel of said computer monitor.

16. The apparatus of claim 9, wherein said three audio frequency ultrasonic microphones are mounted on a frame which surrounds said computer monitor.

17. The apparatus of claim 9, wherein the computer includes a graphics computer mouse input or a joystick game port input, and the apparatus comprises a computer interface unit which includes said measuring means, and said measuring means comprises three channels, one for each of said three audio frequency ultrasonic microphones, wherein each channel converts an analog signal from its associated ultrasonic microphone into a train of bytes for digital processing, and the computer interface unit further includes a processor which is connected directly to the graphics computer mouse input or the joystick game port input, thus replacing the mouse or joystick device, and the processor processes the trains of bytes internally and converts the information in the trains of bytes directly into contact closure and/or pulse train signals which exactly imitate the kind of signals generated by a mouse or joystick device, such that the computer interface unit is an intelligent unit which eliminates the need for ancillary software.

18. The apparatus of claim 14, wherein said measuring means comprises three channels, one for each of said three audio frequency ultrasonic microphones, wherein each of said three channels comprises identical hardware comprising of an analog section and a digital section, said analog section including a signal conditioning means, and means for converting an analog signal from its associated ultrasonic microphone into a pulse suitable for digital processing, and said digital section including means for converting said pulse into one of said three data signals which is a binary word representative of the instantaneous distance along one axis in a three-dimensional coordinate system between the computer operator'"'"'s head and said computer monitor, each of said three channels corresponding to a different axis in the three-dimensional coordinate system.

19. The apparatus of claim 18, wherein said measuring means further comprises an ultrasonic audio oscillator/amplifier for generating said ultrasonic audio signals of a given frequency and at predetermined intervals for transmission by said transmitting means.

20. The apparatus of claim 19, wherein said measuring means further comprises a control means for controlling the operation of said measuring means and ensuring the correct sequential transfer of said binary words to said processing means.

21. The apparatus of claim 18, wherein said signal conditioning means comprises:

active operational amplifier filters tuned to the ultrasonic frequency transmitted by said transmitter means, for minimizing the effect of spurious low frequency ambient noise by filtering said analog signal from one of said three ultrasonic microphones; and

automatic gain control/threshold detection circuitry for transforming the analog signal output from said filters into noise free trigger pulses.

22. The apparatus of claim 21, wherein said means for converting an analog signal comprises a monostable multivibrator for receiving said noise free trigger pulse and outputting a rectangular pulse of fixed duration for processing by said digital section.

23. The apparatus of claim 22, wherein said means for converting an analog signal comprises:

gating means, responsive to said rectangular pulse, comprising an S-R flip-flop and a two input logic AND gate, the present state output of said S-R flip-flop is input to one input of said two input logic AND gate while the second input is a continuous clock signal, said gating means outputting a logic 1 level signal until receipt of said rectangular pulse upon which said gating means outputs a logic o level signal;

binary counting means, responsive to said gating means, being initialized by a control signal from said control means and continuing counting until said gating means outputs a logic o level signal, and upon receipt of a logic o level signal, said binary counting means temporarily storing the binary count as a final binary count; and

data latch means for storing the final binary count contained in said binary counting means upon a STORE-FOLLOW pulse from said control means and for serially shifting said binary count into a shift register for storage of said final binary count.

24. The apparatus of claim 23, wherein said processing means receives the binary words and reconstructs the instantaneous position of the computer operator'"'"'s head relative to said computer monitor in a three-dimensional coordinate system, said processing means having means for converting said instantaneous position into signals which interact with X, Y, and Z rotational axis algorithms of the graphics software resident in the computer to alter the perspective view of said graphical image.

25. The apparatus of claim 24, wherein said processing means comprises a preprogrammed microprocessor for converting said final binary count from each of said three channels, which are time based signals, into X, Y and Z distance signals utilizing an algorithm which multiplies the known velocity of sound by the final binary count, said microprocessor having an input/output port for connecting said processing means to said graphics computer.

26. A method for controlling the perspective view of computer generated graphical images in proportion to the head movement of a computer operator viewing the image on a computer monitor, said method comprising the steps of:

(a) transmitting ultrasonic signals of a given frequency and at predetermined intervals from only a single transmitter at a position in close proximity to said computer operator'"'"'s head towards said computer monitor;

(b) measuring the elapsed times between the transmission of said ultrasonic signals and the receipt of said ultrasonic signals by a plurality of ultrasonic receivers mounted in close proximity to said computer monitor;

(c) converting the received signals into a plurality of data words representative of the instantaneous distance between said computer operator'"'"'s head and said computer monitor; and

(d) processing said data words and altering the perspective view of said graphical image displayed on said computer monitor based upon the instantaneous distance between the computer operator and said computer monitor.

27. The method of claim 26, wherein said step of transmitting ultrasonic signals comprises radiating ultrasonic acoustic energy directly towards said computer monitor.

28. The method of claim 27, wherein said step of measuring the elapsed times comprises detecting said transmitted signal, filtering out background noise, and converting the received signals into pulses for digital processing.

29. The method according to claim 28, wherein said step of converting comprises generating a binary count representative of the elapsed times in response to said pulses and shifting said binary count into a processing means for conversion of said binary counts into signals which interact with the X, Y, and Z rotational axis algorithms of graphics software resident in the computer to alter the perspective view of said graphical image.

30. The method of claim 26, wherein said step of processing comprises converting time based measurements into three-dimensional distances for interaction with the X, Y and Z rotational algorithms.