Helicopter virtual image display system incorporating structural outlines

• US 5,296,854 A
• Filed: 10/13/1992
• Issued: 03/22/1994
• Est. Priority Date: 04/22/1991
• Status: Expired due to Term

• Current Assignee: United Technologies Corporation (Rtx Corporation)
• Original Assignee: United Technologies Corporation (Rtx Corporation)
• Inventors: Harper, Howard P., Hamilton, Bruce E., Stiles, Lorren
• Primary Examiner(s): Swarthout, Brent
• Application Number:
  US07/960,567
• Time in Patent Office: 525 Days
• Field of Search: 340/980, 340/705, 340/461, 340/971, 340/974, 340/975, 340/946, 340/973, 359/630, 362/62, 362/80.1, 73/178 H, 244/17.11
• US Class Current: 340/980
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G09B 9/302 the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view
• CPC Class Codes: G09B 9/307 by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01
• CPC Class Codes: G09B 9/46 the aircraft being a helicopter

Abstract

A virtual image display system provides video displays based upon virtual images of the external world having synchronized structural outlines superimposed on the video displays to a pilot operating an aircraft such as a helicopter in non-visual flight conditions. The virtual image display system includes a virtual imaging subsystem for generating virtual images of the external world, a video display subsystem for generating video images based upon the virtual images and for displaying the video images for the pilot'"'"'s viewing, a sensing means for providing signals corresponding to the spatial location and perspective of the video display subsystem, a map comprising structural outlines corresponding to structural members forming the canopy structure of the helicopter, and a computer subsystem providing electronic interfacing between the elements of the virtual image display system, for synchronizing the orientation of the virtual imaging subsystem with the video display subsystem, and for processing the virtual image signals to provide signals to the video display subsystem to generate video displays. The computer utilizes the helmet position signals to define the relative position and orientation of the video display subsystem in the cockpit, and utilizes such definition to reconstruct structural outlines from the map that are synchronized to the perspective of the video images. The synchronized structural images are superimposed upon the video display.

Claims

1. A virtual image display system for use by a pilot in an aircraft having a canopy structure of predetermined configuration, comprising:

virtual imaging means for generating virtual images of the external world;

video display means for generating and displaying video images based upon said virtual images of the external world for viewing by the pilot.

sensing means disposed in interactive relation with said video display means for generating position signals corresponding to the spatial location and perspective of said video display means;

map means for storing structural outlines corresponding to the predetermined configuration of the canopy structure; and

computer processing means for defining the spatial location and perspective of said video display means based upon said position signals generated by said sensing means;

said computer processing means being further operative for reconstructing structural outlines of segments of the canopy structure from said stored structural outlines of said map means, said reconstructed structural outline segments being based upon and synchronized with said defined spatial location and perspective of said video display means;

said computer processing means being further operative to superimpose said reconstructed structural outline segments onto said displayed video images to provide the pilot with a high-definition pictorial representation of the external world wherein said superimposed, reconstructed structural outline segments occlude corresponding segments of said displayed video images such that said superimposed, reconstructed structural outline segments provide the pilot with a referential framework during viewing of said occluded displayed video images.

2. The virtual image display system of claim 1 where said computer processing means is further operative, in response to said position signals generated by said sensing means, to generate control signals to synchronize said virtual imaging means to said defined spatial location and perspective of said video display means.

3. The virtual image display system of claim 1 wherein said stored structural outlines of said map means are in digitized form.

4. The virtual image display system of claim 3 wherein said computer processing means is operative to interpolate between adjacent digital points of said stored digitalized structural outlines wherein said reconstructed structural outline segments are provided as continuous images.

5. The virtual image display system of claim 1 wherein the canopy structure is formed from structural posts and rails and wherein said stored structural outline segments correspond to the structural posts and rails forming the canopy structure.

6. The virtual image display system of claim 5 wherein said reconstructed structural outline segments comprise segments of the structural posts and rails based upon and synchronized with said defined spatial location and perspective of said video display means.

7. The virtual image display system of claim 1 wherein said computer processing means includes a memory structure, and wherein said map means is said memory structure.

8. The virtual image display system of claim 1 wherein said virtual imaging means is a forward looking infrared imaging subsystem.

9. The virtual image display system of claim 1 wherein said virtual imaging means is a low-light television subsystem.

10. The virtual image display system of claim 1 wherein said virtual imaging means is a radar subsystem.

11. The virtual image display system of claim 1 wherein said video display system is a helmet mounted display subsystem.

12. The virtual image display system of claim 1 wherein said sensing means is a three-axis Polhemus system.

13. A virtual image display system for use by a pilot in an aircraft having a canopy structure including a plurality of posts and rails, comprising:

a forward looking infrared imaging subsystem for generating virtual image signals corresponding to the external world within the field of view thereof;

a helmet mounted display subsystem worn by the pilot;

sensing means disposed in interactive relation with said helmet mounted display system for generating position signals corresponding to the spatial location and perspective of said helmet mounted display system with respect to the plurality of posts and rails forming the canopy structure; and

computer processing means being operative in response to said position signals for defining the spatial location and perspective of said helmet mounted display subsystem worn by the pilot;

said computer processing means being further operative to process said virtual image signals to provide corresponding signals to said helmet mounted display subsystem to generate and display video images for viewing by the pilot, said displayed video images being based upon and synchronized with said defined spatial location and perspective of said helmet mounted display subsystem;

said computer processing means including a memory structure having stored therein a digitized map defining an interrelated series of structural outlines corresponding to the plurality of posts and rails forming the canopy structure;

said computer processing means being further operative to reconstruct structural outlines of segments of the plurality of posts and rails from said digitized map based upon and synchronized in perspective with said defined spatial location and perspective of said helmet mounted display subsystem;

said computer processing means being further operative to superimpose said reconstructed structural outline segments onto said displayed video images viewed by the pilot such that said reconstructed structural outline segments occlude corresponding portions of said displayed video images, said superimposed reconstructed structural outline segments providing the pilot with a referential framework during view of said occluded displayed video images.

14. The virtual image display system of claim 13 wherein said computer processing means is operative to interpolate between adjacent digital points of said stored digitalized structural outlines wherein said reconstructed structural outline segments are provided as continuous images.

15. The virtual image display system of claim 13 wherein said computer processing means is further operative, in response to said position signals generated by said sensing means, to generate control signals to synchronize the field of view of said forward looking infrared imaging subsystem to align with said defined spatial location and perspective of said helmet mounted display subsystem.