Helmet mounted display adaptive predictive tracking

• US 5,138,555 A
• Filed: 06/28/1990
• Issued: 08/11/1992
• Est. Priority Date: 06/28/1990
• Status: Expired due to Fees

• Current Assignee: Robert E. Albrecht
• Original Assignee: Robert E. Albrecht
• Inventors: Albrecht, Robert E.
• Primary Examiner(s): Black, Thomas G.
• Application Number:
  US07/546,275
• Time in Patent Office: 775 Days
• Field of Search: 364/424.06, 364/424.01, 364/514, 340/705, 340/980
• US Class Current: 701/14
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09B 9/307 by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01

Abstract

A system for predicting head movements by an aircrew member, such as a pilot flying a tactical aircraft, from input data which includes an ongoing record of head positions. The input is without head acceleration or velocity input data and is applied to a Least Mean Square prediction algorithm. The disclosure also includes an improved data dependent convergence algorithm for the prediction system, an algorithm shown to provide rapid convergence to the final prediction output. Use of the prediction system to make the delay between actually viewed and HMD presented images and other flight video images acceptable from a human engineering and disoriented pilot avoidance viewpoint is also disclosed. A computer program embodiment of the system using head movement data is included.

Claims

1. The method for supplementing the surrounding terrain visual information available to an air crew member comprising the steps of:

sensing the features of said surrounding terrain with an electrical output signal generating directionally receptive energy transducer;

presenting said output signal of said energy transducer as a visual image on a crew member disposed helmet mounted display;

slaving said energy transducer receptive direction to said air crew member generated movements of said helmet;

learning a pattern of helmet movements accomplished by said air crew member over a first predetermined past time interval ending with a present time instant;

estimating from said learned pattern of past helmet movements, and a newly commenced movement, the movement expected in said commenced movement during a future period beginning with said present time instant and extending over a second predetermined time interval;

generating from said estimating a future position electrical signal; and

reducing the time delay between direct vision perceived surrounding terrain features and helmet mounted display representations of said features by commending looking direction change of said directionally receptive energy transducer in response to said future position electrical signals.

2. The method of claim 1 wherein said directionally receptive energy transducer is a sensor taken from the group consisting of a radar sensor, an infrared sensor and a visual light sensor.

3. The method of claim 1 wherein said slaving step includes sensing the position of said helmet.

4. The method of claim 3 wherein said position sensing includes generating magnetic field dependent electrical position indicating signals.

5. The method of claim 3 wherein said position sensing includes generating azimuth and elevation signals.

6. The method of claim 1 wherein said future second predetermined time interval is limited to one hundred milliseconds.

7. The method of claim 6 wherein said future second predetermined time interval is limited to fifty milliseconds.

8. The method of claim 1 wherein said direct vision to helmet mounted display delay is limited to fifty milliseconds.

9. The method of claim 1 wherein said learning and estimating steps include an iterative sequence of output signals each successively reduced in error with respect to estimated actual head movements.

10. The method of claim 9 wherein said iterative sequence comprises a least mean square adaptive algorithm.

11. The method for using and estimating and using the near future looking direction of a helmet equipped aircraft crew member from successive previous helmet position signals comprising the steps of:

generating from a current helmet position signal and an adaptive linear combiner, having a first parameter set conditioned least mean square algorithm, a first estimate of said current helmet position signal;

subtracting said first estimate signal from said current helmet position signal to obtain a first estimated helmet position to actual helmet position combiner error signal;

developing from said combiner error signal a new second parameter set for conditioning said adaptive linear combiner least mean square algorithm, said new parameter set having reduced combiner error signal generating capability with respect to said first parameter set;

repeating said generating, subtracting, and developing steps with said second parameter set conditioning said combiner, and with each succeeding new parameter set conditioning said combiner, in an iterative sequence until said error signal conforms with a predetermined criteria therefor;

computing with the final parameter set and a selected one of said current helmet position signal and a previous helmet position signal, an estimated future look direction signal for said crewmember helmet; and

moving a helmet position controlled member in anticipating response to said estimated future look direction signal.

12. The method of claim 11 wherein said least mean square adaptive linear combiner includes a data dependent convergence factor algorithm.

13. The method of claim 12 wherein said convergence factor algorithm has the mathematical form of:

##EQU7##

14. The method of claim 13 wherein said constant μ

₀ has a value of 1×

10^-5, and said constant N has a value of 10.

15. An aircraft crewmember helmet mounted display comprising the combination of:

means including a crewmember helmet mounted electrical video signal to optical transducer device and optical elements coupled therewith for generating a visual image viewable by said crewmember and movable in fixed relationship with crewmember eyes during movement of said helmet;

means coupled to said electrical video signal to optical transducer device for generating flight video electrical signals;

means for changing said flight video electrical signals and a resulting visual image therefrom in response to helmet position signals representing positioning of said helmet by said crewmember; and

means including a crewmember head position responsive first iterative learning mathematical algorithm and a second data dependent convergence factor iterative mathematical algorithm operative on said helmet position signals for initiating changes in said flight video signals prior to attainment of a corresponding crewmember and helmet viewing position therefor.

16. The apparatus of claim 15 wherein said means for changing includes magnetic field coupled means for generating said helmet position signals.

17. The apparatus of claim 15 wherein said first iterative mathematical algorithm comprises a least mean square algorithm.

18. The method for reducing time delay between aircraft crewmember head movements and head position determined flight video images presented on a helmet mounted display of said crewmember comprising the steps of:

sensing a sequence of successive head positions used by said crewmember during a past time interval up to a present time instant;

conditioning weight vector coefficients in a learning prediction algorithm to successive of said past time interval head positions, said conditioning including minimizing a current position difference error, between head positions predicted by said learning prediction algorithm and currently sensed head positions, over a series of successive predictions during said sequence of past successive head positions; and

reducing time delay between a future time instant attained new head position and presentation of a corresponding helmet mounted display flight video image by commencing formation of said new head position related flight video image prematurely and in response to a prediction of said new head position by said conditioned learning prediction algorithm.

19. The method of claim 18 wherein said learning prediction algorithm includes a data dependent convergence factor.

20. The method of claim 18 wherein said commencing formation of said new head position related flight video image begins in response to initiation of head movement toward said new head position.

21. The method of claim 18 wherein said learning prediction algorithm is a least-mean-square algorithm.