Gaze-actuated information system

• US 6,667,694 B2
• Filed: 09/27/2001
• Issued: 12/23/2003
• Est. Priority Date: 10/03/2000
• Status: Expired due to Fees

• Current Assignee: Rafael - Armament Development Authority Ltd.
• Original Assignee: Rafael - Armament Development Authority Ltd.
• Inventors: Ben-Ari, Tsafrir, Ben-Horin, Ronen
• Primary Examiner(s): SWARTHOUT, BRENT
• Application Number:
  US09/963,443
• Publication Number:
  US 20020039073A1
• Time in Patent Office: 817 Days
• Field of Search: 340/980, 340/945, 340/963, 340/961, 345/8, 345/7, 345/9, 359/630, 359/633, 359/634, 702/150, 702/85, 702/92, 235/411, 89/412.2, 89/410.6
• US Class Current: 340/980
• CPC Class Codes: F41G 3/225 Helmet sighting systems

Abstract

A method for providing a pilot with information associated with at least one region of a field of view visible to the pilot from within a cockpit without requiring a visual display. The method includes the steps of determining an eye gaze direction relative to a given frame of reference for at least one eye of the pilot, determining a reference direction relative to the given frame of reference, comparing the eye gaze direction with the reference direction, and if the eye gaze direction and the reference direction are equal to within a given degree of accuracy, generating audio output audible to the pilot and indicative of information associated with the reference direction.

Claims

1. A method for providing a pilot with information associated with at least one region of a field of view visible to the pilot from within a cockpit without requiring a visual display, the method comprising the steps of:

(i) determining an eye gaze direction relative to a given frame of reference for at least one eye of the pilot by;

(a) employing a helmet-mounted system to derive direction information related to a relative eye gaze direction for at least one eye of the pilot relative to a helmet worn by the pilot,

(b) deriving position information related to a position of said helmet within a cockpit, and

(c) processing said direction information and said position information to derive said eye gaze direction relative to a frame of reference associate with said cockpit;

(ii) determining a reference direction relative to said given frame of reference;

(iii) comparing said eye gaze direction with said reference direction; and

(iv) if said eye gaze direction and said reference direction are equal to within a given degree of accuracy, generating audio output audible to the pilot and indicative of information associated with said reference direction.

2. The method of claim 1, wherein said reference direction corresponds to a direction from a weapon system to a target to which the weapon system is locked-on, such that said audio output provides confirmation that the weapon system is locked-on to a target at which the pilot is currently gazing.

3. The method of claim 1, wherein said reference direction corresponds to a direction from the cockpit to a friendly aircraft, such that said audio output provides an indication that an aircraft at which the pilot is currently gazing is friendly.

4. The method of claim 1, wherein said reference direction corresponds to a direction from the cockpit to a hostile aircraft, such that said audio output provides an indication that an aircraft at which the pilot is currently gazing is hostile.

5. The method of claim 1, wherein said reference direction corresponds to a direction from the cockpit to a landmark, such that said audio output provides information relating to the landmark at which the pilot is currently gazing.

6. The method of claim 1, wherein said given degree of accuracy corresponds to a maximum allowed angular discrepancy between said eye gaze direction and said reference direction, said maximum allowed discrepancy having a value of less than 50°

.

7. The method of claim 1, wherein said given degree of accuracy corresponds to a maximum allowed angular discrepancy between said eye gaze direction and said reference direction, said maximum allowed discrepancy having a value of less than 2°

.

8. The method of claim 1, wherein said determining an eye gaze direction includes transmitting said direction information from said helmet mounted system to a receiver unit via a cordless communications link.

9. The method of claim 8, wherein said helmet-mounted system and a helmet-mounted portion of said cordless communications link are implemented using low-power electrical components powered exclusively by at least one helmet-mounted battery.

10. A gaze-actuated information system for providing a pilot with information associated with at least one region of a field of view visible to the pilot from within a cockpit without requiring a visual display, the system comprising:

(i) a gaze-direction determining system deployed within the cockpit and configured to determine a current gaze direction of the pilot relative to the cockpit said gaze-direction determining system including;

(a) a helmet-mounted system configured to derive relative direction information related to a relative eye gaze direction for at least one eye of the pilot relative to a helmet worn by the pilot, and

(b) a helmet positioning system configured to derive position information related to a position of said helmet within the cockpit

(ii) a direction correlation system associated with said gaze-direction determining system and configured to compare said current gaze direction with at least one reference direction and to generate a correlation signal when said current gaze direction is equal to said reference direction within a predefined margin of error; and

(iii) an audio output system associated with said direction correlation system and configured to be responsive to said correlation signal to generate audio output audible to the pilot and indicative of information related to said reference direction.

11. The gaze-actuated information system of claim 10, further comprising a weapon system including a seeker operative to track a target, said weapon system generating a current target direction corresponding to the direction from the seeker to the target being tracked, said direction correlation system being associated with said weapon system and configured to employ said current target direction as one of said reference directions such that, when the pilot looks towards the target, said audio output system generates audio output indicative that the currently viewed target is being tracked.

12. The gaze-actuated information system of claim 10, wherein said gaze-direction determining system further includes a transmitter deployed for transmitting a wireless signal containing information from said helmet-mounted system.

13. The gaze-actuated information system of claim 12, wherein said helmet-mounted system and said transmitter are implemented using low-power electrical components powered exclusively by at least one helmet-mounted battery.

14. A method for providing to a pilot confirmation that a weapon system is locked-on to a visible target without use of a visual display, the method comprising the steps of:

(i) determining an eye gaze direction relative to a given frame of reference for at least one eye of the pilot;

(ii) determining a target direction representing the direction relative to said given frame of reference from the weapon system to the target to which the weapon system is locked-on;

(iii) comparing said eye gaze direction with said target direction; and

(iv) if said eye gaze direction and said target direction are equal to within a given degree of accuracy, generating a predefined audible signal to confirm that the weapon system is locked-on to a target at which the pilot is currently gazing.

15. The method of claim 14, wherein said given degree of accuracy corresponds to a maximum allowed angular discrepancy between said eye gaze direction and said target direction, said maximum allowed discrepancy having a value of less than 5°

.

16. The method of claim 14, wherein said given degree of accuracy corresponds to a maximum allowed angular discrepancy between said eye gaze direction and said target direction, said maximum allowed discrepancy having a value of less than 2°

.

17. The method of claim 14, wherein said determining an eye gaze direction includes:

(i) employing a helmet-mounted system to derive direction information related to a relative eye gaze direction for at least one eye of the pilot relative to a helmet worn by the pilot;

(ii) transmitting said direction information via a cordless communications link to a receiver unit;

(iii) deriving position information related to a position of said helmet within a cockpit; and

(iv) processing said direction information and said position information to derive said eye gaze direction relative to a frame of reference associate with said cockpit.

18. The method of claim 17, wherein said helmet-mounted system and a helmet-mounted portion of said cordless communications link are implemented using low-power electrical components powered exclusively by at least one helmet-mounted battery.