Methods and systems for operating avionic systems based on user gestures

• US 8,907,887 B2
• Filed: 05/19/2008
• Issued: 12/09/2014
• Est. Priority Date: 05/19/2008
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Larson, Brent D., Suddreth, John G., Cupero, Frank
• Primary Examiner(s): MARINELLI, PATRICK
• Application Number:
  US12/123,079
• Publication Number:
  US 20090284552A1
• Time in Patent Office: 2,395 Days
• Field of Search: 345 7- 9, 345204-215, 345 87-104, 345629-641
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06F 3/012 Head tracking input arrangements

Abstract

Methods and systems for operating an avionics system are provided. A predefined set of movements of a headset is detected. In response to the detection of the set of movements, one or more various functions are performed.

Claims

1. A method for operating an avionics system comprising a headset and a head-up display (HUD) device in an aircraft, the method comprising:

determining when the headset is in a specific starting position at a predetermined position in the aircraft and when the headset is in a specific starting orientation when the HUD device is in a first state of operation;

determining when the headset is moved starting from the specific starting position and the specific starting orientation in the aircraft according to a predefined set of movements;

switching, only in response to the determining when the headset is moved starting from the specific starting position and the specific starting orientation in the aircraft according to the predefined set of movements, the HUD device from the first state of operation to a second state of operation; and

causing the HUD device to remain in the second state of operation when the headset returns to the predetermined position and predetermined orientation;

wherein determining when the headset is moved starting from the specific starting position and the specific starting orientation in the aircraft according to the predefined set of movements further comprises;

receiving, from a motion tracker, position coordinates and orientation coordinates having a first number of degrees of freedom;

transforming the position coordinates and orientation coordinates having the first number of degrees of freedom to a data set having a second number of degrees of freedom, the second number of degrees of freedom having fewer degrees of freedom than the first number of degrees of freedom; and

determining when the headset is moved starting from the specific starting position and the specific starting orientation in the aircraft according to the predefined set of movements based upon the data set having the second number of degrees of freedom.

2. The method of claim 1, further comprising:

detecting a second predefined set of movements of the headset; and

in response to said detection of the second predefined set of movements, switching the HUD device from the second state of operation to a third state of operation.

3. The method of claim 2, further comprising:

causing at least one image to be rendered on the on the HUD device; and

wherein said switching of the state of operation from the first state of operation to the second state of operation of the HUD device causes at least a portion of the at least one image to be deactivated.

4. The method of claim 3, wherein the third state of operation is the same as the first state of operation.

5. The method of claim 4, wherein the second predefined set of movement is substantially opposite the predefined set of movements.

6. The method of claim 5, wherein the HUD device is operable within an operational range limit on-board the aircraft and the initial position-orientation is within the operational range limit.

7. The method of claim 6, wherein the HUD device is a near-to-eye (NTE) display device coupled to the headset.

8. The method of claim 1, wherein the first number of degrees of freedom is six and the second number of degrees of freedom is two.

9. A method for operating an avionics system comprising a headset and a head-up display (HUD) device in an aircraft, the method comprising:

defining first and second sets of movements of the headset;

detecting when the headset is in a predetermined position and a predetermined orientation in the aircraft when the HUD device is in a first state of operation;

detecting the first set of movements of the headset, the first set of movements of the headset originating at the predetermined position and the predetermined orientation in the aircraft;

switching, only in response to said detection of the first set of movements starting from the predetermined position and the predetermined orientation in the aircraft, the HUD device from the first state of operation to a second state of operation;

causing the HUD device to remain in the second state of operation when the headset returns to the predetermined position and predetermined orientation without undergoing the second set of movements;

detecting the second set of movements of the headset; and

in response to said detection of the second set of movements, switching the HUD device from the second state of operation to a third state of operation;

wherein detecting the first set of movements of the headset and the second set of movements of the headset further comprises;

receiving, from a motion tracker, position coordinates and orientation coordinates having a first number of degrees of freedom;

transforming the position coordinates and orientation coordinates having the first number of degrees of freedom to a data set having a second number of degrees of freedom, the second number of degrees of freedom having fewer degrees of freedom than the first number of degrees of freedom;

detecting the first set of movements of the headset based upon the data set having the second number of degrees of freedom; and

detecting the second set of movements of the headset based upon the data set having the second number of degrees of freedom.

10. The method of claim 9, wherein the first and second set of movements comprise at least one of a spatial movement and an angular movement.

11. The method of claim 10, further comprising:

causing a first image to be displayed on the HUD device, the first image being at least representative of a field of view from on-board the aircraft; and

rendering a second image over the first image on the HUD device.

12. The method of claim 11, wherein said switching of the state of operation from the first state of operation to the second state of operation of the HUD device causes at least a portion of the second image to be deactivated.

13. The method of claim 12, wherein the second image comprises symbology indicative of a current state of the aircraft.

14. The method of claim 13, wherein the HUD device is a near-to-eye (NTE) display device coupled to the headset.

15. A method for operating an avionics system comprising a headset, the method comprising:

detecting when the headset is in a predetermined position and a predetermined orientation in an aircraft;

detecting a predefined set of movements of the headset beginning at the predetermined position and the predetermined orientation in the aircraft; and

generating an audio communication only in response to said detection of the predefined set of movements of the headset beginning at the predetermined position and predetermined orientation;

wherein detecting the predefined set of movements of the headset beginning at the predetermined position and the predetermined orientation in the aircraft further comprises;

receiving, from a motion tracker, position coordinates and orientation coordinates having a first number of degrees of freedom;

transforming the position coordinates and orientation coordinates having the first number of degrees of freedom to a data set having a second number of degrees of freedom, the second number of degrees of freedom having fewer degrees of freedom than the first number of degrees of freedom; and

detecting the predefined set of movements of the headset based upon the data set having the second number of degrees of freedom.

16. The method of claim 15, wherein the audio communication is generated by at least one of a transmitter and an audio device located on-board the aircraft.

17. The method of claim 16, wherein the audio communication is generated by the transmitter on-board the aircraft and is indicative of a state of distress.

18. The method of claim 17, wherein the predefined set of movements is representative of a Morse code message.

19. The method of claim 15, wherein the audio communication is generated by the audio device on-board the aircraft and is indicative of a behavior of a user wearing the headset.

20. The method of claim 19, wherein the audio device is a speaker and the audio communication is an alert audible to the user.

21. The method of claim 20, wherein the predefined set of movements is indicative of a state of fatigue of the user.