OPERATOR ASSISTANCE METHODS AND SYSTEMS

• US 20090325131A1
• Filed: 05/30/2008
• Published: 12/31/2009
• Est. Priority Date: 05/30/2008
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Cernasov, Andrei, Mead, Robert, Marotta, Joseph
• Granted Patent: US 9,207,758 B2
• Time in Patent Office: Days
• US Class Current: 434/30
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09B 9/307 by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01

Abstract

Embodiments include systems and methods for assisting an operator (e.g., a pilot) of an apparatus (e.g., an aircraft) that includes a control compartment (e.g., a cockpit). The system includes a near-eye display and a processing subsystem. The near-eye display includes a transparent display panel and is adapted to be worn on a head of the operator. The processing subsystem is adapted to receive layout information defining a physical layout of one or more operational components located within the control compartment. The processing subsystem is further adapted to determine a location for a display indicator on the transparent display panel, where the location is determined to appear to the operator to be in proximity to an operational component. The processing subsystem is further adapted to generate a display signal to cause the near-eye display to display the display indicator in the location.

Claims

1. A system for assisting an operator of an apparatus that includes a control compartment, the system comprising:

a near-eye display having a transparent display panel, wherein the near-eye display is adapted to be worn on a head of the operator; and

a processing subsystem communicatively coupled to the near-eye display, wherein the processing subsystem is adapted to receive layout information defining a physical layout of one or more operational components located within the control compartment, and to determine a location for a display indicator on the transparent display panel, wherein the location is determined to appear to the operator to be in proximity to an operational component of the one or more operational components, and the processing subsystem is further adapted to generate a display signal to cause the near-eye display to display the display indicator in the location.

2. The system of claim 1, further comprising:

a head position sensing system communicatively coupled to the processing subsystem and adapted to generate head position data representing a head position and a head orientation of the operator,

wherein the processing subsystem is further adapted to receive the head position data and to determine the location of the display indicator as a default location that is offset to compensate for the head position and the head orientation.

3. The system of claim 1, wherein at least a portion of the system is incorporated into the apparatus, and the apparatus is an apparatus selected from a group that includes an airplane, a simulator, a helicopter, a gyroplane, a glider, an electric vehicle, a hybrid vehicle, a motor vehicle, and a water vessel.

4. A system for assisting a pilot of an aircraft that includes a cockpit, the system comprising:

a near-eye display having a transparent display panel, wherein the near-eye display is adapted to be worn on a head of the pilot; and

a processing subsystem communicatively coupled to the near-eye display, wherein the processing subsystem is adapted to receive layout information defining a physical layout of one or more operational components located within the cockpit, and to determine a location for a display indicator on the transparent display panel, wherein the location is determined to appear to the pilot to be in proximity to an operational component of the one or more operational components, and the processing subsystem is further adapted to generate a display signal to cause the near-eye display to display the display indicator in the location.

5. The system of claim 4, further comprising:

a head position sensing system communicatively coupled to the processing subsystem and adapted to generate head position data representing a head position and a head orientation of the pilot,

wherein the processing subsystem is further adapted to receive the head position data and to determine the location of the display indicator as a default location that is offset to compensate for the head position and the head orientation.

6. The system of claim 5, wherein the head position sensing system is further adapted to generate additional head position data, and the processing system is further adapted to receive the additional head position data, to determine updated locations of the display indicator, and to generate additional display signals to cause the near-eye display to display the display indicator in the updated locations.

7. The system of claim 5, further comprising:

a memory device within which software instructions are stored, wherein the processing system is adapted to execute the software instructions, and wherein execution of the software instructions includes determining whether to display the display indicator.

8. The system of claim 7, further comprising:

a computer adapted to execute an application with which the software instructions may be generated through interaction with a user.

9. The system of claim 5, further comprising:

an aircraft data interface communicatively coupled to the processing subsystem, wherein the processing system is adapted to receive aircraft data through the aircraft data interface, and wherein the aircraft data includes information that indicates states of aircraft components, and wherein the processing subsystem is adapted to perform an evaluation of the aircraft data to determine whether to display a display indicator.

10. The system of claim 9, further comprising:

a memory device, wherein the processing subsystem is further adapted to generate a flight log by storing a representation of at least some of the aircraft data with corresponding marker information in the memory device.

11. The system of claim 10, further comprising:

a computer adapted to execute an application with which the flight log may be evaluated through interaction with a user in order to render a flight during which the flight log was generated.

12. A method for assisting an operator of an apparatus that includes a control compartment, the method comprising the steps of:

receiving layout information defining a physical layout of one or more operational components located within the control compartment;

determining a location for a display indicator on a transparent display panel of a near-eye display, wherein the location is determined to appear to the operator to be in proximity to an operational component of the one or more operational components; and

causing the near-eye display to display the display indicator in the location.

13. The method of claim 12, further comprising:

generating head position data representing a head position and a head orientation of the operator; and

determining the location of the display indicator as a default location that is offset to compensate for the head position and the head orientation.

14. The method of claim 13, further comprising:

generating additional head position data;

determining an updated location of the display indicator; and

causing the near-eye display to display the display indicator in the updated location.

15. The method of claim 12, further comprising:

outputting an audio prompt corresponding to the display indicator.

16. The method of claim 12, wherein the apparatus is an aircraft, and the method further comprises:

receiving aircraft data that includes information that indicates states of aircraft components; and

performing an evaluation of the aircraft data to determine whether to cause a display indicator to be displayed.

17. The method of claim 16, wherein determining the location comprises determining a location in proximity to an aircraft instrument or a control component.

18. The method of claim 16, wherein determining the location comprises determining a location overlying a windshield or window.

19. The method of claim 16, further comprising:

generating a flight log by storing a representation of at least some of the aircraft data with corresponding marker information.

20. The method of claim 19, further comprising:

rendering, on a computer, a flight during which the flight log was generated.