Near eye display system and method for display enhancement or redundancy

• US 9,766,465 B1
• Filed: 01/25/2016
• Issued: 09/19/2017
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Tiana, Carlo L., Barber, Sarah, Zimmerman, Kenneth A.
• Primary Examiner(s): Ben, Loha
• Application Number:
  US15/005,507
• Time in Patent Office: 603 Days
• Field of Search: 359630-632, 345 7- 9, 345 32, 345156, 345419, 345426, 345427, 345582, 345633, 351209
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0165 associated with a head-down display
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0149 characterised by mechanical features G02B27/0176 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/14 operating by reflection only
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2330/08 Fault-tolerant or redundant circuits, or circuits in which repair of defects is prepared
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2380/12 Avionics applications
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

An apparatus provides a virtual display in an environment for various applications including avionic, naval, military, remote control, medical and other applications. The apparatus can be a near eye display, such as, a head up display (HUD) or head worn display (e.g., helmet mounted display (HMD), glasses-based, goggle-based, visor-based, etc.). The near eye display can include a combiner for providing one or more of: an image for a failed display, an image between two or more head down displays, or an image to direct attention to warnings or locations in the field-of-view of the combiner.

Claims

1. An apparatus in an environment, the environment comprising a plurality of target areas, the target areas each disposed at a respective target area position and separated by a gap, the apparatus comprising:

an image source; and

a combiner configured to;

receive an image from the image source; and

provide the image virtually at a location associated with the target areas and the gap when the combiner is viewed from a user position viewing the target areas;

wherein the combiner is part of a head worn display.

2. The apparatus of claim 1, wherein the image comprises information associated with the target areas.

3. The apparatus of claim 1, wherein the image comprises head-up display (HUD) symbols provided virtually at a location outside of a windshield.

4. The apparatus of claim 1, wherein a first target area of the plurality of target areas is a first head down display source.

5. The apparatus of claim 1, further comprising:

a head tracking device, wherein the image is provided in accordance with a head position.

6. The apparatus of claim 1, wherein the combiner is fixed to a helmet.

7. The apparatus of claim 6, wherein the combiner is a waveguide combiner.

8. An apparatus in an environment, the environment comprising a plurality of target areas, the target areas each disposed at a respective target area position and separated by a gap, the apparatus comprising:

an image source; and

a combiner configured to;

receive an image from the image source; and

provide the image virtually at a location associated with the target areas and the gap when the combiner is viewed from a user position viewing the target areas;

wherein a first target area of the plurality of target areas is a first head down display source, and wherein the first head down display source is at least one of non-functional, malfunctioning, and powered off.

9. An apparatus for providing a virtual display in an environment including a head down display source, the apparatus comprising:

a computer configured to determine that the head down display source is in a failed mode; and

a combiner configured to provide a virtual display of an image from an image source in response to the head down display source being in a failed mode, wherein the virtual display is provided at a location associated with the head down display source.

10. The apparatus of claim 9, wherein the image is comprised of primarily flight data and the combiner receives light from a real world scene.

11. The apparatus of claim 9, wherein the combiner is a near eye fixed waveguide combiner.

12. The apparatus of claim 9, further comprising:

a head tracking device, wherein the image is provided in accordance with a head position.

13. The apparatus of claim 9, wherein the combiner is a head worn combiner.

14. The apparatus of claim 9, wherein the head down display source is a panel display image source.

15. A method for providing a virtual display in an environment, the method comprising:

determining a status of a first head down display source in the environment; and

providing an image associated with the first head down display source at a virtual location based on the status, wherein the status indicates that the first head down display source is malfunctioning.

16. The method of claim 15, wherein the virtual location is a target location associated with the first head down display source.

17. The method of claim 15, wherein the virtual location correlates to dead space in the environment.

18. The method of claim 17, wherein the dead space comprises a gap between the first head down display source and a second head down display source.

19. The method of claim 15, wherein the status of the first head down display source is determined by a camera.