Conjugate optics projection display with image enhancement

• US 6,379,009 B1
• Filed: 03/30/2000
• Issued: 04/30/2002
• Est. Priority Date: 04/24/1996
• Status: Expired due to Term

• Current Assignee: Fergason Patent Properties
• Original Assignee: Fergason Patent Properties
• Inventors: Fergason, James L.
• Primary Examiner(s): DOWLING, WILLIAM C
• Application Number:
  US09/538,454
• Time in Patent Office: 761 Days
• Field of Search: 353/12, 353/13, 353/28, 353/30, 353/98, 359/629, 359/630, 359/633, 345/7, 345/8, 345/9
• US Class Current: 353/28
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03B 15/12 using mirrors
• CPC Class Codes: G03B 21/14 Details

Abstract

A projected image is overlaid on an actual view of an object, the image being identical to the actual view in size, shape and scale, and being perfectly registered with the actual view, e.g, as to position or location, and, accordingly being substantially parallax-free. The image may be of different “color” than the actual view, i.e., one may be a view or image of light in a visible wavelength region, band or bandwidth, and the other may be a view or image in a non-visible wavelength region, band or bandwidth, such as a view or image of infrared light or of x-ray radiation. The infrared view or image may be converted to a view or image in the visible bandwidth for viewing by a person. The image mentioned above may be a real image of an actual view of an object, scene or the like. Alternatively, the image may be an image other than of an actual view of an object, for example being a previously-obtained image along a same or similar point of view as the actual view of the object, scene, or the like. As another example, the image may be a computer-generated image based on previously-obtained data regarding the object, scene, or the like. The image may be an image obtained by a camera or some other means and then delivered, e.g., as by projection via a projector and conjugate optics, for superpositioning with respect to the real or actual view for viewing by a user.

Claims

1. A method of displaying information, comprising projecting an image in overlaid relation on an actual view of an object, wherein the image is from a same point of view as the actual view, and is of at least part of the actual view or of a missing part of the actual view.

2. The method of claim 1, wherein as viewed the actual view and the image are identical in size, shape and scale.

3. The method of claim 1, wherein as viewed the actual view and the image are substantially registered with each other.

4. The method of claim 1, wherein as viewed the actual view and the image are of different color or wavelength.

5. The method of claim 4, wherein the image is obtained in a non-visible spectrum.

6. The method of claim 5, wherein the image is obtained as an infrared image.

7. The method of claim 6, further comprising the step of converting the infrared image to an image in the visible bandwidth for viewing by a person.

8. The method of claim 1, wherein the projecting includes reflecting the image off of a retroreflector which is positioned such that the retroreflector does not impinge on the actual view.

9. The method of claim 1, wherein the image is an image obtained by a camera.

10. The method of claim 1, further comprising delivering the image by projection via a projector and conjugate optics, for superpositioning with respect to the actual view for viewing by a user.

41. The system of claim 1, wherein the image is a real image.

11. A system for enhancing vision comprising

means for obtaining an actual view of an object from a point of view,

means for obtaining an image of an actual part or a missing part of the actual view from the point of view;

and

means for superimposing said the image on the actual view such that the image enhances viewing of the object, the means for superimposing including imaging and projecting means for projecting in a conjugate path the image;

wherein as viewed the actual view and the image are separated by spectral region or by computer generation.

12. The system of claim 11, wherein the means for obtaining the image includes a detector for detecting an infrared, ultraviolet or other detectable feature of object information and based on that information converting the same to image information in the visible range, and the means for superimposing comprises means for projecting the information in superposition with the actual view of the object.

13. The system of claim 11, wherein the means for obtaining the image includes a camera in a conjugate path with a projection device to produce an electronic image of the object such that the electronic image from the camera falls at the same position as the object in space.

14. The system of claim 11, wherein the means for obtaining the image includes an infrared detector.

15. An apparatus for night vision, for vehicle or aircraft control, for input to a controlling individual of the vehicle or aircraft by simultaneous projection of an image of a detected view while direct viewing of the view is possible, comprising the system of claim 11 to obtain the view and the image.

16. The apparatus of claim 15, further comprising means for producing a supplemental view from another source, for combining with at least one of the image and the direct view.

33. The system of claim 11, wherein the projecting means includes a retroreflector positioned outside the actual view from the point of view.

36. The system of claim 11, wherein the means for obtaining the actual view includes an optical filter.

17. A method of displaying information, comprising,

projecting an image in overlaid relation on an actual view of an object, wherein the image is obtained in a non-visible spectrum and the actual view of the object is obtained or provided in the visible spectrum, the actual view of the object and the image being from a same point of view.

34. The method of claim 17, wherein the projecting includes reflecting the image off or a retroreflector which is positioned such that the retroreflector does not impinge on the actual view.

18. A system for enhancing vision comprising:

a beamsplitter which allows a view of an object to at least partially pass therethrough; and

a projector which projects onto the beamsplitter an image that represents, from a same point of view as the view of the object, an actual part or a missing part of the view, such that at least part of the image is superimposed on the view of the object.

19. The system of claim 18, wherein the image is a previously-obtained image.

20. The system of claim 18, further comprising a remote source which provides data to the projector for use in projecting the image.

21. The system of claim 20, wherein the remote source includes a radio transmitter, and further comprising a radio receiver for receiving signals from the transmitter, the receiver being operatively coupled to the projector.

22. The system of claim 20, further comprising a head tracking device providing information representative of the direction that a viewer is facing to view the object for use to indicate the point of view of the image provided for viewing.

23. The system of claim 20, further comprising a head tracking device operatively coupled to the remote source to provide head position information to the remote source, the data being selected at least in part based on the head position information.

27. The system of claim 18, wherein the beamsplitter is a first beamsplitter, and further comprising a second beamsplitter optically coupled to the first beamsplitter.

30. The system of claim 18, further comprising a retroreflector for reflecting the image.

31. The system of claim 18, further comprising means for providing image data to the projector.

32. The system of claim 30, wherein the retroreflector does not allow light to pass therethrough.

37. The system of claim 18, further comprising an optical filter between the beamsplitter and the object which at least partially filters out one or more wavelengths of light from the actual view.

38. The system of claim 37, wherein the projector projects light including the one or more wavelengths.

24. A system for enhancing vision comprising:

a beamsplitter which allows a view of an object to at least partially pass therethrough;

a projector which projects onto the beamsplitter an image that represents an actual part or a missing part of the object as viewed, such that at least part of the image is superimposed on the view of the object; and

a detector which receives at least some of a reflected portion of the view of the object which is reflected by the beamsplitter, the detector being operatively coupled to the projector to provide data to the projector for use in projecting the image.

25. The system of claim 24, wherein the detector detects an infrared, ultraviolet or other detectable feature of object information and based on that information the projector projects the image in the visible range.

26. The system of claim 24, wherein the detector detects non-visible light and the projector projects the image in the visible range based on the non-visible light detected by the detector.

35. The system of claim 24, further comprising a retroreflector operatively coupled to the projector.

39. The system of claim 24, further comprising an optical filter between the beamsplitter and the object which at least partially filters out one or more wavelengths of light from the actual view.

40. The system of claim 39, wherein the projector projects light including the one or more wavelengths.

28. A system for enhancing vision comprising:

a first beamsplitter which allows a view of an object to at least partially pass therethrough,

a projector which projects onto the first beamsplitter an image that represents an actual part or a missing part of the view of the object, such that at least part of the image is superimposed on the view of the object,

a second beamsplitter optically coupled to the first beamsplitter,

a third beamsplitter optically coupled to the first and second beamsplitters, and

a retroreflector optically coupled to the third beamsplitter,

wherein the third beamsplitter and the retroreflector are a substantial distance away from the detector and the projector.

29. The system of claim 28, wherein the detector and the projector are part of a head mounted display and the located at a windshield or window.