Apparatus for optical see-through head mounted display with mutual occlusion and opaqueness control capability

• US 9,874,752 B2
• Filed: 05/26/2017
• Issued: 01/23/2018
• Est. Priority Date: 04/05/2012
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Gao, Chunyu, Lin, Yuxiang, Hua, Hong
• Primary Examiner(s): Won, Bumsuk
• Assistant Examiner(s): Washington, Tamara Y
• Application Number:
  US15/607,335
• Publication Number:
  US 20170315361A1
• Time in Patent Office: 242 Days
• Field of Search: 359 10, 359 11, 3592042, 3592172, 3592242, 359237-297, 359325, 349 24, 349 50
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0145 creating an intermediate image
• CPC Class Codes: G02B 2027/015 involving arrangement aiming to get less bulky devices
• CPC Class Codes: G02B 25/001 Eyepieces
• CPC Class Codes: G02B 26/00 Optical devices or arrangements for the control of light using movable or deformable optical elements control of light by modification of the optical properties of the media of the elements involved therein G02F1/00
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/1066 for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
• CPC Class Codes: G02B 27/144 using partially transparent surfaces without spectral selectivity G02B27/147 takes precedence
• CPC Class Codes: G02B 27/283 used for beam splitting or combining
• CPC Class Codes: G02B 5/04 Prisms
• CPC Class Codes: G03B 37/02 with scanning movement of lens or cameras
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The present invention comprises a compact optical see-through head-mounted display capable of combining, a see-through image path with a virtual image path such that the opaqueness of the see-through image path can be modulated and the virtual image occludes parts of the see-through image and vice versa.

Claims

1. A compact optical see-through head-mounted display (300), capable of combining a see-through path (307) with a virtual view path (305) such that the opaqueness of the see-through path can be modulated and the virtual view occludes parts of the see-through view and vice versa, the display comprising:

a. a microdisplay (350) for generating an image to be viewed by a user, the microdisplay having a virtual view path (305) associated therewith;

b. a reflection-type spatial light modulator (340) for modifying the light from an external scene in the real world to block portions of the see-through view that are to be occluded, the spatial light modulator having a see-through path (307) associated therewith;

c. an objective optics (320), facing an external scene, configured to receive the incoming light from the external scene and to focus the light upon the spatial light modulator (340) where the objective optics is a one-reflection freeform prism comprising three optical freeform surfaces;

refractive surface S4, reflective surface S5 and refractive surface S6;

d. a beamsplitter (330) configured to merge a digitally generated virtual image from a microdisplay (350) and a modulated see-through image of an external scene passing from a spatial light modulator, producing a combined image;

e. an eyepiece (310) configured to magnify the combined image, where the eyepiece is a one-reflection freeform prism comprising three optical freeform surfaces;

refractive surface S1, reflective surface S2 and refractive surface S3;

f. an exit pupil (302) configured to face the eyepiece, the exit pupil whereupon the user observes the combined view of the virtual and see-through views in which the virtual view occludes portions of the see-through view;

g. a roof mirror (325) configured to reflect light from the external scene into the objective optics, where the roof mirror adds an additional reflection to revert the see-through view so as to maintain the parity between the external scene and the see-through view presented to the viewer;

wherein the mirror (325) is disposed upon the front layer (315) of the display, wherein the objective optics (320) is disposed upon the front layer (315) of the display, where the spatial light modulator (340) is disposed on the back layer (317) of the display, at or near an intermediate image plane of the see-through path, facing a side of the beam splitter (330), where the microdisplay (350) is disposed on the back layer (317) of the display, facing a different side of the beam splitter (330), where the beam splitter (330) is disposed such that the see-through path (307) is merged with the virtual view path (305) and the light from the merged path is directed to the eyepiece (310), wherein the eyepiece (210) is disposed upon the back layer (317) of the display,

whereupon the incoming light from an external scene reflected by the minor (325), enters the objective optics (320) through the refractive surface S4, then is reflected by the reflective surface S5 and exits objective prism (320) through the refractive surface S6 and forms an intermediate image at its focal plane on the spatial light modulator (340), whereupon the spatial light modulator (340) modulates the light in the see-through path to occlude portions of the see-through view, whereupon the spatial light modulator reflects the modulated light into the beam splitter (330), whereupon the light from the microdisplay (350) enters the beam splitter (330), whereupon the beamsplitter (330) merges the modulated light in the see-through path (307) with the light in the virtual view path (305) and folds toward the eyepiece (310) for viewing, whereupon the light from the beam splitter enters the eyepiece (310) through the refractive surface S3, then is reflected by the reflective surface S2 and exits the eyepiece (310) through the refractive surface S1 and reaches the exit pupil (302), where the viewer'"'"'s eye is aligned to see a combined view of a virtual view and a modulated see-through view.