Methods and systems for generating virtual content display with a virtual or augmented reality apparatus

• US 10,175,478 B2
• Filed: 05/29/2015
• Issued: 01/08/2019
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Tekolste, Robert D., Klug, Michael
• Primary Examiner(s): Chang, Audrey Y
• Application Number:
  US14/726,424
• Publication Number:
  US 20150346490A1
• Time in Patent Office: 1,320 Days
• Field of Search: 359 15, 359 34, 359569, 359576, 385 37, 345 8
• CPC Class Codes: G02B 2005/1804 Transmission gratings
• CPC Class Codes: G02B 2027/0109 comprising details concerning the making of holograms
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0125 Field-of-view increase by wavefront division
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 27/0081 with means for altering, e.g. enlarging, the entrance or exit pupil
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 30/24 involving temporal multiplexing, e.g. using sequentially activated left and right shutters
• CPC Class Codes: G02B 30/26 of the autostereoscopic type
• CPC Class Codes: G02B 5/1842 Gratings for image generation G02B5/1847 takes precedence
• CPC Class Codes: G02B 5/1871 Transmissive phase gratings
• CPC Class Codes: G02F 1/1334 based on polymer dispersed liquid crystals, e.g. microencapsulated liquid crystals
• CPC Class Codes: G03H 1/0408 Total internal reflection [TIR] holograms, e.g. edge lit or substrate mode holograms

Abstract

Several unique configurations for interferometric recording of volumetric phase diffractive elements with relatively high angle diffraction for use in waveguides are disclosed. Separate layer EPE and OPE structures produced by various methods may be integrated in side-by-side or overlaid constructs, and multiple such EPE and OPE structures may be combined or multiplexed to exhibit EPE/OPE functionality in a single, spatially-coincident layer. Multiplexed structures reduce the total number of layers of materials within a stack of eyepiece optics, each of which may be responsible for displaying a given focal depth range of a volumetric image. Volumetric phase type diffractive elements are used to offer properties including spectral bandwidth selectivity that may enable registered multi-color diffracted fields, angular multiplexing capability to facilitate tiling and field-of-view expansion without crosstalk, and all-optical, relatively simple prototyping compared to other diffractive element forms, enabling rapid design iteration.

Claims

1. A method for generating stereoscopic images for virtual reality or augmented reality, comprising:

transmitting input light beams having an incident direction and carrying image information of at least one stereoscopic image into a substrate of an eyepiece by using an in-coupling optic element;

refracting, at the in-coupling optic element, the input light beams toward a first diffractive element;

diffracting, with at least the first diffractive element, a first portion of the input light beams incident on a first portion of the first diffractive element to propagate in a diffracted direction that points to a portion of a second diffractive element on the eyepiece while allowing a remaining portion of the input light beams to continue to propagate in the incident direction within the substrate of the eyepiece and to interact with a different portion of the second diffractive element, wherein the first diffractive element and the second diffractive element are disposed on two opposing sides of the substrate; and

projecting exiting light beams with an output light beam density for the at least one stereoscopic image to at least one eye of a viewer with the second diffractive element to diffract some of the first portion of the input light beams that is diffracted by the first diffractive element to the second diffractive element as the exiting light beams and to direct a remaining portion of the first portion incident on the second diffractive element in a direction to continue to propagate within the substrate, wherein

the output light beam density is configured based at least part upon degrees of spatial overlapping between the first and second diffractive elements, or the output light beam intensity is increased by embedding a beam-splitting surface in the substrate or by being sandwiched between the substrate and another substrate to split at least a part of the input light beams into a plurality of portions comprising a transmitted portion and a reflected portion,

the first diffractive elements and the second diffractive elements are configured to comprise diffractive structures of both a volumetric type and a surface relief type, rather than the volumetric type of diffractive structures alone or the surface-relief type of diffractive structures alone, and the first and second diffractive elements are disposed on or in one or more transparent or translucent optical components.

2. The method of claim 1, further comprising:

transmitting a remaining portion of the input light beams within the substrate of the eyepiece;

diffracting some of the remaining portion of the input light beams toward the second diffractive element by using the first diffractive element; and

directing second exiting light beams toward the viewer by diffracting a part of the remaining portion of the input light beams with the second diffractive element.

3. The method of claim 1, further comprising:

transmitting a remaining portion of the first portion of the input light beams within the substrate of the eyepiece; and

directing additional exiting light beams toward the viewer by causing the remaining portion of the first portion to be diffracted with the first diffractive element and the second diffractive element.

4. The method of claim 1, further comprising:

providing the substrate with the first and second diffractive optical elements as a first layer unit;

providing at least a second substrate with third diffractive element and fourth diffractive element disposed on opposite side of the second substrate, as a second layer unit;

stacking the first layer unit and the at least second layer unit on each other to form a multi-planar configuration; and

dynamically switching on the first layer unit project the exiting light beams to form the at least one stereoscopic image at a first focal plane;

or

dynamically switching on at least the second layer unit, to diffract a first portion of the input light beams incident on the third diffractive element to propagate in a diffracted direction to a portion of the fourth diffractive element while allowing a remaining portion of the input light beams to continue to propagate in the incident direction within the second substrate and to interact with a different portion of the fourth diffractive element and to project exiting light beams with the fourth diffractive optical element by diffracting some of the first portion of the input light beams, diffracted by the third diffractive element to the fourth diffractive element, toward the at least one eye of the viewer and directing a remaining portion of the first portion of the input light beams in a direction to propagate within the second substrate, wherein the exiting light beams form the at least one stereoscopic image at a second focal plane.

5. The method of claim 4, wherein the third diffractive element and the fourth diffractive element on at least the second substrate comprise a combination of surface-relief type diffractive elements and volumetric-phase type diffractive elements.

6. An apparatus for generating stereoscopic images for virtual reality and/or augmented reality, comprising:

an eyepiece including a substrate;

an in-coupling optic element to refract input light beams having an incident direction and carrying image information of at least one stereoscopic image into the substrate; and

the substrate comprising first diffractive element and second diffractive element that are operatively coupled to the in-coupling optic element, wherein

the first diffractive element and the second diffractive element are disposed on two opposing sides of the substrate,

the first diffractive element is configured to diffract a first portion of the input light beams incident on at least a portion of the first diffractive element to propagate in a diffracted direction that points to a portion of second diffractive element while allowing a remaining portion of the input light beams to continue to propagate in the incident direction within the substrate of the eyepiece and to interact with a different portion of the second diffractive element,

the second diffractive element is configured to project exiting light beams with an output light beam density for the at least one stereoscopic image to at least one eye of a viewer at least by diffracting some of the first portion of the input light beams that is diffracted by the first diffractive element as exiting light beams toward the at least one eye of the viewer and directing a remaining portion of the first portion incident on at least one portion of the second diffractive element in a direction to propagate within the substrate,

the output light beam density is configured based at least in part on a degree of spatial overlapping between the first and second diffractive elements or an output light beam intensity is increased by embedding a beam-splitting surface in the substrate or sandwiching the beam-splitting surface between the substrate and another substrate to split at least a part of the input light beams into a plurality of portions comprising a transmitted portion and a reflected portion,

the first and second diffractive elements are configured so each comprises diffractive structures of both a volumetric type and a surface relief type, rather than the volumetric type of diffractive structures alone or the surface-relief type of diffractive structures alone.

7. The apparatus of claim 6, wherein the first diffractive element and the second diffractive element are configured to comprise both a plurality of linear diffractive elements and a plurality of circular or radially symmetric diffractive elements.

8. The apparatus of claim 6, wherein the first diffractive element and the second diffractive element are arranged in a folded or overlaid arrangement on both sides of the substrate.

9. The apparatus of claim 6, further comprising:

a multi-layer configuration that is comprised of a stack of a first layer unit, including the substrate, the first diffractive element and the second diffractive element and at least one second layer unit, and a controller to selectively and dynamically switch on/off of the first and the at least one second layer unit, wherein

the at least one second layer unit further comprises a second substrate with third diffractive element and fourth diffractive element disposed on opposite side of the second substrate,

when the second layer unit is dynamically switched on, the third diffractive element is configured to diffract a first portion of the input light beams incident on at least a portion of the third diffractive element to propagate in a diffracted direction that points to a portion of the fourth diffractive element while allowing a remaining portion of the input light beams to continue to propagate in the incident direction within the second substrate and to interact with a different portion of the fourth diffractive element,

the fourth diffractive element is configured to project exiting light beams with an output light beam density for the at least one stereoscopic image to the at least one eye of the viewer at least by diffracting some of the first portion of the input light beams that is diffracted by the third diffractive element toward the at least one eye of the viewer and directing a remaining portion of the first portion incident on the at least one portion of the fourth diffractive element in a direction propagating within the substrate, and

the first layer unit and the second layer unit each projects exiting light to form the image at different focal planes.

10. The apparatus of claim 9, where the first layer unit and the at least one second layer unit include at least one polymer-dispersed liquid crystal layer.

11. The apparatus of claim 6, wherein the first diffractive element and the second diffractive element include both surface-relief type diffractive elements and volumetric-phase type diffractive elements both of which are arranged in a folded configuration.