Waveguide display with multiple focal depths

• US 10,108,014 B2
• Filed: 01/10/2017
• Issued: 10/23/2018
• Est. Priority Date: 01/10/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Vallius, Tuomas, Juhola, Mikko Antton
• Primary Examiner(s): Davis, Tony
• Application Number:
  US15/402,904
• Publication Number:
  US 20180196263A1
• Time in Patent Office: 651 Days
• Field of Search: 345156, 345170-179
• CPC Class Codes: G02B 2027/0125 Field-of-view increase by wavefront division
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 3/0006 Arrays G02B3/02, G02B5/188 take precedence
• CPC Class Codes: G02F 1/291 Two-dimensional analogue deflection
• CPC Class Codes: G02F 1/294 Variable focal length devices
• CPC Class Codes: G02F 1/295 Analog deflection from or in an optical waveguide structure]
• CPC Class Codes: G02F 2201/302 grating coupler
• CPC Class Codes: G02F 2201/305 diffraction grating
• CPC Class Codes: G02F 2203/22 diffractive

Abstract

A near-eye optical display system utilized in augmented reality devices includes a see-through waveguide display having optical elements configured for in-coupling virtual images from an imager, exit pupil expansion, and out-coupling virtual images with expanded pupil to the user'"'"'s eye. The near-eye optical display system further includes a curved two-sided array of electrically-activated tunable liquid crystal (LC) microlenses that is located between the waveguide and the user'"'"'s eye. The LC microlenses are distributed in layers on each side of the two-sided array. Each pixel in the waveguide display is mapped to an LC microlens in the array, and multiple nearby pixels may be mapped to the same LC microlens. A region of the waveguide display that the user is gazing upon is detected and the LC microlens that is mapped to that region may be electrically activated to thereby individually shape the wavefront of each pixel in a virtual image.

Claims

1. A near-eye optical display system configured to enable a user to view a mixed-reality environment comprising real-world images and virtual images, comprising:

an imager configured to generate virtual images;

a waveguide configured to enable the user to see through the waveguide to view virtual-world images and including an in-coupling element for in-coupling virtual images into the waveguide, and an out-coupling element for out-coupling virtual images from the see-through waveguide;

an array of lenses, the array configured to impart variable focal depth to virtual images out-coupled from the waveguide to the user'"'"'s eye and further configured to pass real-world images to the user'"'"'s eye without imparting change in focal depth;

a first diffractive optical element (DOE) having an input surface and configured as an in-coupling grating to receive imaging light incorporating the virtual images from the imager as an input;

a second DOE configured for pupil expansion of the imaging light along a first direction; and

a third DOE having an output surface and configured for pupil expansion of the imaging light along a second direction, and further configured as an out-coupling element to out-couple, as an output to the array of lenses from the output surface, imaging light with expanded pupil relative to the input.

2. The near-eye optical display system of claim 1 in which at least a portion of the array is curved with concavity towards the user'"'"'s eye.

3. The near-eye optical display system of claim 1 in which the array is a two-sided array and the lenses are liquid crystal (LC) microlenses which are disposed on each side of the two-sided array.

4. The near-eye optical display system of claim 1 in which the lenses in the array are each configured to be tunable by application of an electrical modulation signal.

5. An electronic device supporting an augmented reality experience including virtual images and real-world images for a user, comprising:

a virtual image processor configured to provide virtual image data;

an optical engine configured to produce virtual images from the virtual image data;

an exit pupil expander, responsive to one or more input optical beams incorporating the virtual images, comprising a structure on which multiple diffractive optical elements (DOEs) are disposed including an out-coupling DOE; and

a curved array of electrically-modulated tunable lenses, each lens configured to assume a particular wavefront shape to thereby impart multiple focal depths to the virtual images,

wherein the array is located on the electronic device between an eye of the user and the out-coupling DOE when the user operates the electronic device, and

wherein the exit pupil expander is configured to provide one or more out-coupled optical beams at the out-coupling DOE to the array with an expanded exit pupil relative to the one or more input optical beams.

6. The electronic device of claim 5 in which the exit pupil expander provides pupil expansion in two directions.

7. The electronic device of claim 5 in which the optical engine includes an imager selected from one of light emitting diode, liquid crystal on silicon device, organic light emitting diode array, or micro-electro mechanical system device.

8. The electronic device of claim 7 in which the imager is configured to operate using raster scanning.

9. The electronic device of claim 5 in which one or more of the lenses include liquid crystal (LC) microlenses comprising floating electrodes and concentric electrodes wherein the floating electrodes are configured to fill gaps between the concentric electrodes when the one or more LC microlenses are electrically modulated.

10. The electronic device of claim 9 in which a given LC microlens in the array is mapped to one or more pixels in the out-coupling DOE based on a position of the one or more pixels in the out-coupling DOE.

11. The electronic device of claim 10 further including an array controller to set a focal depth for virtual images by controlling wavefront shape for one or more LC microlenses in the array that are mapped to pixels forming the virtual image.

12. The electronic device of claim 11 further including a gaze direction sensor configured to detect a gaze direction of the user, and controlling wavefront shape for one or more LC microlenses in the array that are along a detected gaze direction.

13. The electronic device of claim 12 in which the LC microlens includes a layer of LC material located between respective top and bottom substrates and further comprising a controller configured to electrically modulate the LC microlens to assume the particular wavefront shape to thereby impart focus to the out-coupled optical beams, the controller being adapted to apply an electric profile to various portions of the LC material layer through electrical contacts to the concentric electrodes.

14. The electronic device of claim 5 in which one or more lenses are configured to be infinitely variable between a range of optical powers.

15. A method for selectively providing variable focus to virtual images in an augmented reality display system that supports virtual images and real-world images, comprising:

receiving, from an imager, imaging light incorporating a virtual image at an in-coupling diffractive optical element (DOE) disposed in an exit pupil expander;

expanding an exit pupil of the received imaging light along a first coordinate axis in an intermediate DOE disposed in the exit pupil expander;

expanding the exit pupil along a second coordinate axis in an out-coupling DOE disposed in the exit pupil expander;

outputting the virtual images using the out-coupling DOE to an array of tunable liquid crystal (LC) microlenses, the output virtual images having an expanded exit pupil relative to the received light at the in-coupling DOE along the first and second coordinate axes; and

electrically controlling one or more LC microlenses in the array to focus the virtual image on a virtual image plane, a location of the virtual image plane being at a selectively variable distance from the system based on the electrical control.

16. The method of claim 15 further including mapping pixels from the out-coupling DOE to LC microlenses in the array on a one-to-one basis or a many-to-one basis and controlling the one or more LC microlenses in the array to set focus of the virtual image based on the pixel mapping.

17. The method of claim 15 further including detecting a gaze direction of a system user and controlling LC microlenses to set focus of pixels of virtual images that intersect the detected gaze direction.

18. The method of claim 15 in which the electrically controlling comprises analog adjustability of LC material in the LC microlens between various wavefront shapes by application of power to an arrangement of electrodes in an LC microlens.

19. The method of claim 15 as performed in a near-eye display system.