Methods and system for creating focal planes in virtual and augmented reality

• US 9,857,591 B2
• Filed: 05/29/2015
• Issued: 01/02/2018
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Welch, William Hudson, Tekolste, Robert D., Chung, Hyunsun, Cheng, Hui-Chuan
• Primary Examiner(s): SIMPSON, LIXI CHOW
• Application Number:
  US14/726,429
• Publication Number:
  US 20150346495A1
• Time in Patent Office: 949 Days
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0194 with combiner of laminated type, for optical or mechanical aspects
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a spatial light modulator operatively coupled to an image source for projecting light associated with one or more frames of image data, and a variable focus element (VFE) for varying a focus of the projected light such that a first frame of image data is focused at a first depth plane, and a second frame of image data is focused at a second depth plane, and wherein a distance between the first depth plane and the second depth plane is fixed.

Claims

1. An augmented reality display system, comprising:

first and second spatial light modulators operatively coupled to an image source for projecting light associated with one or more frames of image data, wherein the first spatial light modulator comprises a Digital Light Processing system that provides grayscale images and the second spatial light modulator comprises a Liquid Crystal Display that provides a color map, the combination of the Digital Light Processing system and the Liquid Crystal Display work in conjunction to create multiple depth planes; and

a variable focus element (VFE) for varying a focus of the projected light such that a first frame of image data is focused at a first depth plane, and a second frame of image data is focused at a second depth plane, and wherein a distance between the first depth plane and the second depth plane is fixed,

wherein the first and second spatial light modulators are disposed along a same optical path.

2. The augmented reality display system of claim 1, wherein the first depth plane is different from the second depth plane.

3. The augmented reality display system of claim 1, wherein the first spatial light modulator is projected toward a set of achromatic lenses.

4. The augmented reality display system of claim 3, wherein the DLP operates at a frame rate of 360 Hz.

5. The augmented reality display system of claim 1, wherein the VFE is a deformable mirror membrane.

6. The augmented reality display system of claim 1, wherein the VFE varies the focus on a frame-by-frame basis.

7. The augmented reality display system of claim 1, wherein the first spatial light modulator is a high refresh rate display.

8. The augmented reality display system of claim 1, wherein the first depth plane and the second depth plane are perceived simultaneously.

9. The augmented reality display system of claim 1, further comprising a set of optical elements to deliver the focused light to a user'"'"'s eyes.

10. The augmented reality display system of claim 1, wherein the one or more frames of image data comprise slices of a three-dimensional scene.

11. The augmented reality display system of claim 1, wherein the one or more frames of image data are provided in a time-sequential manner.

12. The augmented reality display system of claim 3, wherein the second spatial light modulator projects light through a second set of achromatic lenses.

13. The augmented reality display system of claim 1, further comprising an accommodation tracking module to track a vergence of a user'"'"'s eyes, wherein the VFE varies the focus of the projected light based at least in part on the tracked vergence.

14. The augmented reality display system of claim 1, wherein the first depth plane corresponds to optical infinity, and the second depth plane corresponds to a depth plane closer than optical infinity.