Near-eye parallax barrier displays

• US 10,008,043 B2
• Filed: 11/14/2016
• Issued: 06/26/2018
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Luebke, David, Lanman, Douglas Patrick, Fox, Thomas Francis, Slavenburg, Gerrit
• Primary Examiner(s): Pervan, Michael
• Assistant Examiner(s): Lee, Andrew
• Application Number:
  US15/351,297
• Publication Number:
  US 20170061698A1
• Time in Patent Office: 589 Days
• Field of Search: 345 6- 8
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/339 using spatial multiplexing H04N13/337 takes precedence

Abstract

In embodiments of the invention, an apparatus may include a display comprising a plurality of pixels and a computer system coupled with the display and operable to instruct the display to display images. The apparatus may further include an SLM array located adjacent to the display and comprising a plurality of SLMs, wherein the SLM array is operable to produce a light field by altering light emitted by the display to simulate an object that is in focus to an observer while the display and the SLM array are located within a near-eye range of the observer.

Claims

1. An apparatus comprising:

a display device comprising a plurality of pixels;

a computer system coupled with said display and operable to instruct said display to display images;

a spatial light modulator (SLM) array located adjacent to said display and comprising a plurality of spatial light modulators (SLMs); and

a light shutter operable to block rays of light originating from a surrounding environment from entering said display device and said SLM array when said display device and said SLM array are operating,

wherein said SLM array is operable to produce a light field by altering light emitted by said display device to simulate an object that is in focus to an observer while said display device and said SLM array are located within a near-eye range of said observer, and wherein said SLM array comprises an array of high-speed SLMs operable to refresh at a faster rate than a flicker fusion threshold for a human eye.

2. The apparatus of claim 1, wherein each SLM of said plurality of SLMs is operable to modulate light produced by said display.

3. The apparatus of claim 2, wherein said display device is semi-transparent, and further wherein each SLM of said plurality of SLMs is operable to modulate light passing through said display device.

4. The apparatus of claim 1, wherein said SLM array is operable to project anisotropic light by altering isotropic light produced by said display device.

5. The apparatus of claim 1, wherein said light field is operable to simulate a 3D object located beyond said near-eye range of said observer.

6. The apparatus of claim 1, wherein said computer system is operable to determine an image for display that counteracts aberrations of said observer'"'"'s eye.

7. The apparatus of claim 1, further comprising a feedback system operable to make measurements of aberrations of said observer'"'"'s eye;

and

wherein said computer system is further operable to determine an image for display that counteracts said aberrations based on said measurements.

8. The apparatus of claim 1, further comprising a sensor operable to provide information related to a surrounding environment;

and

wherein said computer system is further operable to determine an image for display that counteracts said aberrations based on said information.

9. The apparatus of claim 1, further comprising an eye-track adjustment system operable to track a gaze of an eye, wherein said eye-track adjustment system is operable to communicate information related to a gaze of an eye to said computer system for determination of an image for display by said computer system based on said information.

10. The apparatus of claim 1, wherein said display device comprises a plurality of sub-display devices disposed side by side with respect to each other.

24. The apparatus of claim 1, further wherein regions of said display device and said SLM array are operable to switch between transparent, semi-transparent, and opaque modes of operation.

11. An apparatus comprising:

a display device operable to produce an image;

a first SLM array located adjacent to said display device; and

a light shutter operable to block rays of light originating from a surrounding environment from entering said display device and said first SLM array when said display device and said first SLM array are operating,

wherein said first SLM array together with said display device is operable to produce a light field simulating a 3D object that is recognizable to an observer while said display device and said first SLM array are located within a near-eye range of said observer, and wherein said first SLM array comprises an array of high-speed SLMs operable to refresh at a faster rate than a flicker fusion threshold for a human eye.

12. The apparatus of claim 11, further comprising at least one additional SLM array located adjacent to said first SLM array.

13. The apparatus of claim 11, wherein said first SLM array is operable to display different versions, of an image produced by said display device, in different directions.

14. The apparatus of claim 11, wherein said image is out of focus if viewed without said first SLM array and said image is in focus if viewed through said first SLM array.

15. The apparatus of claim 11, wherein said display device is semi-transparent.

16. The apparatus of claim 11, wherein said first SLM array and said display device are operable to alter light from a surrounding environment and light from said display device to provide an augmented reality experience.

17. The apparatus of claim 11, wherein said first SLM array and said display device are operable to provide a virtual reality experience.

25. The apparatus of claim 11, further wherein regions of said display device and said first SLM array are operable to switch between transparent, semi-transparent, and opaque modes of operation.

18. A method comprising:

determining a pre-filtered image to be displayed, wherein said pre-filtered image corresponds to a target image;

displaying said pre-filtered image on a display device; and

producing a near-eye light field after said pre-filtered image travels through an SLM array adjacent to said display device,

wherein said near-eye light field is operable to simulate a light field corresponding to said target image,

wherein a light shutter disposed in an apparatus comprising said SLM array and said display device is operable to block rays of light originating from a surrounding environment from entering said SLM array and said display device when said SLM array and said display device are operating, and wherein said SLM array comprises an array of high-speed SLMs operable to refresh at a faster rate than a flicker fusion threshold for a human eye.

19. The method of claim 18, wherein said target image simulated by said near-eye light field is in focus to an observer'"'"'s eye when said display device and said SLM array are in a near-eye range of said observer'"'"'s eye.

20. The method of claim 18, wherein said SLM array is operable to project anisotropic light by altering isotropic light produced by said display device.

21. The method of claim 18, wherein said determining is based on aberrations of said observer'"'"'s eye, a gaze of said observer'"'"'s eye, and a distance between said observer'"'"'s eye and said SLM array.

22. The method of claim 18, wherein said SLM array is operable to display different versions of said target image in different directions.

23. The method of claim 18, wherein said SLM array comprises a plurality of SLM array layers.

26. The method of claim 18, further wherein regions of said display device and said SLM array are operable to switch between transparent, semi-transparent, and opaque modes of operation.