Near-eye microlens array displays

• US 9,841,537 B2
• Filed: 12/19/2012
• Issued: 12/12/2017
• Est. Priority Date: 07/02/2012
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Luebke, David Patrick, Lanman, Douglas, Fox, Thomas F., Slavenburg, Gerrit
• Primary Examiner(s): PINKNEY, DAWAYNE
• Application Number:
  US13/720,809
• Publication Number:
  US 20140168783A1
• Time in Patent Office: 1,819 Days
• Field of Search: 359618, 359626, 359621, 359443, 359454, 359455, 359630-634, 359 13- 14, 345 7, 345 9, 264 11, 264 132, 264 27, 457162, 457164, 457165, 457226, 457227, 457554, 457553, 457555, 353 11- 12, 353 28, 353119, 349 11, 310 49 R, 31015632, 31015633, 31015634, 31015635, 310266-268, 31015602, 340438, 340980, 3409951, 34081547, 34081574
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 3/0006 Arrays G02B3/02, G02B5/188 take precedence

Abstract

In embodiments of the invention, an apparatus may include a display comprising a plurality of pixels and a computer system coupled with the display and operable to instruct the display to display images. The apparatus may further include a microlens array located adjacent to the display and comprising a plurality of microlenses, wherein the microlens array is operable to produce a light field by altering light emitted by the display to simulate an object that is in focus to an observer while the display and the microlens array are located within a near-eye range of the observer.

Claims

1. An apparatus comprising:

a display comprising a plurality of pixels, said plurality of pixels comprising a first group of pixels and a second group of pixels operable to isotropically and omnidirectionally emit a first plurality of rays and a second plurality of rays, respectively;

a computer system coupled with said display and operable to instruct said display to display images; and

a microlens array comprising a plurality of microlenses operable to switch between a plurality of operating modes, said micro lens array being located adjacent to said display and, operable to produce a light field display by altering light emitted by said display to simulate an object that is in focus to an observer while said display and said microlens array are located within a near-eye range of said observer,

wherein said first plurality of rays is received by a first microlens of said microlens array and aligned by said first microlens in a plurality of first directions in parallel based on a location of said first group of pixels relative to said first microlens,

further wherein said second plurality of rays is received by a second microlens of said microlens array and aligned by said second microlens in a plurality of second directions in parallel based on a location of said second group of pixels relative to said second microlens.

2. The apparatus of claim 1, further comprising a plurality of groups of pixels in said plurality of pixels, wherein each microlens of said plurality of microlenses corresponds to a group of pixels in said plurality of groups of pixels.

3. The apparatus of claim 2, wherein each microlens is operable to alter light from each pixel in a group of pixels corresponding to said each microlens.

4. The apparatus of claim 1, wherein said microlens array is operable to project anisotropic light by altering isotropic light produced by said display.

5. The apparatus of claim 1, wherein said light field is operable to simulate a 3D object located beyond said near-eye range of said observer.

6. The apparatus of claim 1, wherein said computer system is operable to determine an image for display that counteracts aberrations of said observer'"'"'s eye.

7. The apparatus of claim 1, further comprising a feedback system operable to make measurements of aberrations of said observer'"'"'s eye;

and wherein said computer system is further operable to determine an image for display that counteracts said aberrations based on said measurements.

8. The apparatus of claim 1, further comprising:

a sensor operable to provide information related to a surrounding environment; and

wherein said computer system is further operable to determine an image for display that counteracts said aberrations based on said information.

9. The apparatus of claim 1, further comprising an eye-track adjustment system operable to track a gaze of an eye, wherein said eye-track adjustment system is operable to communicate information related to a gaze of an eye to said computer system for determination of an image for display by said computer system based on said information.

10. The apparatus of claim 1, wherein said plurality of microlenses are operable to electro-optically switch between a transparent and opaque state.

11. The apparatus of claim 1, wherein said display comprises a plurality of sub-displays disposed side by side to one another.

12. The apparatus of claim 1, wherein said microlens array comprises at least one microlens from the group consisting of:

a liquid crystal microlens; and

a birefringent optics microlens.

13. The apparatus of claim 1, wherein said microlens array is configured to alternate between a transparent mode and an opaque mode.

14. The apparatus of claim 1, wherein said microlens array is further configured to switch between said plurality of operating modes comprising a transparent mode and a opaque mode, said plurality of operating modes comprising at least one operating mode from the group of operating modes consisting of:

a spatial-multiplexing of said transparent mode and said opaque mode;

a spatial-combination of said transparent mode and said opaque mode; and

a temporal modulation of said transparent mode and said opaque mode.

15. The apparatus of claim 1, wherein said apparatus comprises a plurality of separate microlens arrays in front of at least one eye of said observer operable to achieve binocular viewing for said observer.

16. The apparatus of claim 1, wherein said apparatus comprises a plurality of displays in front of at least one eye of said observer operable to achieve binocular viewing for said observer.

17. An apparatus comprising:

a display operable to produce an image and comprising a plurality of pixels, said plurality of pixels operable to emit a plurality of rays isotropically and omnidirectionally; and

a microlens array located adjacent to said display and operable to switch between a plurality of operating modes, said microlens array together with said display being operable to produce a light field display simulating a 3D object that is recognizable to an observer while said display and said microlens array are located within a near-eye range of said observer,

wherein a first plurality of rays emitted from a first group of pixels of said display is received by a first microlens of said microlens array and aligned by said first microlens in a plurality of first directions in parallel based on a location of said first group of pixels relative to said first microlens, wherein a second plurality of rays emitted from a second group of pixels of said display is received by a second microlens of said microlens array and aligned by said second microlens in a plurality of second directions in parallel based on a location of said second group of pixels relative to said second microlens.

18. The apparatus of claim 17, wherein said image is out of focus if viewed without said microlens array and said image is in focus if viewed through said microlens array.

19. The apparatus of claim 17, wherein said microlens array is operable to display different versions, of an image produced by said display, in different directions.

20. The apparatus of claim 17, wherein said microlens array is operable to cover a portion of a view of said observer less than said observer'"'"'s entire view.

21. The apparatus of claim 17, wherein said microlens array and said display are operable to provide a virtual reality experience.

22. The apparatus of claim 17, wherein said display is semi-transparent.

23. The apparatus of claim 17, wherein said display is an LCD or OLED.

24. A method comprising:

determining a pre-filtered image to be displayed, wherein said pre-filtered image corresponds to a target image;

displaying said pre-filtered image on a display; and

producing a near-eye light field after said pre-filtered image travels through a microlens array operable to switch between a plurality of operating modes and adjacent to said display,

wherein said near-eye light field is operable to simulate a light field corresponding to said target image, wherein a first plurality of rays emitted isotropically and omnidirectionally from a first group of pixels of said display is received by a first microlens and aligned by said first microlens in a plurality of first directions in parallel based on a location of said first group of pixels relative to said first microlens,

wherein a second plurality of rays emitted isotropically and omnidirectionally from a second group of pixels of said display is received by a second microlens and aligned by said second microlens in a plurality of second directions in parallel based on a location of said second group of pixels relative to said second microlens, wherein said second group of pixels projects rays to said second microlens.

25. The method of claim 24, wherein said target image simulated by said near-eye light field is in focus to an observer'"'"'s eye when said display and said microlens array are in a near-eye range of said observer'"'"'s eye.

26. The method of claim 24, wherein said microlens array is operable to project anisotropic light by altering isotropic light produced by said display.

27. The method of claim 24, wherein said determining is executed by a computer system based on aberrations of said observer'"'"'s eye, a gaze of said observer'"'"'s eye, and a distance between said observer'"'"'s eye and said microlens array.

28. The method of claim 24, wherein said microlens array is operable to display different versions of said target image in different directions.

29. The method of claim 24, wherein said microlens array and said display are operable to provide a virtual reality experience.