Optical see-through near-eye display using point light source backlight

• US 10,274,731 B2
• Filed: 12/19/2014
• Issued: 04/30/2019
• Est. Priority Date: 12/19/2013
• Status: Active Grant

• Current Assignee: University of North Carolina At Chapel Hill (University of North Carolina System)
• Original Assignee: University of North Carolina At Chapel Hill (University of North Carolina System)
• Inventors: Maimone, Andrew Stephen
• Primary Examiner(s): Edwards, Carolyn R
• Application Number:
  US15/105,903
• Publication Number:
  US 20160320620A1
• Time in Patent Office: 1,593 Days
• Field of Search: 345 5- 9
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 26/04 by periodically varying the intensity of light, e.g. using choppers shutters, diaphragms for cameras G03B9/00; devices for eliminating or reducing the effect of flicker in projection systems G03B21/40
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G02B 6/0008 the light being emitted at the end of the fibre
• CPC Class Codes: G02B 6/0043 provided on the surface of the light guide
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: G09G 3/3406 Control of illumination source illumination devices structurally associated with liquid crystal cells G02F1/1336
• CPC Class Codes: G09G 3/3611 Control of matrices with row and column drivers
• CPC Class Codes: H04N 9/3182 Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607

Abstract

According to one aspect, the subject matter described herein includes a near-eye optical see-through display. The display includes a backlight layer including a plurality of point light sources. The display further includes a spatial light modulator (SLM) layer for modulating light from the point light sources. The spatial light modulator is located in the optical path between the point light sources and a user'"'"'s eye. The spatial light modulator layer includes pixels that are controllable to modulate light from the point light sources such that the light that impacts the user'"'"'s eye has a desired intensity and color to display a synthetic image. At least a portion of the backlight layer and the spatial light modulator layer are optically transparent to allow a user to view a real scene through the spatial light modulator layer and the backlight layer such that the synthetic image appears to be overlaid on a view of the real scene. Each pixel in the spatial light modulator layer modulates only a portion of the light emanating from the point light sources such that the synthetic image appears to be in focus to the user'"'"'s eye.

Claims

1. A near-eye optical see-through display comprising:

a backlight layer including a plurality of point light sources, wherein the backlight layer comprises a sheet patterned with a sparse array of divots that scatter light through the divots but not between the divots when the sheet is lit from an edge of the sheet to form the point light sources; and

a spatial light modulator (SLM) layer for modulating light from the point light sources, the spatial light modulator layer being located in an optical path between the point light sources and a viewing location at which a user'"'"'s eye is located during use, the spatial light modulator layer including pixels that are controllable to modulate the light from the point light sources such that the light from the point light sources that arrives at the viewing location has a desired intensity and color to display a synthetic image at the viewing location, wherein at least a portion of the backlight layer and at least a portion of the SLM layer are optically transparent to allow a user to view a real scene through the SLM layer and the backlight layer such that the synthetic image appears to be overlaid on a view of real scene, and wherein each pixel in the SLM layer modulates only a portion of the light emanating from the point light sources and arriving at the viewing location such that the synthetic image appears to be in focus when viewed from the viewing location.

2. The display of claim 1 wherein the sheet comprises a waveguide and the divots are etched in the sheet for scattering or redirecting light from the edge of the sheet.

3. The display of claim 1 comprising a shutter located on a scene side of the backlight layer, the shutter being controllable to be closed during a display phase in which the synthetic image is displayed on the backlight layer and open during a see-through phase in which the synthetic image is not displayed on the backlight layer.

4. The display of claim 2 wherein the pixels on the SLM layer are controllable to allow rapid alternation between the display and see-through phases so that the synthetic image will appear to be overlaid on the real scene.

5. The display of claim 1 wherein the SLM layer comprises a liquid crystal display (LCD).

6. The display of claim 1 wherein the SLM layer is spaced from the point light sources such that each pixel on the SLM layer seen over the area of a pupil of the user'"'"'s eye is illuminated by only a single light source.

7. The display of claim 1 comprising an eyeglasses frame, wherein the backlight layer and the SLM layer are mounted to the eyeglasses frame.

8. The display of claim 1 wherein the features form a two-dimensional array of the point light sources that are spaced from each other by a distance that is based on the size of an aperture of a human eye.

9. The display of claim 1 wherein the features are configured to create a tiled display of the synthetic image across a desired field of view of the user.

10. The display of claim 9 wherein the desired field of view is at least about 60°

.

11. The near-eye see-through display of claim 1 comprising:

an eye monitor for tracking changes in eye position and pupil aperture size; and

an illumination and modulation controller for adjusting at least one of the spatial light modulator or illumination of the backlight layer based on the changes in eye position or pupil aperture size.

12. The display of claim 1 comprising an illumination and modulation controller configured to control the spatial light modulator and/or illumination of the backlight layer to display redundant information to account for changes in a viewer'"'"'s eye.

13. The display of claim 1 wherein the spatial light modulator is configured to rotate the synthetic image to account for rotation performed by a user'"'"'s eye.

14. A near-eye optical see-through display comprising:

a display frame for mounting the display near a user'"'"'s eye;

a backlight layer mounted to the display frame and including a two-dimensional array of point light sources, wherein the backlight layer comprises a sheet patterned with a sparse array of divots that scatter light through the divots but not between the divots when the sheet is lit from an edge of the sheet to form the point light sources;

a spatial light modulator layer mounted to the display frame and for modulating light from the point light sources, the spatial light modulator being located in an optical path between the point light sources and a viewing location at which a user'"'"'s eye is located during use, the spatial light modulator layer being controllable to modulate the light from the point light sources to display a synthetic image overlaid on a view of a real scene at the viewing location; and

a modulation and illumination controller for controlling illumination of the backlight layer and modulation performed by the spatial light modulator.

15. The display of claim 14 comprising a sensor for sensing changes in pupil position or size and wherein the modulation and illumination controller is configured to adjust display of the synthetic image based on the changes in pupil position and size.

16. The display of claim 14 wherein the modulation and illumination controller is configured to display redundant information of the synthetic image to account for changes in pupil size and position.

17. The display of claim 14 wherein the modulation and illumination controller is configured to control the spatial light modulator to tile light emanating from the point light sources to produce the synthetic image across the horizontal field of view.

18. The display of claim 14 wherein the sheet comprises a waveguide.

19. The display of claim 14 wherein the point light sources and the spatial light modulator are configured so that each point in the synthetic image reproduced by two or more modulated rays emitted by the spatial light modulator simultaneously enter a pupil of the user'"'"'s eye so that the user receives focal depth cues.