Near-eye display device and methods with coaxial eye imaging

• US 9,958,680 B2
• Filed: 09/29/2015
• Issued: 05/01/2018
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Original Assignee: Omnivision Technologies Incorporated (Will Semiconductor Co., Ltd. Shanghai)
• Inventors: Liu, Yi-Wei, Deng, Jau-Jan, Fan, Regis
• Primary Examiner(s): FLORES, ROBERTO W
• Application Number:
  US14/869,067
• Publication Number:
  US 20160091722A1
• Time in Patent Office: 945 Days
• Field of Search: 359 13, 359618-640, 359614, 345 7- 9, 348115
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/141 using dichroic mirrors
• CPC Class Codes: G02B 27/283 used for beam splitting or combining
• CPC Class Codes: G02B 5/12 Reflex reflectors
• CPC Class Codes: G02B 5/3083 Birefringent or phase retarding elements G02B5/3008, G02B5/3016 take precedence; systems for polarisation control G02B27/286; manufacturing phase modulating patterns by lithographic processes G03F7/001
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/56 provided with illuminating means

Abstract

A near-eye display device, with coaxial eye imaging, for mounting in field of view of an eye of a user, includes a display unit for displaying a display image, a viewing unit for (i) presenting the display image to the eye based upon polarized visible light received from the display unit and (ii) transmitting ambient light from an ambient scene toward the eye, and an eye imaging unit including (a) an illumination module for generating infrared light, (b) a first polarizing beamsplitter interface, disposed between the display unit and the viewing unit, for (i) merging a polarized infrared component of the infrared light with the polarized visible light and (ii) separating from the polarized visible light a portion of the polarized infrared component reflected by the eye, and (c) a camera for forming an image of the eye based upon the polarized infrared component reflected by the eye.

Claims

1. A near-eye display device, with coaxial eye imaging, for mounting in field of view of an eye of a user, comprising:

a display unit for displaying a display image;

a viewing unit for (i) presenting the display image to the eye based upon polarized visible light received from the display unit and (ii) transmitting ambient light from an ambient scene toward the eye; and

an eye imaging unit including

an illumination module for generating infrared light,

a first polarizing beamsplitter interface, disposed between the display unit and the viewing unit, for (i) merging a polarized infrared component of the infrared light with the polarized visible light and (ii) separating from the polarized visible light a portion of the polarized infrared component reflected by the eye, and

a camera for forming an image of the eye based upon the portion;

wherein the viewing unit includes;

an imaging objective for focusing the polarized visible light to present the display image to the eye,

a second polarizing beam splitter interface configured for (i) transmitting the polarized visible light received from the display unit and (ii) reflecting toward the ambient scene the polarized infrared component received from the first polarizing beamsplitter interface,

an infrared-band mirror disposed between the second polarizing beamsplitter interface and the ambient scene for retro-reflecting the polarized infrared component reflected toward the ambient scene by the second polarizing beamsplitter interface, and

an infrared-band quarter-wave plate for rotating polarization of the polarized infrared component to form, in cooperation with the infrared-band mirror, orthogonally polarized infrared light to be transmitted by the second polarizing beamsplitter interface toward the eye.

2. The near-eye display device of claim 1, the first polarizing beamsplitter interface being configured to transmit the polarized visible light and reflect the polarized infrared component.

3. The near-eye display device of claim 2, the display unit being configured to emit the polarized visible light as p-polarized visible light, the first polarizing beamsplitter interface being configured to produce, by reflection, the polarized infrared component as s-polarized infrared light.

4. The near-eye display device of claim 1,

the imaging objective being a reflective imaging objective;

and

the viewing unit further including

a visible-band quarter-wave plate disposed between the second polarizing beamsplitter interface and the imaging objective for rotating polarization of the polarized visible light to form, in cooperation with the imaging objective, orthogonally polarized visible light to be reflected by the second polarizing beamsplitter interface toward the eye.

5. The near-eye display device of claim 1, comprising:

a first beamsplitter cube implementing the first polarizing beamsplitter interface and having a first face facing the viewing unit;

a second beamsplitter cube implementing the second polarizing beamsplitter interface and having a second face facing the first face; and

a solid light tunnel having (i) a first planar surface bonded to the first face and (ii) a second planar surface bonded to the second face.

6. The near-eye display device of claim 5, the illumination module and the camera being implemented in a package that is directly mounted to at least one of the first beamsplitter cube and the solid light tunnel.

7. The near-eye display device of claim 5, the display unit comprising:

a display; and

a third beamsplitter cube having

a third polarizing beamsplitter interface for transmitting the polarized visible light from the display toward the viewing unit, and

a third face bonded to a fourth face of the first beamsplitter cube, the fourth face opposite the first face.

8. The near-eye display device of claim 1, the display unit comprising:

a liquid-crystal-on-silicon display for displaying the display by generating the polarized visible light from polarized visible illumination light;

an illumination module for generating visible illumination light including the polarized illumination light; and

a third polarizing beam splitter interface for (i) reflecting, from the visible illumination light, only the polarized visible illumination light toward the liquid-crystal-on-silicon display and (ii) transmitting the polarized visible light from the liquid-crystal-on-silicon display.

9. The near-eye display device of claim 1, the imaging unit further comprising a control module, communicatively coupled with the illumination module, for activating the illumination module for a finite duration to illuminate the eye with at least a portion of the infrared light during the finite duration.

10. The near-eye display device of claim 9, the control module further being communicatively coupled with the camera and configured to induce capture of the image of the eye during the finite duration.

11. A method for performing coaxial eye imaging in a near-eye display device for mounting in field of view of an eye of a user, comprising:

using a first polarizing beamsplitter interface to merge polarized infrared light with polarized visible display light from a display;

using a second polarizing beamsplitter interface to superimpose the polarized infrared light and the polarized visible light on ambient light from an ambient scene to (a) illuminate the eye with the polarized infrared light, (b) present an image of the display to the eye, and (c) allow the eye to view the ambient scene, said using a second polarizing beamsplitter interface including;

using the second polarizing beamsplitter interface to reflect toward the ambient scene the polarized infrared light received from the first polarizing beamsplitter interface,

retro-reflecting and rotating polarization of the polarized infrared light to produce orthogonally polarized infrared light, and

transmitting the orthogonally polarized infrared light through the second polarizing beamsplitter interface toward the eye to illuminate the eye; and

imaging the eye through the second polarizing beamsplitter interface and the first polarizing beamsplitter interface based upon a portion of the polarized infrared light reflected by the eye.

12. The method of claim 11, the step of imaging comprising:

separating the portion of the polarized infrared light reflected by the eye from the ambient light using the second polarizing beamsplitter interface; and

separating the portion of the polarized infrared light reflected by the eye from the polarized visible light using the first polarizing beamsplitter interface.

13. The method of claim 11, the step of retro-reflecting and rotating polarization comprising:

passing the polarized infrared light, reflected toward the scene by the second polarizing beamsplitter interface, through an infrared-band quarter-wave plate to rotate polarization of the polarized infrared light;

retro-reflecting on an infrared-band mirror the polarized infrared light passed through the infrared-band quarter-wave plate; and

passing the polarized infrared light, retro-reflected by the infrared-band mirror, through the infrared-band quarter-wave plate to further rotate the polarized infrared light so as to produce the orthogonally polarized infrared light.

14. The method of claim 11, further comprising:

transmitting through the second polarizing beamsplitter interface the polarized visible light received from the first polarizing beamsplitter interface;

retro-reflecting and rotating polarization of the polarized visible light transmitted by the second polarizing beamsplitter interface to produce orthogonally polarized visible light; and

using the second polarizing beamsplitter interface to reflect the orthogonally polarized visible light toward the eye to present the image of the display to the eye.

15. The method of claim 14, the step of retro-reflecting and rotating polarization comprising retro-reflecting the polarized visible light on a curved mirror surface to present to the eye the image of the display as a virtual image located at a distance from the eye greater than light propagation distance from the display to the eye.

16. The method of claim 11, further comprising:

generating infrared light using an illumination module mechanically coupled with at least one of (a) a first beamsplitter cube implementing the first polarizing beamsplitter interface and (b) a light tunnel connecting the first beamsplitter cube with a second beamsplitter cube implementing the second polarizing beamsplitter interface; and

reflecting only one polarization component of the infrared light on the first polarizing beamsplitter interface to produce the polarized infrared light.

17. The method of claim 16, the step of imaging comprising imaging the eye using a camera mechanically coupled with at least one of the first beamsplitter cube and the light tunnel.

18. The method of claim 16, further comprising:

generating visible illumination light;

using a third polarizing beamsplitter interface to reflect only a first polarization component of the visible illumination light toward the display to illuminate the display with polarized visible illumination light;

based upon the visible illumination light and settings of the display, emitting first visible display light from the display toward the third polarizing beamsplitter interface; and

transmitting only a second polarization component, orthogonal to the first polarization component, of the first visible light through the third polarizing beamsplitter interface and the first polarizing beamsplitter interface toward the second polarizing beamsplitter interface.