DIRECT VIEW AUGMENTED REALITY EYEGLASS-TYPE DISPLAY

• US 20130286053A1
• Filed: 12/19/2012
• Published: 10/31/2013
• Est. Priority Date: 04/25/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Fleck, Rod G., Nowatzyk, Andreas G., Bennett, John G.
• Application Number:
  US13/720,905
• Publication Number:
  US 20130286053A1
• Time in Patent Office: Days
• US Class Current: 345/690
• CPC Class Codes: G02B 2027/0163 Electric or electronic control thereof
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G03B 21/20 Lamp housings
• CPC Class Codes: G09G 3/3208 organic, e.g. using organic light-emitting diodes [OLED]
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

A low-power, high-resolution, see-through (i.e., “transparent”) augmented reality (AR) display without projectors with relay optics separate from the display surface but instead feature a small size, low power consumption, and/or high quality images (high contrast ratio). The AR display comprises sparse integrated light-emitting diode (iLED) array configurations, transparent drive solutions, and polarizing optics or time multiplexed lenses to combine virtual iLED projection images with a user'"'"'s real world view. The AR display may also feature full eye-tracking support in order to selectively utilize only the portions of the display(s) that will produce only projection light that will enter the user'"'"'s eye(s) (based on the position of the user'"'"'s eyes at any given moment of time) in order to achieve power conservation.

Claims

1. A transparent light-field projector (LFP) device for providing an augmented reality display, the device comprising:

a transparent solid-state LED array (SLEA) comprising a plurality of integrated light-emitting diodes (iLEDs);

a micro-array (MA) placed at a separation distance from the SLEA, the MA comprising a plurality of either microlenses or micro-mirrors; and

a processor communicatively coupled to the SLEA and adapted to;

identify a target pixel for rendering on the retina of a human eye,

determine at least one iLED from among the plurality of iLEDs for displaying the pixel,

move the at least one iLED to a best-fit pixel location relative to the MA and corresponding to the target pixel, and

cause the iLED to emit a primary beam of a specific intensity for a specific duration.

2. The device of claim 1, wherein the iLEDs comprising the SLEA utilize a random pattern arrangement for a spacing offset between iLEDs in the iLED array.

3. The device of claim 1, wherein the MA utilizes at least one from among the group comprising a time-domain multiplexing, a wavelength multiplexing, and a polarization multiplexing.

4. The device of claim 1, wherein the SLEA only emits light in a limited range of the visible spectrum and the MA only distorts light in the limited range of the visible spectrum and does not distort light that is not in the limited range of the visible spectrum.

5. The device of claim 1, further comprising a polarizer component, wherein real world light passing through the device is polarized in a first direction and iLED-emitted light is polarized in a second direction opposite the first direction.

6. The device of claim 5, where the polarizer component utilizes a Dual Brightness Enhancement Film (DBEF).

7. The device of claim 1, further adapted to correct for imperfect vision of a user of the LFP.

8. The device of claim 1, wherein a diameter and a focal length of each microlens among the plurality of either microlenses or micro-mirrors comprising the MA is sized to permit no more than one beam from each LED comprising the SLEA to enter the human eye.

9. The device of claim 1, wherein a pixel projected onto the retina of the human eye comprises primary beams from multiple LEDs from among the plurality of LEDs.

10. The device of claim 1, wherein the plurality of LEDs are multiplexed to time-sequentially produce an effect of a larger number of static LEDs.

11. The device of claim 1, wherein the separation distance is equal to a focal length for a corresponding microlens in the MA to enable the MA to collimate light emitted from the SLEA.

12. The device of claim 1, wherein the processor is further adapted to add focus cues to a generated light field.

13. A method for multiplexing a plurality of integrated light-emitting diodes (iLEDs) in a light-field projector (LFP) comprising a transparent solid-state LED array (SLEA) having a plurality of iLEDs and a micro-array (MA) having a plurality of either microlenses or micro-mirrors placed at a separation distance from the SLEA, the method comprising:

arranging a plurality of iLEDs to achieve overlapping orbits;

identifying a best-fit pixel for each target pixel;

orbiting the iLEDs; and

emitting a primary beam to at least partially render a pixel on a retina of an eye of a user when an LED is located at a best-fit pixel location for a target pixel that is to be rendered.

14. The method of claim 13, wherein the MA and the SLEA use the same pattern.

15. The method of claim 13, wherein the arranging results in a hexagonal arrangement of the plurality of iLEDs.

16. The method of claim 13, wherein the arranging is performed to achieve a 15×

pitch ratio to achieve a 721;

1 multiplexing ratio.

17. The method of claim 13, wherein the orbiting follows a 3:

5 Lissajous trajectory.

18. A computer-readable medium comprising computer-readable instructions for a light-field projector (LFP) comprising a transparent solid-state LED array (SLEA) having a plurality of integrated light-emitting diodes (iLEDs) and a micro-array (MA) having a plurality of either microlenses or micro-mirrors placed at a separation distance from the SLEA, the computer-readable instructions comprising instructions that cause a processor to:

identify a plurality of target pixels for rendering on the retina of a human eye,

calculate the subset of iLEDs from among the plurality of iLEDs to be used for displaying the pixel,

multiplexing the plurality of iLEDs, and

cause each iLED among the subset of iLEDs to emit a primary beam of a specific intensity for a specific duration in accordance with best-fit pixel location relative to the MA and corresponding to the target pixel.

19. The computer-readable medium of claim 18, further comprising instructions for causing the processor to add finite focus cues to the rendered image.

20. The computer-readable medium of claim 18, further comprising instructions for sensing the position of each rendered beam on the retina of the eye from the light that is reflected back towards the SLEA.