AUTO-STEREOSCOPIC AUGMENTED REALITY DISPLAY

• US 20140176528A1
• Filed: 12/20/2012
• Published: 06/26/2014
• Est. Priority Date: 12/20/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Robbins, Steven John
• Granted Patent: US 10,192,358 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0103 comprising holographic elements
• CPC Class Codes: G02B 30/26 of the autostereoscopic type
• CPC Class Codes: G02B 5/1828 having means for producing variable diffraction controlling the direction of light by means of one or more diffracting elements G02B26/0808; acousto-optical elements G02F1/11, G02F1/33; electro- or magneto-optical diffraction G02F1/292, G02F1/2955
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays
• CPC Class Codes: H04N 13/371 for tracking viewers with different interocular distances; for tracking rotational head movements around the vertical axis
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

In embodiments of an auto-stereoscopic augmented reality display, the display device is implemented with an imaging structure that includes a waveguide for see-through viewing of an environment. The waveguide also transmits light of a virtual image that is generated as a near-display object to appear at a distance in the environment. The imaging structure includes switchable diffractive elements that are integrated in the waveguide and configured in display zones. The switchable diffractive elements are switchable to independently activate the display zones effective to correct for an accurate stereopsis view of the virtual image that appears at the distance in the environment.

Claims

1. An imaging structure, comprising:

a waveguide configured for see-through viewing of an environment, the waveguide further configured to transmit light of a virtual image that is generated as a near-display object to appear at a distance in the environment; and

switchable diffractive elements integrated in the waveguide and configured in display zones, the switchable diffractive elements switchable to independently activate the display zones effective to correct for an accurate stereopsis view of the virtual image that appears at the distance in the environment.

2. An imaging structure as recited in claim 1, wherein a representation of the virtual image is displayable in a first display zone for user viewing with a right eye, and a different representation of the virtual image is displayable in a second display zone for the user viewing with a left eye.

3. An imaging structure as recited in claim 1, further comprising an element drive circuit that is controllable to selectively activate the switchable diffractive elements in respective ones of the display zones to project the virtual image for display.

4. An imaging structure as recited in claim 1, wherein the switchable diffractive elements in a display zone are configured for activation based on a user eye distance from the imaging structure and viewing angles of a right eye and a left eye to a center of the imaging structure.

5. An imaging structure as recited in claim 1, wherein the switchable diffractive elements are configured in sets of stacked elements, and each switchable diffractive element in a set of stacked elements is configured to diffract the light of the virtual image in a different field of view.

6. An imaging structure as recited in claim 5, wherein the different fields of view projected by each of the switchable diffractive elements in the set of stacked elements combine for a sequential field of view that spans an activated display zone.

7. An imaging structure as recited in claim 1, wherein the switchable diffractive elements comprise Switchable Bragg Gratings.

8. A computing device, comprising:

an imaging system configured to generate a virtual image for display;

a display device configured as an auto-stereoscopic augmented reality display to display the virtual image as a near-display object that appears at a distance in an environment that is viewable through the display device; and

a processing system to implement an imaging controller that is configured to control activation of switchable diffractive elements configured in display zones of the display device, the display zones of the display device independently controllable effective to correct for an accurate stereopsis view of the virtual image that appears at the distance in the environment.

9. A computing device as recited in claim 8, wherein the display device is configured to display a representation of the virtual image in a first display zone for user viewing with a right eye, and display a different representation of the virtual image in a second display zone for the user viewing with a left eye.

10. A computing device as recited in claim 8, further comprising:

a camera configured to capture digital images of left and right eyes of a user of the computing device; and

an eye-tracking system configured to track pupil positions of the left and right eyes based on the digital images.

11. A computing device as recited in claim 10, wherein the eye-tracking system is further configured to:

determine a distance from the left and right eyes to the display device; and

determine viewing angles of the left and right eyes to a center of the display device.

12. A computing device as recited in claim 11, wherein the imaging controller is configured to control activation of the switchable diffractive elements in a display zone based on the pupil positions of the left and right eyes, the distance from the left and right eyes to the display device, and the viewing angles of the left and right eyes to the center of the display device.

13. A computing device as recited in claim 8, further comprising an element drive circuit configured to selectively activate the switchable diffractive elements in the display zones of the display device based on imaging controller inputs.

14. A computing device as recited in claim 8, wherein the switchable diffractive elements are configured in sets of stacked elements integrated in the display device, and each switchable diffractive element in a set of stacked elements is configured to diffract light of the virtual image in a different field of view.

15. A computing device as recited in claim 14, wherein the different fields of view projected by each of the switchable diffractive elements in the set of stacked elements combine for a sequential field of view that spans an activated display zone.

16. A computing device as recited in claim 8, wherein the switchable diffractive elements comprise Switchable Bragg Gratings.

17. A method, comprising:

generating a virtual image for display on a display device;

displaying the virtual image as a near-display object that appears at a distance in an environment that is viewable through the display device; and

controlling activation of switchable diffractive elements configured in display zones of the display device, the display zones of the display device independently controllable effective to correct for an accurate stereopsis view of the virtual image that appears at the distance in the environment.

18. A method as recited in claim 17, further comprising:

tracking pupil positions of left and right eyes of a user based on digital images that capture user eye position;

determining a distance from the left and right eyes to the display device; and

determining viewing angles of the left and right eyes to a center of the display device.

19. A method as recited in claim 18, wherein activation of the switchable diffractive elements in a display zone is controlled based on the pupil positions of the left and right eyes, the distance from the left and right eyes to the display device, and the viewing angles of the left and right eyes to the center of the display device.

20. A method as recited in claim 17, further comprising:

generating a sequential field of view that spans an activated display zone, the sequential field of view said generated from a combination of different fields of view that are each projected by respective switchable diffractive elements in sets of stacked elements.