SELECTIVE OCCLUSION SYSTEM FOR AUGMENTED REALITY DEVICES

• US 20160247319A1
• Filed: 02/20/2015
• Published: 08/25/2016
• Est. Priority Date: 02/20/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Nowatzyk, Andreas G., Pritchett, Joel, Fleck, Rod G.
• Granted Patent: US 11,468,639 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02F 1/133528 Polarisers
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Examples are disclosed that relate to selectively dimming or occluding light from a real-world background to enhance the display of virtual objects on a near-eye display. One example provides a near-eye display system including a see-through display, an image source, a background light sensor, a selective background occluder comprising a first liquid crystal panel and a second liquid crystal panel positioned between a pair of polarizers, and a computing device including instructions executable by a logic subsystem to determine a shape and a position of an occlusion area based upon a virtual object to be displayed, obtain a first and a second birefringence pattern for the first and the second liquid crystal panels, produce the occlusion area by applying the birefringence patterns to the liquid crystal panels, and display the virtual object in a location visually overlapping with the occlusion area.

Claims

1. A near-eye display system, comprising:

a see-through display;

an image source configured to produce images for display on the see-through display;

a background light sensor configured to sense a brightness of a real-world background;

a selective background occluder comprising a first liquid crystal panel and a second liquid crystal panel spaced from the first liquid crystal panel, the first liquid crystal panel and the second liquid crystal panel being positioned between a common pair of polarizers; and

a computing device comprising a logic subsystem and a storage subsystem storing instructions executable by the logic subsystem to;

determine a shape and a position of an occlusion area based upon a virtual object to be displayed on the see-through display,

obtain a first birefringence pattern for the first liquid crystal panel and a second birefringence pattern for the second liquid crystal panel based upon the shape and the position of the occlusion area,

produce the occlusion area by applying the first birefringence pattern to the first liquid crystal panel and the second birefringence pattern to the second liquid crystal pattern, and

display the virtual object in a location visually overlapping with the occlusion area.

2. The near-eye display system of claim 1, wherein the instructions are further executable by the logic subsystem to obtain the first and second birefringence patterns by segmenting a perimeter of the occlusion area into perimeter segments, obtaining birefringence patterns for each of the perimeter segments, and constructing the first and second birefringence patterns from the birefringence patterns for the perimeter segments.

3. The near-eye display system of claim 1, wherein the instructions are further executable by the logic subsystem to obtain the first and second birefringence patterns by obtaining a birefringence pattern for an overall shape of the occlusion area.

4. The near-eye display system of claim 1, wherein the background light sensor comprises an image sensor configured to acquire an image of the real-world background, and wherein the instructions are further executable by the logic subsystem to determine the shape and the position of the occlusion area by determining the shape and the position based at least partially on one or more brightness features in the image of the real-world background.

5. The near-eye display system of claim 1, further comprising a gaze-tracking subsystem, and wherein the instructions are further executable by the logic subsystem to track a gaze position of a user'"'"'s eye via the gaze-tracking subsystem, and to determine the position of the occlusion area by determining the position based upon the gaze position.

6. The near-eye display system of claim 5, wherein the instructions are further executable by the logic subsystem to control a focus distance of the occlusion area by scaling the second birefringence pattern for the second liquid crystal panel based upon one or more of depth information and the gaze position.

7. The near-eye display system of claim 1, wherein the instructions are further executable by the logic subsystem to modify the first birefringence pattern on the first liquid crystal panel and modify the second birefringence pattern on the second liquid crystal panel to move the position of the occlusion area based upon a detected change in relative position of the virtual object and the real-world background.

8. The near-eye display system of claim 1, further comprising a third liquid crystal panel positioned between the common pair of polarizers, and wherein the instructions are further executable by the logic subsystem to obtain a third birefringence pattern for the third liquid crystal panel.

9. The near-eye display system of claim 1, wherein the first liquid crystal panel and the second liquid crystal panel each comprises a passive-matrix liquid crystal panel.

10. On a near-eye display system comprising a see-through display and a selective background occluder comprising a first liquid crystal panel and a second liquid crystal panel positioned between a common pair of polarizers, a method of selectively dimming light from one or more areas of a real-world background, the method comprising:

determining a shape and a position of an occlusion area based upon a virtual object to be displayed on the see-through display;

obtaining a first birefringence pattern for the first liquid crystal panel and a second birefringence pattern for the second liquid crystal panel based upon the shape and the position of the occlusion area;

producing the occlusion area by applying the first birefringence pattern to the first liquid crystal panel and the second birefringence pattern to the second liquid crystal pattern, and

displaying the virtual object in a location visually overlapping with the occlusion area.

11. The method of claim 10, wherein obtaining the first birefringence pattern and the second birefringence pattern comprises segmenting a perimeter of the occlusion area into perimeter segments, obtaining birefringence patterns for the perimeter segments, and constructing the first and second birefringence patterns from the birefringence patterns for the perimeter segments.

12. The method of claim 10, wherein obtaining the first and second birefringence patterns comprises obtaining a birefringence pattern for an overall shape of the occlusion area.

13. The method of claim 10, further comprising modifying the first birefringence pattern on the first liquid crystal panel and modifying the second birefringence pattern on the second liquid crystal panel to move the position of the occlusion area based upon a detected change in relative position of the virtual object and the real-world background.

14. The method of claim 10, wherein determining the shape and the position of the occlusion area comprises acquiring an image of the real-world background and determining the shape and the position based at least partially on one or more brightness features in the image of the real-world background.

15. The method of claim 10, further comprising tracking a gaze position of a user'"'"'s eye, and wherein determining the position of the occlusion area further comprises determining the position based upon the gaze position.

16. The method of claim 15, further comprising controlling a focus distance of the occlusion area by scaling the second birefringence pattern for the second liquid crystal panel based upon one or more of depth information and the gaze position.

17. The method of claim 10, wherein the selective background occluder comprises a third liquid crystal panel positioned between the common pair of polarizers, and further comprising obtaining a third birefringence pattern for the third liquid crystal panel.

18. A near-eye display system, comprising:

a see-through display;

an image source configured to produce images for display on the see-through display;

a background light sensor configured to sense a brightness of a real-world background;

a selective background occluder comprising a first liquid crystal panel and a second liquid crystal panel spaced from the first liquid crystal panel, the first liquid crystal panel and the second liquid crystal panel being positioned between a common pair of polarizers; and

a computing device comprising a logic subsystem and a storage subsystem storing instructions executable by the logic subsystem to

determine a shape of an occlusion area based upon a virtual object to be displayed via the see-through display, and

operate the first liquid crystal panel and the second liquid crystal panel such that light passing through a first pixel of the first liquid crystal panel and a first pixel of the second liquid crystal panel is attenuated differently than light passing through the first pixel of the first liquid crystal panel and a second pixel of the second liquid crystal panel.

19. The near-eye display system of claim 18, wherein the background light sensor comprises an image sensor configured to acquire an image of the real-world background, and wherein the instructions are further executable by the logic subsystem to determine the shape and the position of the occlusion area by determining the shape and the position based at least partially on one or more brightness features in the image of the real-world background.

20. The near-eye display system of claim 19, wherein the instructions are further executable by the logic subsystem to operate the first liquid crystal panel and the second liquid crystal panel by applying a first birefringence pattern to the first liquid crystal panel and a second birefringence pattern to the second liquid crystal panel based upon the shape and the position of the occlusion area.