Mixed reality spotlight

• US 9,652,892 B2
• Filed: 10/29/2013
• Issued: 05/16/2017
• Est. Priority Date: 10/29/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hastings, Ryan, Amador-Leon, Ron, Fajt, Nicholas Gervase, Kaplan, Matthew G., McCulloch, Daniel, Scavezze, Michael, Tomlin, Arthur, Ambrus, Tony
• Primary Examiner(s): Thompson, James A
• Application Number:
  US14/066,442
• Publication Number:
  US 20150116354A1
• Time in Patent Office: 1,295 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/60 Shadow generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Various embodiments relating to creating a virtual shadow of an object in an image displayed with a see-through display are provided. In one embodiment, an image of a virtual object may be displayed with the see-through display. The virtual object may appear in front of a real-world background when viewed through the see-through display. A relative brightness of the real-world background around a virtual shadow of the virtual object may be increased when viewed through the see-through display. The virtual shadow may appear to result from a spotlight that is fixed relative to a vantage point of the see-through display.

Claims

1. A method of operating a see-through display including a plurality of at least partially transparent pixels, the method comprising:

displaying an image of a virtual object with an object subset of the plurality of at least partially transparent pixels by directing additive image light to a user eye via the object subset of the plurality of at least partially transparent pixels such that the virtual object appears in front of a real-world background when viewed through the see-through display; and

creating an illusion of a virtual shadow with a shadow subset and a neighboring background subset of the plurality of at least partially transparent pixels by not directing additive image light to the user eye via the shadow subset while directing additive image light to the user eye via the neighboring background subset in a vignette pattern displayed with greater brightness adjacent the virtual shadow and displayed with decreasing brightness away from the virtual shadow such that the virtual shadow appears to result from a spotlight that is fixed relative to a vantage point of the see-through display.

2. The method of claim 1, wherein the spotlight is vertically offset from the vantage point and a perspective of the spotlight is angled downward relative to a perspective of the vantage point.

3. The method of claim 1, wherein additive image light is directed to the user eye via an unshadowed subset of the plurality of at least partially transparent pixels that includes all at least partially transparent pixels not included in the shadow subset.

4. The method of claim 1, wherein a relative brightness of the at least partially transparent pixels in the neighboring background subset decreases with increasing closeness of the at least partially transparent pixels of the neighboring background subset to a perimeter of the see-through display.

5. The method of claim 1, further comprising:

blocking ambient light from reaching the user eye via the shadow subset.

6. The method of claim 1, wherein directing additive image light to the user eye via the neighboring background subset includes modulating the additive image light to match colors of the real-world background.

7. A method of operating a see-through display, the method comprising:

displaying an image of a virtual object such that the virtual object appears in front of a real-world background when viewed through the see-through display; and

increasing a relative brightness of the real-world background by directing additive image light from the see-through display to a user eye in a vignette pattern around a virtual shadow of the virtual object when viewed through the see-through display without directing additive image light from the display to the virtual shadow, the vignette pattern displayed with greater brightness adjacent the virtual shadow and displayed with decreasing brightness away from the virtual shadow.

8. The method of claim 7, wherein the relative brightness decreases with increasing closeness to a perimeter of the see-through display.

9. The method of claim 7, wherein the virtual shadow appears to result from a spotlight that is fixed relative to a vantage point of the see-through display.

10. The method of claim 9, wherein the spotlight is vertically offset from the vantage point and a perspective of the spotlight is angled downward relative to a perspective of the vantage point.

11. The method of claim 7, wherein the relative brightness is increased over an entirety of unshadowed portions of the real-world background.

12. The method of claim 7, wherein the see-through display does not increase a brightness of the virtual shadow.

13. The method of claim 7, further comprising:

increasing the relative brightness of the real-world background with display light corresponding to colors of the real-world background.

14. A head-mounted display system, comprising:

a see-through display;

an image production system configured to display an image on the see-through display;

a first image sensor configured to detect a vantage point of the see-through display;

a logic machine; and

a storage machine holding instructions executable by the logic machine to;

determine the vantage point of the see-through display;

display an image of a virtual object such that the virtual object appears in front of a real-world background when viewed through the see-through display; and

increase a relative brightness of the real-world background by directing additive image light from the see-through display to a user eye in a vignette pattern around a virtual shadow of the virtual object when viewed through the see-through display without directing additive image light from the display to the virtual shadow, the vignette pattern displayed with greater brightness adjacent the virtual shadow and displayed with decreasing brightness away from the virtual shadow such that the virtual shadow appears to result from a spotlight that is fixed relative to the vantage point of the see-through display.

15. The head-mounted display system of claim 14, wherein the relative brightness decreases with increasing closeness to a perimeter of the see-through display.

16. The head-mounted display system of claim 14, wherein the spotlight is vertically offset from the vantage point and a perspective of the spotlight is angled downward relative to a perspective of the vantage point.