See-through display brightness control

• US 8,752,963 B2
• Filed: 11/04/2011
• Issued: 06/17/2014
• Est. Priority Date: 11/04/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: McCulloch, Daniel J., Hastings, Ryan L., Geisner, Kevin A., Crocco, Robert L., Balan, Alexandru O., Knee, Derek L., Scavezze, Michael J., Latta, Stephen G., Mount, Brian J.
• Primary Examiner(s): MAI, HUY KIM
• Application Number:
  US13/289,980
• Publication Number:
  US 20130114043A1
• Time in Patent Office: 956 Days
• Field of Search: 351/44, 351/158, 351/204, 351/209, 351/210
• US Class Current: 351/209
• CPC Class Codes: A61B 3/112 for measuring diameter of pupils
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G02C 7/104 having spectral characteristics for purposes other than sun-protection
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

The technology provides various embodiments for controlling brightness of a see-through, near-eye mixed display device based on light intensity of what the user is gazing at. The opacity of the display can be altered, such that external light is reduced if the wearer is looking at a bright object. The wearer'"'"'s pupil size may be determined and used to adjust the brightness used to display images, as well as the opacity of the display. A suitable balance between opacity and brightness used to display images may be determined that allows real and virtual objects to be seen clearly, while not causing damage or discomfort to the wearer'"'"'s eyes.

Claims

1. A method comprising:

estimating a region at which a wearer of a see-through display is gazing using an eye-tracking camera;

determining light intensity of the region at which the user is gazing; and

adjusting brightness of the see-through display based on the light intensity of the region.

2. The method of claim 1, wherein the adjusting brightness of the see-through display based on the light intensity of the region includes:

adjusting the opacity of the see-through display.

3. The method of claim 1, wherein the adjusting brightness of the see-through display based on the light intensity of the region includes:

adjusting the intensity of light projected by the see-through display.

4. The method of claim 1, further comprising:

determining a pupil size of the wearer, the adjusting brightness of the see-through display based on the light intensity of the region is further based on the pupil size of the wearer.

5. The method of claim 4, wherein the determining a pupil size of the wearer is performed using 3D imaging.

6. The method of claim 1, further comprising:

determining a distance between the wearer'"'"'s eyes and the see-through display based on 3D imaging, the adjusting brightness of the see-through display based is further based on the distance.

7. The method of claim 1, wherein the adjusting brightness of the see-through display is further based on context, the context including one or more of aspects of the wearer'"'"'s environment, the type of content, or the format of content being presented on the see-through display.

8. The method of claim 1, further comprising:

determining a baseline dilation response of the wearer, the adjusting brightness of the see-through display is further based on the baseline dilation response of the wearer.

9. A display system comprising:

a see-through, near-eye display device including a respective display optical system for each eye positioned to be seen through by the respective eye;

an image generation unit for each eye attached to the see-through display device for generating at least one virtual image for display in the display optical system;

a respective arrangement of gaze detection elements positioned on the display device;

logic coupled to the gaze detection elements, the logic determines a gaze estimation for a wearer of the see-through display device, the logic accesses brightness data for a field of view of the system, the logic determines light intensity of a region in the field of view being gazed at, the logic adjusts brightness of the see-through display device based on light intensity of the region.

10. The display system of claim 9, wherein the logic adjusts the opacity of the see-through display based on the light intensity of the region.

11. The display system of claim 9, wherein the logic adjusts the brightness of light projected by the see-through display based on the light intensity of the region.

12. The display system of claim 9, wherein the logic determines a pupil size of the wearer, the logic adjusts brightness of the see-through display based on the light intensity of the region and based on the pupil size of the wearer.

13. The display system of claim 12, further comprising a 3D imaging device that collects data for determining the pupil size of the wearer.

14. The display system of claim 12, wherein the logic determines a distance between the wearer'"'"'s eyes and the see-through display based on 3D imaging data, the adjusting the brightness of the see-through display is further based on the distance.

15. The display system of claim 9, wherein the logic determines a pupil size of the wearer, the logic adjusts opacity of the see-through display based on the pupil size of the wearer.

16. A method comprising:

tracking a field of view of a wearer of a see-through display using a first camera;

determining a gaze vector for at least one eye of the wearer using a second camera;

identifying a brightness of a region in the field of view at which the wearer is gazing based on the tracking and the gaze vector;

determining pupil size of the wearer; and

adjusting brightness of the see-through display based on the light intensity of the region and the pupil size.

17. The method of claim 16, wherein the adjusting brightness of the see-through display includes:

adjusting opacity of the see-through display.

18. The method of claim 17, wherein the adjusting brightness of the see-through display further includes:

adjusting brightness of light projected by the see-through display.

19. The method of claim 18, further comprising:

determining a distance between the wearer'"'"'s eyes and the see-through display using 3D imaging, the adjusting brightness of the see-through display based is further based on the distance.

20. The method of claim 16, further comprising:

determining a baseline dilation response of the wearer, the adjusting brightness of the see-through display is further based on the baseline dilation response of the wearer.