SYSTEMS, DEVICES, AND METHODS FOR WEARABLE HEADS-UP DISPLAYS WITH HETEROGENEOUS DISPLAY QUALITY

• US 20160274365A1
• Filed: 03/15/2016
• Published: 09/22/2016
• Est. Priority Date: 03/17/2015
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Thalmic Labs Inc.
• Inventors: Bailey, Matthew, Alexander, Stefan
• Application Number:
  US15/070,887
• Publication Number:
  US 20160274365A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G09G 3/02 by tracing or scanning a light beam on a screen

Abstract

Systems, devices, and methods are described for wearable heads-up displays (“WHUDs”) that provide virtual content with heterogeneous display quality. The WHUDs display virtual content with relatively high quality in a region of interest of the user'"'"'s field of view (“FOV”) and with relatively lower quality in regions of the user'"'"'s FOV that are outside of the region of interest. The region of interest may align with a foveal region of the user'"'"'s FOV at which the user'"'"'s visual acuity is maximal. By limiting display quality for peripheral regions of the virtual content at which the typical user is not able to focus, graphical processing power and/or WHUD battery power are conserved. As a result, a smaller battery and/or smaller other components may be used and the form factor of the WHUD may be reduced. A sensor may be employed to determine the region of interest in the user'"'"'s FOV.

Claims

1. A wearable heads-up display comprising:

a support structure that in use is worn on a head of a user;

a projector carried by the support structure;

a processor communicatively coupled to the projector; and

a non-transitory processor-readable storage medium communicatively coupled to the processor, wherein the non-transitory processor-readable storage medium stores processor-executable virtual content control instructions that, when executed by the processor, cause the wearable heads-up display to;

determine a region of interest in a field of view of the user;

project virtual content with a first quality level with respect to a first display parameter in the region of interest; and

project virtual content with a second quality level with respect to the first display parameter outside of the region of interest, wherein the first quality level is higher than the second quality level.

2. The wearable heads-up display of claim 1 wherein the region of interest in the field of view of the user includes a foveal region of the field of view of the user.

3. The wearable heads-up display of claim 2, further comprising:

a fovea tracker carried by the support structure, positioned and oriented to determine a position of a fovea of an eye of the user, wherein the fovea tracker is communicatively coupled to the processor, and wherein the processor-executable virtual content control instructions that, when executed by the processor, cause the wearable heads-up display to determine a region of interest in a field of view of the user, cause the wearable heads-up display to determine the foveal region of the field of view of the user based on the position of the fovea of the eye of the user determined by the fovea tracker.

4. The wearable heads-up display of claim 1, further comprising:

an eye tracker carried by the support structure, positioned and oriented to determine a gaze direction of an eye of the user, wherein the eye tracker is communicatively coupled to the processor, and wherein the processor-executable virtual content control instructions that, when executed by the processor, cause the wearable heads-up display to determine a region of interest in a field of view of the user, cause the wearable heads-up display to determine a region of interest in the field of view of the user based on the gaze direction of the eye of the user determined by the eye tracker.

5. The wearable heads-up display of claim 4 wherein the region of interest in the field of view of the user includes a foveal region of the field of view of the user, and wherein the foveal region of the field of view of the user is determined by the wearable heads-up display based on the gaze direction of the eye of the user determined by the eye tracker.

6. The wearable heads-up display of claim 1 wherein the first display parameter is selected from a group consisting of:

a resolution of virtual content projected by the projector and a brightness of virtual content projected by the projector.

7. The wearable heads-up display of claim 1 wherein the projector includes at least one projector selected from a group consisting of:

a scanning laser projector and a digital light processing-based projector.

8. The wearable heads-up display of claim 1, further comprising:

a holographic combiner carried by the support structure, wherein the holographic combiner is positioned within a field of view of an eye of the user when the support structure is worn on the head of the user.

9. The wearable heads-up display of claim 8, further comprising:

a prescription eyeglass lens, wherein the holographic combiner is carried by the prescription eyeglass lens.

10. The wearable heads-up display of claim 1 wherein the support structure has a general shape and appearance of an eyeglasses frame.

11. The wearable heads-up display of claim 1, further comprising:

a virtual content control system, wherein both the processor and the non-transitory processor-readable storage medium are included in the virtual content control system.

12. A method of operating a wearable heads-up display to display virtual content with non-uniform quality, the wearable heads-up display including a projector and the method comprising:

determining a region of interest in a field of view of a user of the wearable heads-up display;

projecting, by the projector, virtual content with a first quality level with respect to a first display parameter in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second quality level with respect to the first display parameter in regions of the field of view of the user that are outside of the region of interest, wherein the first quality level is higher than the second quality level.

13. The method of claim 12 wherein determining a region of interest in a field of view of a user of the wearable heads-up display includes determining a foveal region in the field of view of the user.

14. The method of claim 13 wherein the wearable heads-up display includes a fovea tracker and the method further comprises:

determining a position of a fovea of an eye of the user by the fovea tracker, and wherein determining a foveal region in the field of view of the user includes determining the foveal region of the field of view of the user based on the position of the fovea of the eye of the user determined by the fovea tracker.

15. The method of claim 12 wherein the wearable heads-up display includes an eye tracker and the method further comprises:

determining a gaze direction of an eye of the user by the eye tracker, and wherein determining a region of interest in a field of view of a user of the wearable heads-up display includes determining the region of interest in the field of view of the user based on the gaze direction of the eye of the user determined by the eye tracker.

16. The method of claim 12 wherein:

projecting, by the projector, virtual content with a first quality level with respect to a first display parameter in the region of interest of the field of view of the user includes projecting, by the projector, virtual content with a first brightness level in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second quality level with respect to the first display parameter in regions of the field of view of the user that are outside of the region of interest includes projecting, by the projector, virtual content with a second brightness level in regions of the field of view of the user that are outside of the region of interest, wherein the first brightness level is brighter than the second brightness level.

17. The method of claim 12 wherein:

projecting, by the projector, virtual content with a first quality level with respect to a first display parameter in the region of interest of the field of view of the user includes projecting, by the projector, virtual content with a first resolution in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second quality level with respect to the first display parameter in regions of the field of view of the user that are outside of the region of interest includes projecting, by the projector, virtual content with a second resolution in regions of the field of view of the user that are outside of the region of interest, wherein the first resolution is a higher resolution than the second resolution.

18. The method of claim 17 wherein:

projecting, by the projector, virtual content with a first resolution in the region of interest of the field of view of the user includes projecting, by the projector, virtual content with a first light modulation frequency in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second resolution in regions of the field of view of the user that are outside of the region of interest includes projecting, by the projector, virtual content with a second light modulation frequency in regions of the field of view of the user that are outside of the region of interest, wherein the first light modulation frequency is greater than the second light modulation frequency.

19. The method of claim 17 wherein:

projecting, by the projector, virtual content with a first resolution in the region of interest of the field of view of the user includes scanning, by the projector, virtual content with a first scanning step size in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second resolution in regions of the field of view of the user that are outside of the region of interest includes projecting, by the projector, virtual content with a second scanning step size in regions of the field of view of the user that are outside of the region of interest, wherein the first scanning step size is smaller than the second scanning step size.

20. The method of claim 12 wherein the wearable heads-up display includes a processor and a non-transitory processor-readable storage medium communicatively coupled to the processor and which stores processor-executable virtual content control instructions, and wherein:

determining a region of interest in a field of view of a user of the wearable heads-up display includes executing the processor-executable virtual content control instructions by the processor to cause the wearable heads-up display to determine the region of interest in the field of view of the user;

projecting, by the projector, virtual content with a first quality level with respect to a first display parameter in the region of interest of the field of view of the user includes executing the processor-executable virtual content control instructions by the processor to cause the projector to project virtual content with the first quality level with respect to the first display parameter in the region of interest of the field of view of the user; and

projecting, by the projector, virtual content with a second quality level with respect to the first display parameter in regions of the field of view of the user that are outside of the region of interest includes executing the processor-executable virtual content control instructions by the processor to cause the projector to project virtual content with the second quality level with respect to the first display parameter in regions of the field of view of the user that are outside of the region of interest.