SYSTEMS, DEVICES, AND METHODS FOR EYEBOX EXPANSION IN WEARABLE HEADS-UP DISPLAYS

• US 20160238845A1
• Filed: 02/17/2016
• Published: 08/18/2016
• Est. Priority Date: 02/17/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Thalmic Labs Inc.
• Inventors: Morrison, Vance R., Holland, Lloyd Frederick, Alexander, Stefan, Bailey, Matthew
• Granted Patent: US 10,191,283 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0125 Field-of-view increase by wavefront division
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 26/10 Scanning systems
• CPC Class Codes: G02B 27/0081 with means for altering, e.g. enlarging, the entrance or exit pupil
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/12 operating by refraction only
• CPC Class Codes: G03H 1/2645 Multiplexing processes, e.g. aperture, shift, or wavefront multiplexing
• CPC Class Codes: G03H 1/265 Angle multiplexing; Multichannel holograms G03H1/268 takes precedence
• CPC Class Codes: G03H 2001/266 Wavelength multiplexing
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

Systems, devices, and methods for eyebox expansion by exit pupil replication in wearable heads-up displays (“WHUDs”) are described. A WHUD includes a scanning laser projector (“SLP”), a holographic combiner, and an exit pupil selector positioned in the optical path therebetween. The exit pupil selector is controllably switchable into and between N different configurations. In each of the N configurations, the exit pupil selector receives a light signal from the SLP and redirects the light signal towards the holographic combiner effectively from a respective one of N virtual positions for the SLP. The holographic combiner converges the light signal to a particular one of N exit pupils at the eye of the user based on the particular virtual position from which the light signal is made to effectively originate. In this way, multiple instances of the exit pupil are distributed over the eye and the eyebox of the WHUD is expanded.

Claims

1. A wearable heads-up display comprising:

a support structure that in use is worn on a head of a user;

a scanning laser projector carried by the support structure;

a holographic combiner carried by the support structure, wherein the holographic combiner is positioned within a field of view of an eye of the user when the support structure is worn on the head of the user; and

an exit pupil selector carried by the support structure and positioned in an optical path between the scanning laser projector and the holographic combiner, the exit pupil selector controllably switchable into and between respective ones of N different configurations, where N is an integer greater than 1, wherein in each one of the N different configurations the exit pupil selector is positioned and oriented to receive at least one light signal generated by the scanning laser projector and redirect the at least one light signal towards the holographic combiner effectively from a respective one of N spatially-separated virtual positions for the scanning laser projector, and wherein the holographic combiner comprises at least one hologram positioned and oriented to redirect light signals received from the exit pupil selector towards the eye of the user.

2. The wearable heads-up display of claim 1 wherein the exit pupil selector is controllably switchable into and between respective ones of the N different configurations by at least one form of movement selected from a group consisting of:

a translation of at least one optical element of the exit pupil selector, a rotation of at least one optical element of the exit pupil selector, and a displacement of at least one optical element of the exit pupil selector.

3. The wearable heads-up display of claim 1 wherein the exit pupil selector comprises at least one dynamic optical element selected from a group consisting of:

at least one microelectromechanical systems (“

MEMS”

) based optical element and at least one piezo-based optical element.

4. The wearable heads-up display of claim 1 wherein the support structure has a general shape and appearance of an eyeglasses frame.

5. The wearable heads-up display of claim 4, further comprising:

a prescription eyeglass lens, wherein the holographic combiner is carried by the prescription eyeglass lens.

6. The wearable heads-up display of claim 1 wherein for each one of the N different configurations of the exit pupil selector, the at least one hologram of the holographic combiner converges light signals received from the exit pupil selector to a respective one of N exit pupils at or proximate the eye of the user.

7. The wearable heads-up display of claim 6 wherein the holographic combiner includes at least N multiplexed holograms, and wherein for each one of the N different configurations of the exit pupil selector, a respective one of the at least N multiplexed holograms converges light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user.

8. The wearable heads-up display of claim 6 wherein:

the scanning laser projector includes a red laser diode, a green laser diode, and a blue laser diode; and

the holographic combiner includes a wavelength-multiplexed holographic combiner that includes at least one red hologram, at least one green hologram, and at least one blue hologram, and wherein for each one of the N different configurations of the exit pupil selector;

the at least one red hologram converges a red component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user, the at least one green hologram converges a green component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user, and the at least one blue hologram converges a blue component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user.

9. The wearable heads-up display of claim 8 wherein the holographic combiner includes a wavelength-multiplexed and angle-multiplexed holographic combiner that includes at least N angle-multiplexed red holograms, at least N angle-multiplexed green holograms, and at least N angle-multiplexed blue holograms, and wherein for each one of the N different configurations of the exit pupil selector:

a respective one of the at least N angle-multiplexed red holograms converges a red component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user, a respective one of the at least N angle-multiplexed green holograms converges a green component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user, and a respective one of the at least N angle-multiplexed blue holograms converges a blue component of light signals received from the exit pupil selector to a respective one of the N exit pupils at or proximate the eye of the user.

10. The wearable heads-up display of claim 1 wherein the optical path between the scanning laser projector and the holographic combiner includes a total scan range θ

of the scanning laser projector, and wherein for each one of the N different configurations of the exit pupil selector, the exit pupil selector is positioned and oriented to receive all light signals corresponding to a sweep of the total scan range θ

by the scanning laser projector and redirect all light signals corresponding to the sweep of the total scan range θ

of the scanning laser projector towards the holographic combiner effectively from a respective one of the N spatially-separated virtual positions for the scanning laser projector.

11. The wearable heads-up display of claim 1 wherein the at least one light signal includes an image comprising at least two pixels.

12. The wearable heads-up display of claim 11 wherein in each one of the N different configurations the exit pupil selector is positioned and oriented to receive a respective instance of the image generated by the scanning laser projector and redirect the respective instance of the image towards the holographic combiner effectively from a respective one of the N spatially-separated virtual positions for the scanning laser projector, and wherein at least one hologram of the holographic combiner is positioned and oriented to redirect each instance of the image received from the exit pupil selector towards the eye of the user.

13. The wearable heads-up display of claim 1 wherein in each one of the N different configurations the exit pupil selector is positioned and oriented to receive a respective instance of a same pixel in a different instance of a same image generated by the scanning laser projector and redirect the respective instance of the same pixel in the different instance of the same image towards the holographic combiner effectively from a respective one of the N spatially-separated virtual positions for the scanning laser projector, and wherein at least one hologram of the holographic combiner is positioned and oriented to redirect each instance of the same pixel in the different instance of the same image received from the exit pupil selector towards the eye of the user.

14. The wearable heads-up display of claim 1, further comprising an eye tracker carried by the support structure, positioned and oriented to determine a gaze direction of the eye of the user, wherein the exit pupil selector is controllably switchable into and between respective ones of the N different configurations based on the gaze direction of the eye of the user determined by the eye tracker.

15. A wearable heads-up display comprising:

a support structure that in use is worn on a head of a user;

a scanning laser projector carried by the support structure;

a holographic combiner carried by the support structure, wherein the holographic combiner is positioned within a field of view of an eye of the user when the support structure is worn on the head of the user; and

an exit pupil selector carried by the support structure and positioned in an optical path between the scanning laser projector and the holographic combiner, the exit pupil selector controllably switchable into and between respective ones of N different configurations, where N is an integer greater than 1, wherein in each one of the N different configurations the exit pupil selector is positioned and oriented to receive at least one light signal generated by the scanning laser projector and redirect the at least one light signal towards the holographic combiner along a respective optical path between the exit pupil selector and the holographic combiner, and wherein the holographic combiner comprises at least one hologram positioned and oriented to redirect light signals received from the exit pupil selector towards the eye of the user.

16. The wearable heads-up display of claim 15 wherein for each one of the N different configurations of the exit pupil selector, the at least one hologram of the holographic combiner converges light signals received from the exit pupil selector to a respective one of N exit pupils at or proximate the eye of the user.

17. A method of operating a wearable heads-up display, the wearable heads-up display including a scanning laser projector, a controllably switchable exit pupil selector, and a holographic combiner positioned within a field of view of an eye of a user when the wearable heads-up display is worn on a head of the user, the method comprising:

generating a first sequence of N instances of a light signal by the scanning laser projector, where N is an integer greater than 1;

controllably switching the exit pupil selector into and between a first sequence of N different configurations;

receiving respective ones of the N instances of the light signal by the exit pupil selector in respective ones of the N different configurations;

redirecting each one of the N instances of the light signal towards the holographic combiner along a respective optical path by the exit pupil selector in respective ones of the N different configurations; and

redirecting respective ones of the N instances of the light signal towards the eye of the user by the holographic combiner.

18. The method of claim 17 wherein controllably switching the exit pupil selector into and between a first sequence of N different configurations includes controllably switching the exit pupil selector into and between respective ones of the N different configurations by at least one form of movement selected from a group consisting of:

translating at least one optical element of the exit pupil selector, rotating at least one optical element of the exit pupil selector, and displacing at least one optical element of the exit pupil selector.

19. The method of claim 17 wherein redirecting respective ones of the N instances of the light signal towards the eye of the user by the holographic combiner includes redirecting respective ones of the N instances of the light signal spatially in parallel with one another towards N respective regions of the eye of the user by the holographic combiner.

20. The method of claim 17 wherein redirecting respective ones of the N instances of the light signal towards the eye of the user by the holographic combiner includes converging respective ones of the N instances of the light signal to respective ones of N exit pupils at or proximate the eye of the user by the holographic combiner.

21. The method of claim 20 wherein the holographic combiner includes at least N multiplexed holograms, and wherein converging respective ones of the N instances of the light signal to respective ones of N exit pupils at or proximate the eye of the user by the holographic combiner includes converging each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by a respective one of the at least N multiplexed holograms.

22. The method of claim 21 wherein:

the scanning laser projector includes a red laser diode, a green laser diode, and a blue laser diode;

the N instances of the light signal generated by the scanning laser projector each include a respective red component, a respective green component, and a respective blue component; and

the holographic combiner includes a wavelength-multiplexed holographic combiner that includes at least one red hologram, at least one green hologram, and at least one blue hologram, and wherein converging each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by a respective one of the at least N multiplexed holograms includes;

converging a respective red component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one red hologram;

converging a respective green component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one green hologram; and

converging a respective blue component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one blue hologram.

23. The method of claim 22 wherein the holographic combiner includes a wavelength-multiplexed and angle-multiplexed holographic combiner that includes at least N angle-multiplexed red holograms, at least N angle-multiplexed green holograms, and at least N angle-multiplexed blue holograms, and wherein:

converging a respective red component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one red hologram includes converging a respective red component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by a respective one of the at least N angle-multiplexed red holograms;

converging a respective green component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one green hologram includes converging a respective green component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by a respective one of the at least N angle-multiplexed green holograms; and

converging a respective blue component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by the at least one blue hologram includes converging a respective blue component of each one of the N instances of the light signal to a respective one of the N exit pupils at or proximate the eye of the user by a respective one of the at least N angle-multiplexed blue holograms.

24. The method of claim 17, further comprising:

generating at least a second sequence of N instances of a light signal by the scanning laser projector;

controllably switching the exit pupil selector into and between at least a second sequence of the N different configurations;

receiving respective ones of the at least a second sequence of N instances of the light signal by the exit pupil selector in respective ones of the N different configurations;

redirecting each light signal in the at least a second sequence of N instances of the light signal towards the holographic combiner along a respective optical path by the exit pupil selector in respective ones of the N different configurations; and

redirecting respective ones of the at least a second sequence of N instances of the light signal towards the eye of the user by the holographic combiner.

25. The method of claim 17 wherein the wearable heads-up display further comprises an eye tracker, the method further comprising:

determining a gaze direction of the eye of the user by the eye tracker;

controllably switching the exit pupil selector into a particular one of the N different configurations based on the gaze direction of the eye of the user determined by the eye tracker; and

redirecting at least one of the N instances of the light signal towards a region of the eye of the user that contains a pupil of the eye of the user by the holographic combiner.

26. The method of claim 17 wherein generating a first sequence of N instances of a light signal by the scanning laser projector includes generating a first sequence of N light signals that each correspond to a respective instance of a same pixel in a different instance of a same image by the scanning laser projector.

27. The method of claim 17 wherein generating a first sequence of N instances of a light signal by the scanning laser projector includes generating a first sequence of N instances of a same image by the scanning laser projector.

28. The method of claim 17 wherein redirecting each one of the N instances of the light signal towards the holographic combiner along a respective optical path by the exit pupil selector in respective ones of the N different configurations includes redirecting respective ones of the N instances of the light signal towards the holographic combiner effectively from respective ones of N spatially-separated virtual positions for the scanning laser projector by the exit pupil selector in respective ones of the N different configurations.

29. A method of operating a wearable heads-up display, the wearable heads-up display including a scanning laser projector, a controllably switchable exit pupil selector, and a holographic combiner positioned within a field of view of an eye of a user when the wearable heads-up display is worn on a head of the user, the method comprising:

generating a first light signal by the scanning laser projector;

controllably switching the exit pupil selector into a first configuration;

receiving the first light signal by the exit pupil selector in the first configuration;

redirecting the first light signal towards the holographic combiner effectively from a first virtual position for the scanning laser projector by the exit pupil selector in the first configuration; and

redirecting the first light signal towards a first exit pupil at the eye of the user by the holographic combiner.

30. The method of claim 29, further comprising:

generating a second light signal by the scanning laser projector;

controllably switching the exit pupil selector into a second configuration;

receiving the second light signal by the exit pupil selector in the second configuration;

redirecting the second light signal towards the holographic combiner effectively from a second virtual position for the scanning laser projector by the exit pupil selector in the second configuration, the second virtual position spatially-separated from the first virtual position; and

redirecting the second light signal towards a second exit pupil at the eye of the user by the holographic combiner, the second exit pupil spatially-separated from the first exit pupil.

31. The method of claim 30 wherein generating a first light signal by the scanning laser projector includes generating a first instance of a light signal by the scanning laser projector and generating a second light signal by the scanning laser projector includes generating a second instance of the light signal by the scanning laser projector.