NEAR-TO-EYE DISPLAY HAVING ADAPTIVE OPTICS

• US 20150077312A1
• Filed: 05/13/2011
• Published: 03/19/2015
• Est. Priority Date: 05/13/2011
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Wang, Chia-Jean
• Application Number:
  US13/107,812
• Publication Number:
  US 20150077312A1
• Time in Patent Office: Days
• US Class Current: 345/7
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/02 by tracing or scanning a light beam on a screen

Abstract

An optical apparatus includes a light source, a deformable mirror, an actuator system, and a partially transparent mirror. The deformable mirror is positioned in an optical path of the image output from the light source. The actuator system is coupled to the deformable mirror to selectively adjust at least a curvature of the deformable mirror. The partially transparent mirror is positioned to be in front of the eye of the user when the optical apparatus is worn and optically aligned with the deformable mirror such that the image output from the light source positioned peripherally to the eye is reflected by the deformable mirror to the partially transparent mirror and reflected by the partially transparent mirror to the eye of the user.

Claims

1. An optical apparatus, comprising:

an light source to output an image for display to an eye of a user;

a single continuous deformable mirror surface positioned in an optical path of the image output from the light source;

an actuator system coupled to the single continuous deformable mirror surface to selectively adjust at least a curvature of the single continuous deformable mirror surface;

a partially transparent mirror positioned to be in front of the eye of the user when the optical apparatus is worn and optically aligned with the single continuous deformable mirror surface such that the image output from the light source positioned peripherally to the eye is reflected by the single continuous deformable mirror surface to the partially transparent mirror and reflected by the partially transparent mirror to the eye of the user; and

a computer generated image (“

CGI”

) engine including a pre-distortion engine, the CGI engine coupled to drive the light source with the image being pre-distorted to dynamically compensate for optical distortion due to real-time adjustments in the curvature of the single continuous deformable mirror made in response to eye movements.

2. The optical apparatus of claim 1, wherein the single continuous deformable mirror surface and the partially transparent mirror are positioned relative to each other such that a focal point of the single continuous deformable mirror surface falls at or within a focal distance of the partially transparent mirror from the partially transparent mirror.

3. The optical apparatus of claim 2, wherein the single continuous deformable mirror surface comprises a reflective membrane.

4. The optical apparatus of claim 3, wherein the first actuator system comprises:

a platform; and

an array of pistons disposed across the platform, wherein the reflective membrane is disposed across distal ends of the pistons such that height adjustments to individual pistons change the curvature of the single continuous deformable mirror surface.

5. The optical apparatus of claim 4, wherein the pistons comprise electrostatically activated pistons, the optical apparatus further comprising:

a piston controller coupled to selectively activate individual electrostatically activated pistons to dynamically control the curvature of the single continuous deformable mirror surface.

6. The optical apparatus of claim 5, further comprising:

a gaze tracking camera optically aligned to capture real-time eye images of the eye when the optical apparatus is worn by the user; and

a gaze tracking controller coupled to receive the eye images from the gaze tracking camera, coupled to analyze the eye images to determine a gazing direction, and coupled to the piston controller to provide a feedback control signal to the piston controller to dynamically adjust a position of the image displayed to the eye based upon the gazing direction of the eye.

7. The optical apparatus of claim 6, wherein the pre-distortion engine is coupled to the gaze tracking controller to dynamically adjust pre-distortion applied to the image based upon the gazing direction of the eye.

8. The optical apparatus of claim 4, wherein the global angle actuator system further comprises:

a global angle actuator coupled to the platform to rotate the single continuous deformable mirror surface about at least one axis; and

a global angle controller coupled to dynamically control at least one rotational angle of the single continuous deformable mirror surface.

9. The optical apparatus of claim 8, further comprising:

a gaze tracking camera optically aligned to capture real-time eye images of the eye; and

a gaze tracking controller coupled to receive the eye images from the gaze tracking camera, coupled to analyze the eye images to determine a gazing direction of the eye in real-time, and coupled to the global angle controller to provide a feedback control signal to the global angle controller to adjust the at least one rotational angle of the single continuous deformable mirror surface based upon the gazing direction to dynamically translate a location of the image displayed to the eye to track eye movement.

22. The optical apparatus of claim 1, wherein the actuator system includes a first actuator system that adjusts the curvature of the single continuous deformable mirror surface and a global angle actuator system coupled to rotate the single continuous deformable mirror surface about at least one axis without changing the curvature of the single continuous deformable mirror surface.

10. A head mounted display (“

HMD”

) for displaying an image to a user, the head mounted display comprising;

a near-to-eye optical system including;

an light source to output the image for display to an eye of the user when the HMD is worn by the user;

a single continuous deformable mirror surface positioned in an optical path of the image output from the light source;

an actuator system coupled to the single continuous deformable mirror surface to selectively adjust at least a curvature of the single continuous deformable mirror surface;

a partially transparent eyeglass lens positioned in front of the eye when the HMD is worn and optically aligned with the single continuous deformable mirror surface such that the image output from the light source positioned peripherally to the eye is reflected by the single continuous deformable mirror surface to the eyeglass lens and reflected by the eyeglass lens to the eye; and

a computer generated image (“

CGI”

) engine including a pre-distortion engine, the CGI engine coupled to drive the light source with the image being pre-distorted to dynamically compensate for optical distortion due to real-time adjustments in the curvature of the single continuous deformable mirror made in response to eye movements; and

a frame assembly to support the near-to-eye optical system for wearing on a head of the user with the eyeglass lens positioned in front of the eye of the user.

11. The HMD of claim 10, wherein the single continuous deformable mirror surface and the eyeglass lens are positioned relative to each other such that a focal point of the single continuous deformable mirror surface falls at or within a focal distance of the eyeglass lens from the eyeglass lens.

12. The HMD of claim 11, wherein the first actuator system comprises:

a platform;

an array of pistons disposed across the platform, wherein the single continuous deformable mirror surface is disposed across distal ends of the pistons such that height adjustments to individual pistons changes the curvature of the single continuous deformable mirror surface, wherein the pistons comprise electrostatically activated pistons; and

a piston controller coupled to selectively activate individual electrostatically activated pistons to dynamically control the curvature of the single continuous deformable mirror surface.

13. The HMD of claim 12, further comprising:

a gaze tracking camera optically aligned to capture real-time eye images of the eye; and

a gaze tracking controller coupled to receive the eye images from the gaze tracking camera, coupled to analyze the eye images to determine a gazing direction, and coupled to the piston controller to provide a feedback control signal to the piston controller to dynamically adjust a position of the image displayed to the eye based upon the gazing direction of the eye.

14. The HMD of claim 13, wherein the pre-distortion engine is coupled to the gaze tracking controller to dynamically adjust pre-distortion applied to the image based upon the gazing direction of the eye.

15. The HMD of claim 12, wherein the global angle actuator system further comprises:

a global angle actuator coupled to the platform to rotate the single continuous deformable mirror surface about at least one axis; and

a global angle controller coupled to dynamically control at least one rotational angle of the single continuous deformable mirror surface.

16. A method of providing an augmented reality with a head mounted display, the method comprising:

generating an image at a peripheral location to an eye of a user;

transporting the image from the peripheral location to be in front of the eye with a single continuous deformable mirror surface and a partially transparent mirror;

adjusting a curvature of the single continuous deformable mirror surface with an array of electrostatically activated pistons upon which the single continuous deformable mirror surface is disposed;

passing external scene light through the partially transparent mirror to the eye of the user such that the image is combined with the external scene light received at the eye;

capturing a gazing image of the user eye while displaying the image to the eye;

analyzing the gazing image to determine a gazing direction in real-time while displaying the image to the eye;

adjusting, in real-time, displacements of the array of electrostatically activated pistons in response to the determined gazing direction to deform the single continuous deformable mirror surface and track eye movement with the image thereby improving a field of view associated with the head mounted display; and

pre-distorting the image to dynamically compensate for image distortion imparted in real-time by the single continuous deformable mirror surface in response to movements of the eye.

17. The method of claim 16, wherein adjusting the curvature of the single continuous deformable mirror surface comprises adjusting the curvature in real-time to provide a virtual zoom to the image during operation of the head mounted display.

19. The method of claim 16, further comprising:

adjusting the pre-distorting of the image in real-time to compensate for deformation adjustments to the single continuous deformable mirror surface while tracking the eye movement.

20. The method of claim 16, further comprising:

capturing a gazing image of the user eye while displaying the image to the eye; and

analyzing the gazing image to determine a gazing direction while displaying the image to the eye,

wherein adjusting the global rotational angle of the single continuous deformable mirror surface comprises adjusting the global rotational angle of the single continuous deformable mirror surface in response to the determined gazing direction to translate a position of the image displayed to the eye and to track eye movement with the image.

18. (canceled)

21. (canceled)