System and method for foveated image generation using an optical combiner

• US 10,481,684 B2
• Filed: 11/16/2017
• Issued: 11/19/2019
• Est. Priority Date: 12/09/2016
• Status: Active Grant

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Lopes, Ward, Aksit, Kaan
• Primary Examiner(s): Collins, Darryl J
• Assistant Examiner(s): Sumlar, Journey F
• Application Number:
  US15/815,485
• Publication Number:
  US 20180164592A1
• Time in Patent Office: 733 Days
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0105 Holograms with particular structures
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0103 comprising holographic elements
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

A method, computer readable medium, and system are disclosed for generating foveal images. The method includes the steps of redirecting first light rays towards an eye, where the first light rays are redirected by an optical combiner and produce a peripheral image and generating second light rays by a light engine. The second light rays are redirected towards the eye, where the second light rays intersect a first region of the optical combiner and converge at a nodal point within the eye and produce an inset foveal image positioned within at least a portion of the peripheral image. An origin of the second light rays is offset to intersect a second region of the optical combiner in response to a change in a gaze direction of the eye.

Claims

1. A display system, comprising:

an optical combiner configured to;

redirect a first set of light rays towards an eye, wherein the redirected first set of light rays produce a peripheral image; and

redirect a second set of light rays towards the eye, wherein the redirected second light rays produce an inset foveal image positioned within at least a portion of the peripheral image; and

a light engine configured to generate the second set of light rays to intersect a first region of the optical combiner and converge at a nodal point within 1 mm of a rotational center the eye and, in response to a change in a gaze direction of the eye, to offset an origin of the second set of light rays to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner.

2. The display system of claim 1, wherein the offset comprises a lateral shift of the light engine.

3. The display system of claim 1, wherein the redirected first set of light rays converge at a second nodal point within the eye.

4. The display system of claim 3, wherein the second nodal point is on a retina of the eye.

5. The display system of claim 3, wherein the second nodal point is between the nodal point and a pupil of the eye.

6. The display system of claim 1, wherein the redirected first set of light rays converge at the nodal point.

7. The display system of claim 1, wherein the optical combiner comprises a single-layer holographic optical element configured to redirect the first and second sets of light rays and transmit other light rays.

8. The display system of claim 1, wherein the optical combiner comprises a holographic optical element having a first layer configured to redirect the first set of light rays and transmit other light rays and a second layer configured to redirect the second set of light rays and transmit the first set of light rays and the other light rays.

9. The display system of claim 1, wherein the light engine comprises a single projector configured to output the first set of light rays during a first duration of time and output the second set of light rays during a second duration of time that does not overlap with the first duration of time.

10. The display system of claim 1, wherein the light engine comprises a first projector configured to output the first set of light rays and a second projector configured to output the second set of light rays.

11. The display system of claim 1, the nodal point is the rotational center of the eye.

12. The display system of claim 1, wherein the redirected first set of light rays converge at a second nodal point within the eye and the peripheral image appears at a different distance from the eye compared with the inset foveal image.

13. The display system of claim 12, wherein the optical combiner is further configured to redirect the first set of light rays from a first region centered at a first point and redirect the second set of light rays from a second region centered at a second point that is within 8 mm of the first point.

14. The display system of claim 1, wherein the redirected first set of light rays are within a first pre-determined wavelength range associated with a first color channel and converge at a second nodal point within the eye and the redirected second set of light rays are within a second pre-determined wavelength range associated with the first color channel.

15. The display system of claim 1, where the first set of light rays are a first wavelength and the second set of light rays are a second wavelength.

16. A computer-implemented method, comprising:

redirecting a first set of light rays towards an eye, wherein the first set of light rays are redirected by an optical combiner and produce a peripheral image;

generating a second set of light rays by a light engine to intersect a first region of the optical combiner;

redirecting the second set of light rays towards the eye, wherein the second set of light rays converge at a nodal point within 1 mm of a rotational center the eye and produce an inset foveal image positioned within at least a portion of the peripheral image; and

offsetting an origin of the second set of light rays by the light engine to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner in response to a change in a gaze direction of the eye.

17. The computer-implemented method of claim 16, wherein the offset comprises a lateral shift of the light engine.

18. The computer-implemented method of claim 16, wherein the redirected first set of light rays converge at a second nodal point within the eye.

19. The computer-implemented method of claim 16, wherein the redirected first set of light rays converge at the nodal point.

20. A non-transitory, computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform steps comprising:

redirecting a first set of light rays towards an eye, wherein the first set of light rays are redirected by an optical combiner and produce a peripheral image;

generating a second set of light rays by a light engine to intersect a first region of the optical combiner;

redirecting the second set of light rays towards the eye, wherein the second set of light rays converge at a nodal point within 1 mm of a rotational center of the eye and produce an inset foveal image positioned within at least a portion of the peripheral image; and

offsetting an origin of the second set of light rays by the light engine to move the intersection of the second set of light rays with the optical combiner from the first region to a second region of the optical combiner in response to a change in a gaze direction of the eye.