Foveated MEMS scanning display

• US 10,499,021 B2
• Filed: 04/11/2017
• Issued: 12/03/2019
• Est. Priority Date: 04/11/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Tardif, John, Miller, Joshua O
• Primary Examiner(s): Haley, Joseph R
• Assistant Examiner(s): Frank, Emily J
• Application Number:
  US15/485,030
• Publication Number:
  US 20180295331A1
• Time in Patent Office: 966 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 26/105 with one or more pivoting mirrors or galvano-mirrors G02B26/101 takes precedence
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: H04N 9/3135 Driving therefor
• CPC Class Codes: H04N 9/3155 for controlling the light source light source control per se H05B35/00 – H05B47/00; control of an illumination source for displays in general G09G3/3406
• CPC Class Codes: H04N 9/3161 using laser light sources using laser beams scanning the display screen H04N9/3129
• CPC Class Codes: H04N 9/3164 using multiple light sources
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

A scanning display device includes a MEMS scanner, a controller, light source drivers, light sources and an image processor. The controller controls rotation of MEMS mirror(s) of the MEMS scanner. Each light source driver selectively drives a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on a MEMS mirror of the MES scanner. The image processor causes two of the light source drivers to drive two of the light sources to thereby produce two light beams, when a first portion of an image is being raster scanned by the MEMS scanner. The image processor causes only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam, when a second portion of the image is being raster scanned by the MEMS scanner. Related methods and systems are also disclosed.

Claims

1. An apparatus comprising:

a MEMS scanner including a biaxial MEMS mirror or a pair of uniaxial MEMS mirrors;

a controller communicatively coupled to the MEMS scanner and configured to control rotation of the biaxial MEMS mirror or the pair of uniaxial MEMS mirrors of the MEMS scanner;

a plurality of light sources each of which comprises one or more light emitting elements;

a plurality of light source drivers, each of which is configured to selectively drive a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on the biaxial MEMS mirror or one of the pair of uniaxial MEMS mirrors; and

an image processor communicatively coupled to each of the light source drivers and configured to

cause at least two of the light source drivers to drive at least two of the light sources to thereby produce at least two light beams to raster scan, by the MEMS scanner, a first portion of an image; and

cause only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam to raster scan, by the MEMS scanner, a second portion of the image.

2. The apparatus of claim 1, wherein:

the plurality of light sources comprise first, second and third light sources;

the plurality of light source drivers comprise first, second and third light source drivers; and

the image processor is configured to

cause the first light source driver to not drive the first light source, and cause the second and third light source drivers to drive the second and third light sources respectively to thereby produce two light beams, when the first portion of the image is being raster scanned by the MEMS scanner; and

cause the second and third light source drivers to not drive the second and third light sources, and cause the first light source driver to drive the first light source to thereby produce only one light beam, when the second portion of the image is being raster scanned by the MEMS scanner.

3. The apparatus of claim 2, wherein a respective spot size of each of the two light beams, used to raster scan the first portion of the image, is smaller than a spot size of the only one light beam used to raster scan the second portion of the image.

4. The apparatus of claim 1, wherein:

the plurality of light sources comprise first and second light sources;

the plurality of light source drivers comprise first and second light source drivers; and

the image processor is configured to

cause the first and second light source drivers to drive the first and second light sources, respectively, to thereby produce two light beams, when the first portion of the image is being raster scanned by the MEMS scanner; and

cause the second light source driver to not drive the second light source, and cause the first light source driver to drive the first light source to thereby produce only one light beam, when the second portion of the image is being raster scanned by the MEMS scanner.

5. The apparatus of claim 1, wherein:

each of the plurality of light sources comprises red, green and blue laser diodes that are configured to respectively emit red, green and blue light and one or more optical elements that is/are configured to combine the red, green and blue light into a said light beam; and

wherein each of the light source drivers is configured to selectively drive the red, green and blue laser diodes of a respective one of the light sources to thereby selectively drive the respective one of the light sources.

6. The apparatus of claim 1, wherein:

the first portion of the image has a first line density; and

the second portion of the image has a second line density that is lower than the first line density.

7. The apparatus of claim 6, wherein:

the first portion of the image comprises a foveal region of the image; and

the second portion of the image comprises a non-foveal region of the image.

8. The apparatus of claim 1, wherein a location of the first portion of the image is fixed relative to a rest of the image.

9. The apparatus of claim 1, wherein a location of the first portion of the image is dynamic relative to a rest of the image.

10. The apparatus of claim 9, wherein the location of the first portion of the image is based on a gaze of an eye, and changes in response to the gaze changing.

11. A method for use with a MEMS scanner that includes a biaxial MEMS mirror or a pair of uniaxial MEMS mirrors that are used to raster scan an image, the method comprising:

controlling rotation of the biaxial MEMS mirror or the pair of uniaxial MEMS mirrors of the MEMS scanner;

producing at least two light beams that are directed toward and incident on the biaxial MEMS mirror, or one of the pair of uniaxial MEMS mirrors, to raster scan, by the MEMS scanner, a first portion of the image; and

producing only one light beam that is directed towards and incident on the biaxial MEMS mirror, or one of the pair of uniaxial MEMS mirrors, to raster scan, by the MEMS scanner, a second portion of the image.

12. The method of claim 11, wherein:

the first portion of the image has a first line density and comprises a foveal region of the image; and

the second portion of the image has a second line density that is lower than the first line density and comprises a non-foveal region of the image.

13. The method of claim 12, wherein the only one light beam, that is produced when the second portion of the image is being raster scanned by the MEMS scanner, comprises none of the two light beams that are produced when the first portion of the image is being raster scanned by the MEMS scanner.

14. The method of claim 12, wherein the only one light beam, that is produced when the second portion of the image is being raster scanned by the MEMS scanner, comprises one of the two light beams that are produced when the first portion of the image is being raster scanned by the MEMS scanner.

15. The method of claim 11, wherein a location of the first portion of the image is dynamic relative to a rest of the image, and further comprising:

tracking a gaze of an eye; and

determining a location of the first portion of the image based on the tracked gaze;

wherein the location of the first portion of the image changes in response to the tracked gaze changing.

16. A near eye or heads up display system, comprising:

a MEMS scanner including a biaxial MEMS mirror or a pair of uniaxial MEMS mirrors;

a controller communicatively coupled to the MEMS scanner and configured to control rotation of the biaxial MEMS mirror or the pair of uniaxial MEMS mirrors of the MEMS scanner;

a plurality of light sources each of which comprises one or more light emitting elements;

a plurality of light source drivers, each of which is configured to selectively drive a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on the biaxial MEMS mirror or one of the pair of uniaxial MEMS mirrors;

an image processor communicatively coupled to each of the light source drivers and configured to

cause at least two of the light source drivers to drive at least two of the light sources to thereby produce at least two light beams when a first portion of an image is being raster scanned by the MEMS scanner; and

cause only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam when a second portion of the image is being raster scanned by the MEMS scanner; and

one or more optical waveguides each of which includes an input-coupler and an output-coupler;

wherein light corresponding to the first and second portions of the image that are raster scanned using the biaxial MEMS mirror or the pair of uniaxial MEMS mirrors, under the control of the controller, is coupled into the one or more optical waveguides via the input-coupler(s) of the one or more optical waveguide(s);

wherein the light corresponding to the first and second portions of the image, that is coupled into the one or more optical waveguides via the input-coupler(s), travels at least in part by way of total internal reflection (TIR) from the input-coupler(s) to the output-coupler(s) of the one or more optical waveguides; and

wherein the output-coupler(s) is/are configured to couple the light corresponding to the first and second portions of the image, that has traveled within the one or more optical waveguides from the input-coupler(s) to the output-coupler(s), out of the one or more optical waveguides.

17. The system of claim 16, wherein:

the first portion of the image comprises a foveal region of the image; and

the second portion of the image comprises a non-foveal region of the image.

18. The system of claim 17, further comprising:

an eye tracker configured to track a gaze of an eye;

wherein the image processor is configured to change a location of the first portion of the image based on changes to the gaze, as determined using the eye tracker.

19. The system of claim 16, wherein a respective spot size of each of the at least two light beams, used to raster scan the first portion of the image, is smaller than a spot size of the only one light beam used to raster scan the second portion of the image.

20. The system of claim 16, wherein:

the plurality of light sources comprise first, second and third light sources;

the plurality of light source drivers comprise first, second and third light source drivers; and

the image processor is configured to

cause the first light source driver to not drive the first light source, and cause the second and third light source drivers to drive the second and third light sources respectively to thereby produce two light beams, when the first portion of the image is being raster scanned by the MEMS scanner; and

cause the second and third light source drivers to not drive the second and third light sources, and cause the first light source driver to drive the first light source to thereby produce only one light beam, when the second portion of the image is being raster scanned by the MEMS scanner.