Near-eye display system and method

• US 10,152,906 B2
• Filed: 11/09/2015
• Issued: 12/11/2018
• Est. Priority Date: 04/26/2015
• Status: Active Grant

• Current Assignee: Mems Start LLC
• Original Assignee: Mems Start LLC
• Inventors: Gutierrez, Roman
• Primary Examiner(s): Yang, Andrew G
• Application Number:
  US14/936,226
• Publication Number:
  US 20160314729A1
• Time in Patent Office: 1,128 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/015 involving arrangement aiming to get less bulky devices
• CPC Class Codes: G02B 2027/0154 with movable elements
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0457 Improvement of perceived resolution by subpixel rendering
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/145 the light originating from the display screen
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 3/02 by tracing or scanning a light beam on a screen
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H02N 1/008 Laterally driven motors, e.g. of the comb-drive type

Abstract

A near-eye light field display for use with a head mounted display unit with enhanced resolution and color depth. A display for each eye is connected to one or more actuators to scan each display, increasing the resolution of each display by a factor proportional to the number of scan points utilized. In this way, the resolution of near-eye light field displays is enhanced without increasing the size of the displays.

Claims

1. A near-eye display system, comprising:

a display component, comprising a light source array disposed on one or more actuators, the light source array comprising a focus sensor;

an actuator control component communicatively coupled to the one or more actuators; and

a processor unit communicatively coupled to the light source array and the actuator control component;

wherein the focus sensor is disposed on the surface of the display component between at least two pixels of a plurality of pixels of the display component

wherein the focus sensor measures an eye focus of a user'"'"'s eyes

wherein the light source array is connected with the one or more actuators such that the one or more actuators are capable of moving the light source array in accordance with a scan pattern, and the processor unit is configured to synchronize the illumination of a plurality of pixels of the light source array with the scan pattern.

2. The near-eye display system of claim 1, wherein the light source array comprises one of:

an LED;

an OLED;

an LCD;

a plasma display.

3. The near-eye display system of claim 1, further comprising one or more lenses disposed in front of the light source array.

4. The near-eye display system of claim 1, wherein the scan pattern comprises a raster scan pattern configured to scan the one or more actuators laterally.

5. The near-eye display system of claim 1, wherein the scan pattern results in a Lissajous curve.

6. The near-eye display system of claim 1, further comprising one or more cameras having a field of view encompassing a portion of a view of a user, and wherein the processor is further configured to compute a light field representation.

7. The near-eye display system of claim 6, wherein the one or more cameras comprise one or more light field cameras.

8. The near-eye display system of claim 6, wherein the one or more cameras comprises a motorized focus.

9. The near-eye display system of claim 6, wherein the scan pattern comprises a raster scan pattern configured to scan the one or more actuators laterally, and a depth scan pattern configured to scan the one or more actuators in the Z-axis.

10. The near-eye display system of claim 1, comprising two of the display components, and further comprising:

a focus correction module communicatively coupled to the focus sensors of each of the two display components and configured to determine a desired focus;

a display focus control communicatively coupled to the focus correction module and configured to set a focus of the light source array of each of the two display components; and

a camera focus control communicatively coupled to the one or more cameras and configured to set a focus of each of the one or more cameras based on the desired focus.

11. The near-eye display system of claim 1, wherein the system comprises a head mounted display.

12. A method, comprising:

using one or more focus sensors to measure an eye focus of a user'"'"'s eyes, wherein each of the one or more focus sensors is on a surface of a first display or a surface of a second display, wherein the focus sensor is disposed on the surface of the display component between at least two pixels of a plurality of pixels of the display component

determining by a focus correction module a desired focus based on the eye focus measured using the one or more focus sensors;

setting a focus of a first camera and a second camera based on the desired focus;

capturing images within a field of view of the first camera and the second camera;

processing the captured images to generate processed images;

setting a focus of the first display and the second display; and

providing the processed images to the first display and a second display;

wherein the first display is disposed in front of a first eye of the user and the second display is disposed in front of a second eye of the user.

13. The method of claim 12, wherein the first display and the second display comprise one of:

an LED;

an OLED;

an LCD;

a plasma display.

14. The method of claim 12, wherein processing the captured images to generate the processed images comprises computing a light field representation of the captured images, and computing a sequence pattern for turning on and off a plurality of light sources disposed on the first display and the second display.

15. The method of claim 14, wherein processing the captured images to generate the processed images further comprising computing a sequence pattern for turning on and off a plurality of light sources disposed on the first display and the second display.

16. The method of claim 14, wherein the sequence pattern comprises a raster scan pattern.

17. The method of claim 12, wherein the one or more cameras comprises a motorized focus and setting the focus of the first camera and the second camera comprises setting the motorized focus to a capture focus.

18. The method of claim 17, wherein the capture focus is equal to the desired focus.

19. The method of claim 17, wherein the capture focus is different than the desired focus.

20. The method of claim 12, wherein providing the processed images to the first display and the second display comprises scanning the first display and the second display via one or more actuators configured to laterally scan each of the first and second displays.

21. A method of enhancing image resolution in a head mounted display comprising a light source array, the method comprising:

using a focus sensor between two pixels on a surface of the light source array to measure a focus of an eye;

determining a desired focus using the focus of the eye;

setting a focus of a head mounted camera using the desired focus;

using the head mounted camera to capture images within a field of view of the head mounted camera;

processing the captured images to generate processed images, wherein the processed images are generated using one or more of;

illumination control for the light source array;

focal depths associated with the captured images; and

a sequence for a driver associated with the light source array;

setting a focus of the display using the focus of the eye; and

providing the processed images using the display.