Light field display, adjusted pixel rendering method therefor, and vision correction system and method using same

• US 10,394,322 B1
• Filed: 01/28/2019
• Issued: 08/27/2019
• Est. Priority Date: 10/22/2018
• Status: Active Grant

• Current Assignee: Evolution Optiks Limited
• Original Assignee: Evolution Optiks Limited
• Inventors: Gotsch, Daniel
• Primary Examiner(s): Dinh, Jack
• Application Number:
  US16/259,845
• Time in Patent Office: 211 Days
• CPC Class Codes: G02B 27/0025 for optical correction, e.g. distorsion, aberration
• CPC Class Codes: G06F 1/1609 to support filters or lenses
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2320/068 for control of viewing angle adjustment
• CPC Class Codes: G09G 2320/08 Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/001 Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607

Abstract

Described are various embodiments of a light field display, adjusted pixel rendering method and computer-readable medium therefor, and vision correction system and method using same. In one embodiment, a computer-implemented method is provided to automatically adjust user perception of an input image to be rendered on a digital display via a set of pixels thereof, wherein the digital display has a light field shaping layer (LFSL) disposed thereon comprising an array of LFSL elements.

Claims

1. A computer-implemented method, automatically implemented by one or more digital processors, to automatically adjust user perception of an input image to be rendered on a digital display via a set of pixels thereof, wherein the digital display includes a light field shaping layer (LFSL) disposed thereon comprising an array of LFSL elements, the method comprising:

digitally mapping the input image on an adjusted image plane designated to provide the user with a designated image perception adjustment;

for each given pixel in the set of pixels, digitally;

calculating a trial vector between said given pixel and an input user pupil location;

identifying a center position of a given LFSL element closest to a LFSL intersection point of said trial vector with said LFSL;

projecting an adjusted image ray trace between said given pixel and said center position to intersect said adjusted image plane at a given adjusted image location; and

associating an adjusted image colour designated for said given adjusted image location with said given pixel based on said mapping; and

rendering for each said given pixel said adjusted image colour associated therewith, thereby rendering a perceptively adjusted version of the input image.

2. The method of claim 1, wherein said adjusted image plane is a virtual image plane virtually positioned relative to the digital display at a designated distance from said input user pupil location, and wherein said adjusted image ray trace comprises a virtual image vector between said given pixel and said center position to intersect said virtual image plane.

3. The method of claim 2, wherein said designated distance comprises a minimum viewing distance designated such that said perceptively adjusted version of the input image is adjusted to accommodate a user'"'"'s reduced visual acuity.

4. The method of claim 1, wherein said adjusted image plane is designated as a user retinal plane, and wherein said adjusted image ray trace is projected to intersect with said user retinal plane by redirecting said adjusted image ray trace at said pupil location in accordance with an input user eye focus aberration parameter.

5. The method of claim 4, wherein said mapping is implemented by scaling the input image on said retinal plane as a function of said input user eye focus aberration parameter.

6. The method of claim 5, wherein said input user eye focus aberration parameter is designated as a function of a quantified abnormal user eye focal length.

7. The method of claim 1, wherein, prior to said associating, the method further comprises confirming that said adjusted image ray trace intersects with an input pupil area associated with said input user pupil location, and wherein said associating comprises only associating said adjusted image colour upon said adjusted image ray trace intersecting said input pupil area and otherwise associating a black colour to, or deactivating, said given pixel.

8. The method of claim 1, wherein each said given pixel comprises a set of subpixels, wherein at least some of said calculating, identifying, and projecting is executed for each of said subpixels independently, and wherein said associating comprises associating for each of said subpixels a subpixel colour channel value corresponding with said adjusted image colour.

9. The method of claim 1, wherein said LFSL elements are configured in a hexagonal LFSL element array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a hexagonal tile array of hexagonal tiles corresponding with said LFSL elements;

overlaying said hexagonal tile array with a rectangular tile array aligned so to thereby delineate, for each rectangular tile, a set of distinct linearly-segregated tile regions including linear boundaries defined by adjacent underlying hexagonal tiles;

identifying a given rectangular tile of said rectangular tile array containing said LFSL intersection point; and

applying a set of designated conditional statements to said LFSL intersection point as identified within said given rectangular tile and derived from said linear boundaries to output a corresponding set of Boolean or binary values representative as to which of said tile regions contains said LFSL intersection point to thereby identify which given hexagonal tile of said adjacent underlying hexagonal tiles contains said intersection point accordingly.

10. The method of claim 1, wherein said LFSL elements define an at least partially nestled array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a nestled tile array of nestled tiles corresponding with said LFSL elements;

overlaying said nestled tile array with a rectangular tile array aligned so to thereby delineate, for each rectangular tile, a set of distinct linearly-segregated tile regions including linear boundaries defined by adjacent underlying nestled tiles;

identifying a given rectangular tile of said rectangular tile array containing said LFSL intersection point; and

applying a set of designated conditional statements to said LFSL intersection point as identified within said given rectangular tile and derived from said linear boundaries to output a corresponding set of Boolean or binary values representative as to which of said tile regions contains said LFSL intersection point to thereby identify which given nestled tile of said adjacent underlying nestled tiles contains said intersection point accordingly.

11. The method of claim 1, wherein said LFSL elements are configured in a rectangular LFSL element array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a normalized rectangular tile array of rectangular tiles corresponding with said LFSL elements;

identifying a designated corner of given rectangular tile of said rectangular tile array containing said LFSL intersection point using normalized rectangular tile array coordinates; and

applying a set of normalized vectorial coordinates to compute a center of said given rectangular tile containing said LFSL intersection point based on said identified designated corner.

12. A non-transitory computer-readable medium comprising digital instructions to be implemented by one or more digital processors to automatically adjust user perception of an input image to be rendered on a digital display via a set of pixels thereof, wherein the digital display includes a light field shaping layer (LFSL) disposed thereon comprising an array of LFSL elements, by:

digitally mapping the input image on an adjusted image plane designated to provide the user with a designated image perception adjustment;

for each given pixel in the set of pixels, digitally;

calculating a trial vector between said given pixel and an input user pupil location;

identifying a center position of a given LFSL element closest to a LFSL intersection point of said trial vector with said LFSL;

projecting an adjusted image ray trace between said given pixel and said center position to intersect said adjusted image plane at a given adjusted image location; and

associating an adjusted image colour designated for said given adjusted image location with said given pixel based on said mapping; and

rendering for each said given pixel said adjusted virtual image colour associated therewith, thereby rendering a perceptively adjusted version of the input image.

13. The non-transitory computer-readable medium of claim 12, wherein said adjusted image plane is a virtual image plane virtually positioned relative to the digital display at a designated distance from said input user pupil location, and wherein said adjusted image ray trace comprises a virtual image vector between said given pixel and said center position to intersect said virtual image plane.

14. The non-transitory computer-readable medium of claim 12, wherein said designated distance comprises a minimum viewing distance designated such that said perceptively adjusted version of the input image is adjusted to accommodate a user'"'"'s reduced visual acuity.

15. The non-transitory computer-readable medium of claim 12, wherein said adjusted image plane is designated as a user retinal plane, and wherein said adjusted image ray trace is projected to intersect with said user retinal plane by redirecting said adjusted image ray trace at said pupil location in accordance with an input user eye focus aberration parameter.

16. The non-transitory computer-readable medium of claim 15, wherein said mapping is implemented by scaling the input image on said retinal plane as a function of said input user eye focus aberration parameter.

17. The non-transitory computer-readable medium of claim 16, wherein said input user eye focus aberration parameter is designated as a function of a quantified abnormal user eye focal length.

18. The non-transitory computer-readable medium of claim 12, wherein, prior to said associating, said instructions are further executable to confirm that said adjusted image ray trace intersects with an input pupil area associated with said input user pupil location, and wherein said associating comprises only associating said adjusted image colour upon said adjusted image ray trace intersecting said input pupil area, and otherwise associating a black colour to, or deactivating, said given pixel.

19. The non-transitory computer-readable medium of claim 12, wherein each said given pixel comprises a set of subpixels, wherein at least some of said calculating, identifying, and projecting is executed for each of said subpixels independently, and wherein said associating comprises associating for each of said subpixels a subpixel colour channel value corresponding with said adjusted image colour.

20. The non-transitory computer-readable medium of claim 12, wherein said LFSL elements are configured in a hexagonal LFSL element array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a hexagonal tile array of hexagonal tiles corresponding with said LFSL elements;

overlaying said hexagonal tile array with a rectangular tile array aligned so to thereby delineate, for each rectangular tile, a set of distinct linearly-segregated tile regions including linear boundaries defined by adjacent underlying hexagonal tiles;

identifying a given rectangular tile of said rectangular tile array containing said LFSL intersection point; and

applying a set of designated conditional statements to said LFSL intersection point as identified within said given rectangular tile and derived from said linear boundaries to output a corresponding set of Boolean or binary values representative as to which of said tile regions contains said LFSL intersection point to thereby identify which given hexagonal tile of said adjacent underlying hexagonal tiles contains said intersection point accordingly.

21. The non-transitory computer-readable medium of claim 12, wherein said LFSL elements define an at least partially nestled array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a nestled tile array of nestled tiles corresponding with said LFSL elements;

overlaying said nestled tile array with a rectangular tile array aligned so to thereby delineate, for each rectangular tile, a set of distinct linearly-segregated tile regions including linear boundaries defined by adjacent underlying nestled tiles;

identifying a given rectangular tile of said rectangular tile array containing said LFSL intersection point; and

applying a set of designated conditional statements to said LFSL intersection point as identified within said given rectangular tile and derived from said linear boundaries to output a corresponding set of Boolean or binary values representative as to which of said tile regions contains said LFSL intersection point to thereby identify which given nestled tile of said adjacent underlying nestled tiles contains said intersection point accordingly.

22. The non-transitory computer-readable medium of claim 12, wherein said LFSL elements are configured in a rectangular LFSL element array, and wherein said identifying further comprises computationally:

defining said LFSL elements as a normalized rectangular tile array of rectangular tiles corresponding with said LFSL elements;

identifying a designated corner of given rectangular tile of said rectangular tile array containing said LFSL intersection point using normalized rectangular tile array coordinates; and

applying a set of normalized vectorial coordinates to compute a center of said given rectangular tile containing said LFSL intersection point based on said identified designated corner.

23. A digital display device operable to automatically adjust user perception of an input image to be rendered thereon, the device comprising:

a digital display medium comprising an array of pixels and operable to render a pixelated image accordingly;

a light field shaping layer defined by an array of light field shaping elements and disposed relative to said digital display so to align each of said light field shaping elements with a corresponding set of said pixels to shape a light field emanating therefrom and thereby at least partially govern a projection thereof from said display medium toward the user; and

a hardware processor operable on pixel data for the input image to output adjusted image pixel data to be rendered via said light field shaping layer to adjust user perception of the input image as rendered therethrough by;

digitally mapping the input image on an adjusted image plane designated to provide the user with a designated image perception adjustment;

for each given pixel in the set of pixels, digitally;

calculating a trial vector between said given pixel and an input user pupil location;

identifying a center position of a given LFSL element closest to a LFSL intersection point of said trial vector with said LFSL;

projecting an adjusted image ray trace between said given pixel and said center position to intersect said adjusted plane at a given adjusted image location; and

associating an adjusted image colour designated for said given adjusted image location with said given pixel based on said mapping; and

rendering for each said given pixel said adjusted image colour associated therewith, thereby rendering a perceptively adjusted version of the input image.

24. The digital display device of claim 23, wherein said adjusted image plane is a virtual image plane virtually positioned relative to the digital display at a designated distance from said input user pupil location, wherein said adjusted image ray trace comprises a virtual image vector between said given pixel and said center position to intersect said virtual image plane, and wherein said designated distance comprises a minimum viewing distance designated such that said perceptively adjusted version of the input image is adjusted to accommodate a user'"'"'s reduced visual acuity.

25. The digital display device of claim 24, wherein the device is operable to adjust user perception of the input image for viewing by a viewer including reduced visual acuity such that said perceptively adjusted version of the input image at least partially compensates for the viewer'"'"'s reduced visual acuity, wherein the device further comprises a user interface for dynamically adjusting said minimum viewing distance.

26. The digital display device of claim 23, wherein said adjusted image plane is designated as a user retinal plane, and wherein said adjusted image ray trace is projected to intersect with said user retinal plane by redirecting said adjusted image ray trace at said pupil location in accordance with an input user eye focus aberration parameter.

27. The digital display device of claim 26, further comprising a user interface for dynamically adjusting said input user eye focus aberration parameter.

28. The digital display of claim 23, wherein each said given pixel comprises a set of subpixels, wherein at least some of said calculating, identifying, and projecting is executed for each of said subpixels independently, and wherein said associating comprises associating for each of said subpixels a subpixel colour channel value corresponding with said adjusted image colour.

29. The digital display device of claim 23, further comprising a pupil tracker or pupil tracking interface operable to dynamically track and automatically accommodate for changes in said input user pupil location.

30. The device of claim 23, wherein said hardware processor comprises a graphics processing unit (GPU), and wherein said calculating, identifying, projecting and associating steps are implemented in parallel for each said given pixel of at least a subset of said pixels by said GPU.