Light field processor system

• US 10,451,895 B2
• Filed: 07/24/2017
• Issued: 10/22/2019
• Est. Priority Date: 07/25/2016
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Macnamara, John Graham, Samec, Nicole Elizabeth, Robaina, Nastasja U., Baerenrodt, Eric, Harrises, Christopher M.
• Primary Examiner(s): Hasan, Mohammed A
• Application Number:
  US15/658,262
• Publication Number:
  US 20180136486A1
• Time in Patent Office: 820 Days
• Field of Search: 351206
• CPC Class Codes: A61B 3/00 Apparatus for testing the eyes; Instruments for examining the eyes eye inspection using ultrasonic, sonic or infrasonic waves A61B8/10; devices for treatment of the eyes A61F9/00; exercisers for the eyes A61H5/00; optical systems in general G02B
• CPC Class Codes: A61B 3/0025 characterised by electronic signal processing, e.g. eye models
• CPC Class Codes: A61B 3/028 for testing visual acuity; for determination of refraction, e.g. phoropters
• CPC Class Codes: A61B 3/1015 for wavefront analysis
• CPC Class Codes: A61B 3/13 Ophthalmic microscopes
• CPC Class Codes: A61B 3/14 Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G02C 2202/22 Correction of higher order and chromatic aberrations, wave front measurement and calculation
• CPC Class Codes: G02C 7/027 considering wearer's parameters
• CPC Class Codes: G06F 1/14 Time supervision arrangements, e.g. real time clock
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

A wearable ophthalmic device is disclosed. The device may include an outward facing head-mounted light field camera to receive light from a user'"'"'s surroundings and to generate numerical light field image data. The device may also include a light field processor to access the numerical light field image data, to obtain an optical prescription for an eye of the user, and to computationally introduce an amount of positive or negative optical power to the numerical light field image data based on the optical prescription to generate modified numerical light field image data. The device may also include a head-mounted light field display to generate a physical light field corresponding to the modified numerical light field image data.

Claims

1. A wearable ophthalmic device, comprising:

an outward facing head-mounted light field camera configured to receive light from a user'"'"'s surroundings and to generate numerical light field image data;

a light field processor configured to access the numerical light field image data, to obtain an optical prescription for an eye of the user, and to computationally introduce an amount of positive or negative optical power to the numerical light field image data based on the optical prescription to generate modified numerical light field image data; and

a head-mounted light field display configured to generate a physical light field corresponding to the modified numerical light field image data.

2. The device of claim 1, wherein the optical power comprises spherical or cylindrical optical power.

3. The device of claim 1, wherein the modified numerical light field image data is at least partially corrected for the optical prescription.

4. The device of claim 1, wherein the light field processor is configured to generate the modified numerical light field image data by identifying one or more wavefronts represented by the numerical light field image data and computationally modifying the curvature of the one or more wavefronts based on the optical prescription.

5. The device of claim 1, wherein the light field processor is further configured to add virtual reality or augmented reality image content to the numerical light field image data.

6. The device of claim 1, wherein the optical prescription comprises a prescription for myopia.

7. The device of claim 1, wherein the optical prescription comprises a prescription for hyperopia.

8. The device of claim 1, wherein the optical prescription comprises a prescription for astigmatism.

9. The device of claim 1, wherein the optical prescription comprises information regarding higher-order aberrations of the user'"'"'s eye.

10. The device of claim 1, wherein the light field camera comprises an integral imaging camera with a two-dimensional array of micro-lenses and a corresponding two-dimensional array of photodetectors.

11. The device of claim 1, wherein the light field display comprises an integral imaging display with a two-dimensional array of micro-lenses and a corresponding two-dimensional array of light sources.

12. The device of claim 1, wherein the light field display comprises one or more infrared light sources configured to project infrared light into the user'"'"'s eye to measure the optical prescription.

13. The device of claim 1, wherein the light field processor is configured to generate the modified numerical light field image data in real-time.

14. The device of claim 1, wherein the light field processor is configured generate the optical prescription.

15. The device of claim 14, wherein the light field processor is configured to generate the optical prescription by:

computationally introducing a first test amount of positive or negative optical power to the numerical light field image data;

receiving feedback from the user regarding the first test amount of positive or negative optical power; and

computationally introducing a second test amount of positive or negative optical power to the light field image data.

16. The device of claim 1, wherein the light field processor is further configured to generate the modified numerical light field image data by removing one or more light rays which would interact with a defect in the user'"'"'s cornea or crystalline lens if generated as part of the physical light field.

17. A method for using a wearable ophthalmic device, the method comprising:

computationally introducing an amount of positive or negative optical power to numerical light field image data of a user'"'"'s surroundings so as to generate modified numerical light field image data, the amount of optical power being based on an optical prescription for the user; and

generating a physical light field corresponding to the modified numerical light field image data using a light field display.

18. The method of claim 17, wherein generating the modified numerical light field image data comprises identifying one or more wavefronts represented by the numerical light field image data and computationally modifying the curvature of the one or more wavefronts based on the optical prescription.

19. The method of claim 17, further comprising adding virtual reality or augmented reality image content to the numerical light field image data.

20. The method of claim 17, further comprising projecting infrared light into the user'"'"'s eye to measure the optical prescription.

21. The method of claim 17, further comprising generating the modified numerical light field image data in real-time.

22. The method of claim 17, further comprising generating the optical prescription.

23. The method of claim 17, wherein generating the optical prescription comprises:

computationally introducing a first test amount of positive or negative optical power to the numerical light field image data;

receiving feedback from the user regarding the first test amount of positive or negative optical power; and

computationally introducing a second test amount of positive or negative optical power to the light field image data.

24. The method of claim 17, further comprising generating the modified numerical light field image data by computationally removing one or more light rays which would interact with a defect in the user'"'"'s cornea or crystalline lens if generated as part of the physical light field.