Augmented and virtual reality display systems and methods for delivery of medication to eyes

• US 10,564,423 B2
• Filed: 09/19/2016
• Issued: 02/18/2020
• Est. Priority Date: 03/16/2015
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Samec, Nicole Elizabeth, Macnamara, John Graham, Harrises, Christopher M., Schowengerdt, Brian T., Abovitz, Rony, Baerenrodt, Mark
• Primary Examiner(s): Wang, Jin Cheng
• Application Number:
  US15/269,772
• Publication Number:
  US 20170007450A1
• Time in Patent Office: 1,247 Days
• Field of Search: 351206, 351208, 351246, 351211, 351200, 351209, 345 8, 345633, 600437, 600452, 600443, 600407, 600444, 600459, 600446, 600439, 600441, 600447, 600449, 600558, 600425, 604294, 607 45, 607141
• CPC Class Codes: A61B 2562/0204 Acoustic sensors
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/0247 Pressure sensors
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/0025 characterised by electronic signal processing, e.g. eye models
• CPC Class Codes: A61B 3/005 Constructional features of the display
• CPC Class Codes: A61B 3/022 for testing contrast sensitivity
• CPC Class Codes: A61B 3/024 for determining the visual field, e.g. perimeter types
• CPC Class Codes: A61B 3/028 for testing visual acuity; for determination of refraction, e.g. phoropters
• CPC Class Codes: A61B 3/0285 Phoropters
• CPC Class Codes: A61B 3/032 Devices for presenting test symbols or characters, e.g. test chart projectors A61B3/036 takes precedence
• CPC Class Codes: A61B 3/036 for testing astigmatism
• CPC Class Codes: A61B 3/063 for testing light sensitivity, i.e. adaptation
• CPC Class Codes: A61B 3/066 for testing colour vision
• CPC Class Codes: A61B 3/08 for testing binocular or stereoscopic vision, e.g. strabismus
• CPC Class Codes: A61B 3/085 for testing strabismus
• CPC Class Codes: A61B 3/10 Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• CPC Class Codes: A61B 3/1005 for measuring distances inside the eye, e.g. thickness of the cornea A61B3/11 takes precedence
• CPC Class Codes: A61B 3/101 for examining the tear film
• CPC Class Codes: A61B 3/1015 for wavefront analysis
• CPC Class Codes: A61B 3/102 : for optical coherence tomography [OCT]
• CPC Class Codes: A61B 3/1035 : for measuring astigmatism testing astigmatism A61B3/036
• CPC Class Codes: A61B 3/113 : for determining or recording eye movement
• CPC Class Codes: A61B 3/12 : for looking at the eye fundus, e.g. ophthalmoscopes A61B3/13 takes precedence
• CPC Class Codes: A61B 3/1216 : for diagnostics of the iris
• CPC Class Codes: A61B 3/1241 : specially adapted for observation of ocular blood flow, e.g. by fluorescein angiography
• CPC Class Codes: A61B 3/13 : Ophthalmic microscopes
• CPC Class Codes: A61B 3/14 : Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: A61B 3/165 : Non-contacting tonometers
• CPC Class Codes: A61B 5/0059 : using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0066 : Optical coherence imaging
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 : Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/12 : Audiometering
• CPC Class Codes: A61B 5/14532 : for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/1455 : using optical sensors, e.g. spectral photometrical oximeters
• CPC Class Codes: A61B 5/14555 : specially adapted for the eye fundus
• CPC Class Codes: A61B 5/361 : Detecting fibrillation
• CPC Class Codes: A61B 5/369 : Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/398 : Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
• CPC Class Codes: A61B 5/6803 : Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 8/10 : Eye inspection
• CPC Class Codes: A61B 8/461 : Displaying means of special interest
• CPC Class Codes: A61F 2007/0004 : Eyes or part of the face surrounding the eyes
• CPC Class Codes: A61F 2007/004 : Hip
• CPC Class Codes: A61F 2009/00863 : Retina
• CPC Class Codes: A61F 9/0026 : Ophthalmic product dispenser attachments to facilitate positioning near the eye
• CPC Class Codes: A61H 2201/165 : Wearable interfaces
• CPC Class Codes: A61M 2021/0022 : by the tactile sense, e.g. vibrations
• CPC Class Codes: A61M 2021/0027 : by the hearing sense
• CPC Class Codes: A61M 2021/0066 : with heating or cooling
• CPC Class Codes: A61M 21/02 : for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: A61M 2205/3375 : Acoustical, e.g. ultrasonic, measuring means
• CPC Class Codes: A61M 2205/507 : Head Mounted Displays [HMD]
• CPC Class Codes: A61N 2005/0648 : the light being directed to the eyes
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 2027/0185 : Displaying image at variable distance
• CPC Class Codes: G02B 21/0032 : Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers G02B21/0036 - G02B21/008; means for illumination of specimens in general G02B21/06
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G02B 27/0179 : Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G02C 7/027 : considering wearer's parameters
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10024 : Color image
• CPC Class Codes: G06T 2207/10148 : Varying focus
• CPC Class Codes: G06T 2207/10152 : Varying illumination
• CPC Class Codes: G06T 2207/30041 : Eye; Retina; Ophthalmic
• CPC Class Codes: G16H 20/17 : delivered via infusion or injection
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user'"'"'s body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Claims

1. A wearable augmented reality device comprising:

an augmented reality head-mounted ophthalmic system comprising an augmented reality display platform comprising;

a frame configured to be worn on the head of a wearer wearing the head-mounted system; and

a display attached to the frame, the display comprising;

a waveguide stack configured to pass light from the world into an eye of the wearer; and

a light source configured to provide light for generating virtual content,

wherein the waveguide stack comprises a plurality of waveguides, each waveguide of the plurality of waveguides comprising;

in-coupling diffractive optical elements configured to in-couple light provided by the light source, and

out-coupling diffractive optical elements configured to out-couple in-coupled light to the eye of the wearer,

wherein one or more waveguides of the plurality of waveguides are configured to output in-coupled light to an eye of the wearer with a different amount of wavefront divergence than one or more other waveguides of the plurality of waveguides, wherein different amounts of wavefront divergence are associated with different accommodation by the eye, and wherein the outputted light with different amounts of wavefront divergence forms virtual objects at different perceived depths away from the wearer, wherein each waveguide of the plurality of waveguides is configured to guide light therein by total internal reflection between opposing surfaces of the waveguide; and

a medication delivery system configured to deliver medication to the eye of the wearer,

wherein the augmented reality head-mounted ophthalmic system is configured to;

display a visual cue on the display; and

provide an alert to the wearer to focus on the visual cue while the medication is delivered.

2. The device of claim 1, wherein the medication delivery system comprises outlets for expelling the medication, wherein the outlets are attached to the frame.

3. The device of claim 1, wherein the augmented reality head-mounted ophthalmic system comprises a sensor to detect irritants in an atmosphere around the wearer, wherein the augmented reality head-mounted ophthalmic system is configured to deliver the medication based on the detection of the irritants.

4. The device of claim 1, wherein the augmented reality head-mounted ophthalmic system is configured to deliver the medication to the eye of the wearer based on a treatment protocol.

5. The device of claim 1, wherein the augmented reality head-mounted ophthalmic system is configured to provide an alert to the wearer while the medication is delivered.

6. The device of claim 1, wherein the augmented reality head-mounted ophthalmic system is configured to provide an alert to the wearer to keep the eye open while the medication is delivered.

7. The device of claim 1, wherein the augmented reality head-mounted ophthalmic system is configured to deliver the medication as part of a light or laser therapy.

8. The device of claim 7, wherein the medication is photosensitive to wavelengths of light used for the light or laser therapy.

9. A wearable augmented reality device comprising:

an augmented reality head-mounted ophthalmic system comprising an augmented reality display platform comprising;

a frame configured to be worn on the head of a wearer wearing the head-mounted system; and

a display attached to the frame, the display comprising;

a waveguide stack configured to pass light from the world into an eye of the wearer; and

a light source configured to provide light for generating virtual content,

wherein the waveguide stack comprises a plurality of waveguides, each waveguide of the plurality of waveguides comprising;

in-coupling diffractive optical elements configured to in-couple light provided by the light source, and

out-coupling diffractive optical elements configured to out-couple in-coupled light to the eye of the wearer,

wherein one or more waveguides of the plurality of waveguides are configured to output light to an eye of the wearer with a different amount of wavefront divergence than one or more other waveguides of the plurality of waveguides, wherein different amounts of wavefront divergence are associated with different accommodation by the eye, and wherein the outputted light with different amounts of wavefront divergence forms virtual objects at different perceived depths away from the wearer; and

a liquid delivery system configured to deliver a liquid to the eye of the wearer, wherein the augmented reality head-mounted ophthalmic system is configured to;

display a visual cue on the display; and

provide an alert to the wearer to focus on the visual cue while the liquid is delivered.

10. The device of claim 9, wherein the liquid delivery system comprises outlets for expelling the liquid, wherein the outlets are attached to the frame.

11. The device of claim 9, wherein the liquid delivery system is configured to deliver a spray or mist of the liquid to the eye.

12. The device of claim 9, wherein the liquid delivery system is configured to deliver drops of the liquid to the eye.

13. The device of claim 9, wherein the liquid delivery system is configured to deliver a stream of the liquid to the eye.

14. The device of claim 9, wherein the liquid delivery system is configured to deliver a saline solution to the eye of the wearer.

15. The device of claim 14, wherein the ophthalmic system comprises a camera configured to image the eye and to detect an eye condition requiring the saline solution.

16. The device of claim 15, wherein the ophthalmic system is configured to detect dry eyes, and wherein the liquid delivery system is configured to deliver the saline solution when the eye is dry.

17. The device of claim 14, wherein the ophthalmic system is configured detect red or bloodshot eyes, and wherein the liquid delivery system is configured to deliver the saline solution in response to detection of the red or bloodshot eyes.

18. The device of claim 9, wherein the augmented reality head-mounted ophthalmic system further comprises one or more sensors to measure one or more of a temperature of the wearer, a duration since an immediately previous delivery of liquid or powdered medication to the eye, an ambient humidity, a presence of foreign objects on the eye, a presence of chemical irritants in the eyes, and/or a pollen or particulate count.

19. The device of claim 18, wherein the augmented reality head-mounted ophthalmic system is configured to deliver the liquid to the eye based upon one or more measurements of the one or more sensors exceeding a threshold.

20. The device of claim 18, wherein the augmented reality head-mounted ophthalmic system is configured to flush the eye with the liquid.