Methods and systems for diagnosing and treating health ailments

• US 11,156,835 B2
• Filed: 03/16/2016
• Issued: 10/26/2021
• Est. Priority Date: 03/16/2015
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Samec, Nicole Elizabeth, Macnamara, John Graham, Harrises, Christopher M., Schowengerdt, Brian T., Abovitz, Rony, Baerenrodt, Mark
• Primary Examiner(s): Zhai, Kyle
• Application Number:
  US15/072,290
• Publication Number:
  US 20160270656A1
• Time in Patent Office: 2,050 Days
• Field of Search: None
• CPC Class Codes: A61B 2562/0204 Acoustic sensors
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 2562/0247 Pressure sensors
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/0025 characterised by electronic signal processing, e.g. eye models
• CPC Class Codes: A61B 3/005 Constructional features of the display
• CPC Class Codes: A61B 3/022 for testing contrast sensitivity
• CPC Class Codes: A61B 3/024 for determining the visual field, e.g. perimeter types
• CPC Class Codes: A61B 3/028 for testing visual acuity; for determination of refraction, e.g. phoropters
• CPC Class Codes: A61B 3/0285 Phoropters
• CPC Class Codes: A61B 3/032 Devices for presenting test symbols or characters, e.g. test chart projectors A61B3/036 takes precedence
• CPC Class Codes: A61B 3/036 for testing astigmatism
• CPC Class Codes: A61B 3/063 for testing light sensitivity, i.e. adaptation
• CPC Class Codes: A61B 3/066 for testing colour vision
• CPC Class Codes: A61B 3/08 for testing binocular or stereoscopic vision, e.g. strabismus
• CPC Class Codes: A61B 3/085 for testing strabismus
• CPC Class Codes: A61B 3/10 Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• CPC Class Codes: A61B 3/1005 for measuring distances inside the eye, e.g. thickness of the cornea A61B3/11 takes precedence
• CPC Class Codes: A61B 3/101 for examining the tear film
• CPC Class Codes: A61B 3/1015 for wavefront analysis
• CPC Class Codes: A61B 3/102 : for optical coherence tomography [OCT]
• CPC Class Codes: A61B 3/1035 : for measuring astigmatism testing astigmatism A61B3/036
• CPC Class Codes: A61B 3/113 : for determining or recording eye movement
• CPC Class Codes: A61B 3/12 : for looking at the eye fundus, e.g. ophthalmoscopes A61B3/13 takes precedence
• CPC Class Codes: A61B 3/1216 : for diagnostics of the iris
• CPC Class Codes: A61B 3/1241 : specially adapted for observation of ocular blood flow, e.g. by fluorescein angiography
• CPC Class Codes: A61B 3/13 : Ophthalmic microscopes
• CPC Class Codes: A61B 3/14 : Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: A61B 3/165 : Non-contacting tonometers
• CPC Class Codes: A61B 5/0059 : using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0066 : Optical coherence imaging
• CPC Class Codes: A61B 5/0077 : Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 : Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/12 : Audiometering
• CPC Class Codes: A61B 5/14532 : for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/1455 : using optical sensors, e.g. spectral photometrical oximeters
• CPC Class Codes: A61B 5/14555 : specially adapted for the eye fundus
• CPC Class Codes: A61B 5/361 : Detecting fibrillation
• CPC Class Codes: A61B 5/369 : Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/398 : Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
• CPC Class Codes: A61B 5/6803 : Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 8/10 : Eye inspection
• CPC Class Codes: A61B 8/461 : Displaying means of special interest
• CPC Class Codes: A61F 2007/0004 : Eyes or part of the face surrounding the eyes
• CPC Class Codes: A61F 2007/004 : Hip
• CPC Class Codes: A61F 2009/00863 : Retina
• CPC Class Codes: A61F 9/0026 : Ophthalmic product dispenser attachments to facilitate positioning near the eye
• CPC Class Codes: A61H 2201/165 : Wearable interfaces
• CPC Class Codes: A61M 2021/0022 : by the tactile sense, e.g. vibrations
• CPC Class Codes: A61M 2021/0027 : by the hearing sense
• CPC Class Codes: A61M 2021/0066 : with heating or cooling
• CPC Class Codes: A61M 21/02 : for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: A61M 2205/3375 : Acoustical, e.g. ultrasonic, measuring means
• CPC Class Codes: A61M 2205/507 : Head Mounted Displays [HMD]
• CPC Class Codes: A61N 2005/0648 : the light being directed to the eyes
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 2027/0185 : Displaying image at variable distance
• CPC Class Codes: G02B 21/0032 : Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers G02B21/0036 - G02B21/008; means for illumination of specimens in general G02B21/06
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G02B 27/0179 : Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G02C 7/027 : considering wearer's parameters
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10024 : Color image
• CPC Class Codes: G06T 2207/10148 : Varying focus
• CPC Class Codes: G06T 2207/10152 : Varying illumination
• CPC Class Codes: G06T 2207/30041 : Eye; Retina; Ophthalmic
• CPC Class Codes: G16H 20/17 : delivered via infusion or injection
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user'"'"'s body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Claims

1. A user-wearable diagnostic health system comprising:

a frame configured to mount on the user;

an augmented reality display attached to the frame and configured to direct images to an eye of the user, wherein the augmented reality display comprises a stack of waveguides, each waveguide configured to;

allow a view of the world through the waveguide; and

form images by directing light out of the waveguide and into the eye of the user,

wherein each waveguide of the stack of waveguides comprises;

in-coupling diffractive optical elements configured to in-couple light provided by a light source, and

out-coupling diffractive optical elements configured to out-couple in-coupled light to the eye of the user,

wherein the out-coupling diffractive optical elements of one or more waveguides of the stack of waveguides are configured to output the light with a different amount of wavefront divergence than the out-coupling diffractive optical elements of one or more other waveguides of the stack of waveguides, wherein an amount of wavefront divergence of the one or more waveguides corresponds to a first depth plane and an amount of wavefront divergence of the one or more other waveguides corresponds to a second depth plane;

a light detector attached to the frame and configured to detect light reflected from an eye of the user; and

a processor configured to conduct a health analysis of the user based on light detected by the light detector.

2. The user-wearable diagnostic health system of claim 1, wherein each waveguide of the stack is configured to output light with different amounts of wavefront divergence in comparison to one or more other waveguides of the stack of waveguides.

3. The user-wearable diagnostic health system of claim 1, wherein the light detector is an image capture device.

4. The user-wearable diagnostic health system of claim 1, wherein the light detector is configured to track movement of eyes of the user.

5. The user-wearable diagnostic health system of claim 1, wherein the light detector is configured to image a fundus of the eye of the user.

6. The user-wearable diagnostic health system of claim 5, wherein the light detector is configured to image microcirculation in the fundus.

7. The user-wearable diagnostic health system of claim 6, wherein the processor is configured to analyze brain health and heart health based on the imaged microcirculation.

8. The user-wearable diagnostic health system of claim 6, wherein the processor is configured to detect hypertension.

9. The user-wearable diagnostic health system of claim 1, wherein the augmented reality display is configured to display one or more images at varying depths, wherein the light detector is configured to capture images of the eye while focused at these varying depths.

10. The user-wearable diagnostic health system of claim 9, wherein the light detector is configured to capture images of the eye by detecting light of visible wavelengths.

11. The user-wearable diagnostic health system of claim 9, wherein the light detector is configured to capture images of the eye by detecting non-visible wavelengths of light.

12. The user-wearable diagnostic health system of claim 11, wherein the non-visible wavelengths are wavelengths of infrared light.

13. The user-wearable diagnostic health system of claim 1, wherein the augmented reality display is configured to project, during the health analysis, an image to the eye, the image containing an object appearing to be placed at a variable location and depth plane.

14. The user-wearable diagnostic health system of claim 1, wherein the light detector comprises a plurality of photodetectors, wherein the photodetectors are arranged at different angles to the user.

15. The user-wearable diagnostic health system of claim 1, further comprising a user illumination light source configured to emit light towards the user, wherein the light detector is configured to detect all or portions of the emitted light reflected by the user.

16. The user-wearable diagnostic health system of claim 15, wherein the user illumination light source is configured to emit non-visible light.

17. The user-wearable diagnostic health system of claim 16, wherein the non-visible light is infrared light.

18. The user-wearable diagnostic health system of claim 17, wherein the user illumination light source is configured to emit light of multiple wavelengths, wherein the system is configured to change the emitted wavelength based on features of the user to be imaged.

19. The user-wearable diagnostic health system of claim 1, wherein the augmented reality display is a fiber scanning display comprising fibers configured to project light in a pattern to form images in the eye of the user.

20. The user-wearable diagnostic health system of claim 19, wherein the light detector comprises the fibers of the fiber scanning display, wherein the fibers are configured to receive light to image the eye of the user.

21. The user-wearable diagnostic health system of claim 19, wherein the fiber scanning display is configured to project light to the eye through the fibers and to receive reflected portions of the light during the health analysis.

22. The user-wearable diagnostic health system of claim 21, wherein the fiber scanning display is configured to change a wavelength of light projected through the fibers into the eye.

23. The user-wearable diagnostic health system of claim 22, wherein the fiber scanning display is configured to change the wavelength of light projected through the fibers to provide depth information for tissue that the light is reflected from.

24. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by monitoring an eyelid of the user.

25. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by monitoring a pupil of the user.

26. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by detecting, using information captured by the light detector, one or more of:

eye movements, eye movement patterns, blinking patterns, eye vergence, fatigue, changes in eye color, depth of focus of the eye, and changes in focal distance for the eye.

27. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by detecting, using information captured by the light detector, one or more of:

eye fatigue, dry eye, and hypertension.

28. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct a health analysis of the user by applying pattern recognition to light detected by the light detector.

29. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by detecting an intraocular pressure of the eye.

30. The user-wearable diagnostic health system of claim 29, wherein the processor is configured to detect intraocular pressure based on an amount or density of backscattered light detected by the light detector.

31. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to conduct the health analysis by directing the augmented reality display to provide light stimulation to the eye of the user.

32. The user-wearable diagnostic health system of claim 1, further comprising one or more sensors configured to conduct a non-eye diagnostic of the user.

33. The user-wearable diagnostic health system of claim 32, wherein the one or more sensors comprises an EEG sensor, wherein the processor is configured to conduct the health analysis by detecting brain activity.

34. The user-wearable diagnostic health system of claim 33, wherein the system is configured to issue an alert triggered by the detection of brain activity, wherein the alert is issued to one or both of the user and a clinician.

35. The user-wearable diagnostic health system of claim 32, wherein the one or more sensors comprises one or more sensors selected from the group consisting of temperature sensors, pressure sensors, light sensors, non-invasive blood glucose sensors, and ETCO2 sensors.

36. The user-wearable diagnostic health system of claim 1, further comprising one or more sensors configured to monitor one or more conditions of the ambient environment of the user, wherein the system is configured to conduct the health analysis using data collected by the one or more sensors.

37. The user-wearable diagnostic health system of claim 36, wherein the one or more sensors comprises a camera configured to image the ambient environment.

38. The user-wearable diagnostic health system of claim 37, wherein the camera and processor are configured to identify and analyze food, drug, nutrients and toxins that the user intakes.

39. The user-wearable diagnostic health system of claim 37, wherein the processor is configured to determine a head pose of the user based on information received from the camera.

40. The user-wearable diagnostic health system of claim 36, wherein processor is configured to correlate the one of more conditions of the ambient environment with other user health data.

41. The user-wearable diagnostic health system of claim 36, wherein the one or more sensors comprises one or more of location and orientation sensors.

42. The user-wearable diagnostic health system of claim 41, wherein the one or more of location and orientation sensors comprise an accelerometer, a GPS sensor, a compass, a gyroscope, an inertial measurement device, and a camera.

43. The user-wearable diagnostic health system of claim 41, wherein the processor is configured to conduct the health analysis by determining environmental information based upon a location of the user.

44. The user-wearable diagnostic health system of claim 43, wherein the processor is configured to conduct the health analysis by accessing information characterizing the location, wherein the information comprises one or more of pollen count, demographics, air pollution, environmental toxins, poverty, lifestyle statics, or proximity to a health-care provider.

45. The user-wearable diagnostic health system of claim 44, wherein the processor is configured to access remotely-stored information.

46. The user-wearable diagnostic health system of claim 36, wherein the one or more sensors comprises a microphone.

47. The user-wearable diagnostic health system of claim 46, wherein the system is configured to detect eating by a user by detecting sounds indicative of chewing by the user.

48. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to perform the health analysis autonomously.

49. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to perform the health analysis semi-autonomously with input from a clinician.

50. The user-wearable diagnostic health system of claim 1, wherein the processor is configured to perform the health analysis under control of a clinician.

51. The user-wearable diagnostic health system of claim 1, wherein the system is configured to provide results of the health analysis to a clinician.

52. The user-wearable diagnostic health system of claim 1, further comprising one or more output devices for providing non-optical stimulation to the user.

53. The user-wearable diagnostic health system of claim 52, wherein the one or more output devices comprises a speaker, wherein the processor is configured to conduct the health analysis by directing the augmented reality display to provide auditory stimulation to the user.

54. The user-wearable diagnostic health system of claim 52, wherein the one or more output devices comprises a heater.

55. The user-wearable diagnostic health system of claim 52, wherein the one or more output devices comprises a cooler.

56. The user-wearable diagnostic health system of claim 1, wherein the system is configured to track health data over time.

57. The user-wearable diagnostic health system of claim 56, wherein the system is configured to compare contemporaneous health data with historical health data.

58. The user-wearable diagnostic health system of claim 57, wherein the system is configured to send alerts to a clinician in response to comparing the contemporaneous health data and historical health data.

59. The user-wearable diagnostic health system of claim 1, wherein the system is configured to compare user health data with standard data for individuals of a particular age group.

60. The user-wearable diagnostic health system of claim 1, wherein the system is configured to conduct the health analysis by occluding areas of a field of vision of the user.

61. The user-wearable diagnostic health system of claim 1, wherein the system is configured to track user movements and to reduce noise in images captured by the light detector based on the tracked user movements.

62. The user-wearable diagnostic health system of claim 61, wherein the user movements comprise movements of the eyes of the user, wherein the system is configured to reduce noise in images captured by the light detector based on the tracked eye movements.

63. The user-wearable diagnostic health system of claim 61, wherein the system is configured to authenticate an identity of the user before conducting the health analysis.

64. The user-wearable diagnostic health system of claim 63, wherein the system is configured to authenticate the identity of the user by performing one or both of an iris scan and a retina scan.

65. A wearable diagnostic health system comprising:

a frame configured to mount on a clinician;

an augmented reality display attached to the frame and configured to direct images to an eye of the clinician, wherein the augmented reality display comprises a stack of waveguides, each waveguide configured to;

allow a view of the world through the waveguide; and

form images by directing light out of the waveguide and into the eye of the clinician,

wherein each waveguide of the stack of waveguides comprises;

in-coupling diffractive optical elements configured to in-couple light provided by a light source, and

out-coupling diffractive optical elements configured to out-couple in-coupled light to the eye of the user,

wherein the out-coupling diffractive optical elements of one or more waveguides of the stack of waveguides are configured to output the light with a different amount of wavefront divergence than the out-coupling diffractive optical elements of one or more other waveguides of the stack of waveguides, wherein an amount of wavefront divergence of the one or more waveguides corresponds to a first depth plane and an amount of wavefront divergence of the one or more other waveguides corresponds to a second depth plane;

an outward-facing image capture device configured to image an eye of a patient; and

a processor configured to conduct a health analysis of the patient based on the image of the eye captured by the image capture device.

66. The diagnostic health system of claim 65, wherein the outward facing image capture device is configured to image an interior of an eye of the patient.