Health monitoring system using outwardly manifested micro-physiological markers

• US 10,470,670 B2
• Filed: 03/13/2018
• Issued: 11/12/2019
• Est. Priority Date: 07/01/2015
• Status: Active Grant

• Current Assignee: Rememdia, LC (Sarcos Technology & Robotics Corp.)
• Original Assignee: Rememdia LLC
• Inventors: Smith, Fraser M.
• Primary Examiner(s): Levicky, William J
• Application Number:
  US15/920,385
• Publication Number:
  US 20180199828A1
• Time in Patent Office: 609 Days
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/4806 Sleep evaluation A61B5/4821 takes precedence; devices for inducing sleep A61M21/02
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: A61B 5/7275 Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30076 Plethysmography
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients

Abstract

A camera coupled to a processor is disclosed. The camera is configured to capture images of the subject. The processor is configured to amplify microscopic temporal variations between the images of the subject and generate a profile of at least one microscopic temporally detected physiological variation of the subject. The processor is further configured to compare the profile of the subject to a pre-existing first aggregate profile of a plurality of third-party subjects, said aggregate profile corresponding to the at least one microscopic temporally detected physiological variation of the third-party subjects, the aggregate third-party profile corresponding to a known state of the third-party subjects.

Claims

1. A device configured to monitor visible physiological conditions of a subject, comprising:

a processor;

a camera in communication with the processor, the camera configured to capture at least a first and second image of the subject, said processor comprising executable code configured to amplify microscopic temporal variations between the first and second image of the subject and generate a profile of at least one microscopic temporally detected physiological variation of a portion of the subject,

wherein said processor is further configured to;

compare the profile of the subject to a pre-existing baseline aggregate profile of the subject, said baseline aggregate profile corresponding to the at least one microscopic temporally detected physiological variation of the portion of the subject, said baseline aggregate profile corresponding to a known state of the subject; and

determine a probability that a state of the subject corresponds to the known state of the subject; and

an output from the processor corresponding to the probability that the state of the subject corresponds to the known state of the subject,

wherein said processor is further configured to detect differences between the profile of the subject and the pre-existing baseline aggregate profile of the subject.

2. The device of claim 1, wherein the physiological variation comprises micro-variations in the movement of eyes of the subject, a coloration of a face and/or neck of the subject, a musculature of the subject, or a combination of these.

3. The device of claim 1, further comprising a database containing the pre-existing baseline aggregate profile of the subject.

4. The device of claim 1, wherein the physiological variation comprises micro-variations in a coloration of skin of the subject.

5. The device of claim 1, wherein the known state comprises one of an emotional state, a mental state, or a physiological state.

6. The device of claim 1, wherein the camera is configured to detect a first band of wavelengths of light ranging from 150 to 400 nm, a second band of wavelengths of light ranging from 400 to 700 nm and a third band of wavelengths of light ranging from 700 to 1100 nm.

7. The device of claim 1, wherein the device further comprises a mobile assembly coupled to the camera configured to move the device about a pre-determined area corresponding to an area of movement of the subject, wherein the device is configured to propel itself about a plurality of pre-determined areas during pre-determined periods of time.

8. The device of claim 1, further comprising a wireless device coupled to the processor configured to receive signals from a monitoring device adapted to be coupled directly to the subject, wherein the monitoring device comprises one of a pulse oximeter, an EKG, or a thermometer.

9. The device of claim 1, further comprising an input device coupled to the camera configured to receive a biological sample from the subject, wherein the input device comprises one of a breathalyzer, a urine sampling device, a saliva sampling device, sweat sampling device, lymph sampling device, tear sampling device, or a blood sampling device.

10. The device of claim 1, wherein the processor comprises a wireless device configured to wirelessly communicate with and access image data from cameras that are not coupled to the device within a pre-determined area corresponding to an area frequented by the subject, wherein the cameras correspond to the subject'"'"'s cellular phone, personal computer device, gaming system, security system, or tablet.

11. The device of claim 1, wherein the processor comprises a wireless device configured to communicate with a remote computer device adapted to communicate with the processor, the remote computer device corresponding to a health care professional.

12. The device of claim 11, wherein the processor is configured to:

detect a modified state of the subject that creates a pre-determined level of risk to the subject;

calculate a level of risk to the subject created by performing a pre-determined treatment; and

perform the pre-determined treatment on the subject based upon the level of risk to the subject created by performing the pre-determined treatment.

13. The device of claim 12, wherein, in response to the pre-determined level of risk to the subject created by performing the pre-determined treatment exceeding a threshold level of risk to the subject, the processor is configured to receive a clearance signal from a remote computer device adapted to communicate with the processor, the clearance signal corresponding to a health care professional prior to performing the pre-determined treatment.

14. The device of claim 1, wherein the processor is configured to:

receive, from the camera, information related to activity conducted by the subject and identified using the camera, the activity comprising the amount of sleep obtained by the subject within a pre-determined period of time and/or the subject'"'"'s diet; and

store the information.

15. The device of claim 1, further comprising a sound recording device coupled to the processor.

16. The device of claim 15, wherein the processor is configured to amplify temporal variations between a first and second voice recording of the subject and generate a profile of at least one micro temporally detected variation of the voice of the subject.

17. A computer-implemented method for monitoring visible physiological conditions of a subject, comprising:

capturing at least a first and second image of a portion of a subject with a camera operably coupled to a processor;

generating, with the processor, a profile of at least one microscopic temporally detected physiological variation of a portion of the subject by amplifying microscopic temporal physiological variations between the first and second image of the subject;

comparing, with the processor, the profile of the subject to a pre-existing baseline aggregate profile of the subject, said baseline aggregate profile corresponding to the at least one microscopic temporally detected physiological variation of the portion of the subject; and

detecting, with the processor, differences between the profile of the subject and the pre-existing baseline aggregate profile of the subject.

18. The method of claim 17, further comprising predicting a health risk of a patient corresponding to a state of the subject based on a known state of the subject.

19. The method of claim 17, further comprising measuring micro-variations in the coloration of the skin of the subject.

20. The method of claim 17, further comprising measuring micro-variations in the movement of the eyes of the subject, the coloration of the face and/or neck of the subject, the musculature of the subject, or a combination of these.

21. The method of claim 17, further comprising storing in a database the pre-existing baseline aggregate profile of the subject, and storing in the database the profile of the subject.

22. The method of claim 17, further comprising operating a medical device assistant to monitor visible physiological conditions of the subject, wherein the medical device assistant comprises a mobile assembly comprising the camera and the processor.

23. The method of claim 22, further comprising communicating data associated with the profile from the medical device assistant to a remote computing device of a health care professional.

24. The method of claim 17, further comprising graphically displaying data corresponding to the at least one microscopic temporally detected physiological variation.

25. The method of claim 17, further comprising detecting, with the camera, a first band of wavelengths of light ranging from 150 to 400 nm, and detecting a second band of wavelengths of light ranging from 400 to 700 nm, and detecting a third band of wavelengths of light ranging from 700 to 1100 nm.

26. The method of claim 17, further comprising transmitting signals from a monitoring device coupled directly to the subject to a wireless device coupled to the processor, wherein the monitoring device comprises one of a pulse oximeter, an EKG, or a thermometer.

27. The method of claim 17, further comprising inserting a biological sample from the subject into an input device coupled to the camera, wherein the input device comprises one of a breathalyzer, a urine sampling device, a saliva sampling device, sweat sampling device, lymph sampling device, tear sampling device, or a blood sampling device.

28. The method of claim 17, further comprising transmitting signals from a wireless device coupled to the processor to a remote computer device corresponding to a health care professional.

29. The method of claim 17, further comprising amplifying temporal variations between a first and second voice recording of the subject, and generating a profile of at least one micro temporally detected variation of the voice of the subject.

30. A non-transitory computer-readable medium having computer executable instructions for performing the method recited in claim 17.