Capturing data for individual physiological monitoring

• US 8,831,299 B2
• Filed: 05/22/2007
• Issued: 09/09/2014
• Est. Priority Date: 05/22/2007
• Status: Expired due to Fees

• Current Assignee: Monument Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Kurtz, Andrew F., Gobeyn, Kevin M., Olson, Donald E., Border, John N.
• Primary Examiner(s): STREGE, JOHN B
• Application Number:
  US11/751,648
• Publication Number:
  US 20080292151A1
• Time in Patent Office: 2,667 Days
• Field of Search: 382/128, 382/254
• US Class Current: 382/128
• CPC Class Codes: A61B 3/10 Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/1038 Measuring plantar pressure during gait
• CPC Class Codes: A61B 5/1176 Recognition of faces
• CPC Class Codes: A61B 5/411 Detecting or monitoring allergy or intolerance reactions to an allergenic agent or substance
• CPC Class Codes: A61B 5/442 Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: A61B 5/4547 Evaluating teeth
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment

Abstract

A method for capturing images of an individual to determine wellness for such individual, including establishing baseline physiological data for the individual, and baseline capture condition data for the individual; detecting and identifying the presence of the individual in the image capture environment; providing semantic data associated with the individual; capturing one or more images of the individual during a capture event and determining the capture conditions present during the capture event; using the event capture conditions, the baseline physiological data for the individual and the baseline capture condition data to determine the acceptability of event captured images; and using the acceptable images and the semantic data in determining the wellness of the individual.

Claims

1. A method comprising:

capturing, by a processor, an image of an individual based at least on a privacy setting;

capturing, by the processor, condition data associated with the captured image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data is a measure of a light level of an image capture environment of the captured image;

assessing, by the processor, image acceptability of the captured image for determining a physiological condition of the individual, wherein assessing the image acceptability of the captured image comprises assessing at least the ambient lighting data of the condition data, and wherein the image acceptability of the captured image is based at least on predefined condition criteria; and

accumulating, by the processor, a longitudinal record from two or more acceptable captured images of the individual and condition data associated with the two or more acceptable captured images, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period.

2. The method of claim 1, wherein the predefined condition criteria are quantified using statistical measures of the variability of the condition data.

3. The method of claim 1, wherein a set-up process determines the predefined condition criteria from baseline capture conditions relative to orientation of the individual, size of the individual, lighting conditions, reference features, or combinations thereof.

4. The method of claim 1, wherein the image capture environment is monitored relative to lighting characteristics, and wherein the lighting characteristics include intensity, white point, color temperature, color balance, or spectral composition, or combinations thereof.

5. The method of claim 4, wherein the image capture environment is monitored with an ambient light detector, an image sensor, or a spectral detector, or combinations thereof.

6. The method of claim 1, wherein the acceptable captured image is modified using image normalization transforms.

7. The method of claim 1, wherein the condition data is derived as capture parameters from one or more captured images acquired during a capture event.

8. The method of claim 1, wherein the predefined condition criteria are partially defined by semantic data associated with the individual.

9. The method of claim 8, wherein the semantic data associated with the individual includes personal data concerning physical characteristics, privacy settings, physiological conditions information of the individual or the individual'"'"'s family, personal behavior, or activity records.

10. The method of claim 1, further comprising capturing a longitudinal record of images of a group of individuals to determine wellness for each individual in the group of individuals.

11. The method of claim 10, wherein the group of individuals comprise a family unit, in which semantic data for an individual partially defines condition criteria for that individual, and wherein a portion of the semantic data for an individual is common with semantic data for at least some of the other individuals in the family.

12. The method of claim 1, wherein the accumulation of the longitudinal record occurs automatically on an ongoing basis over a time period, wherein the time period comprises days, months, or years.

13. The method of claim 1, further comprising capturing additional data via sensing devices, wherein the sensing devices include an infrared image capture device, a motion detector, a microphone, or an electric potential probe.

14. The method of claim 1, wherein the assessing the image acceptability further comprises:

determining a presence of reference features in the captured image, wherein the reference features include measures of an eye-to-eye distance of the individual, whiteness of the sclera of the individual, skin tone color components of the individual, eye movements of the individual, or combinations thereof.

15. The method of claim 1, wherein the assessing the image acceptability further comprises determining whether variations in the ambient lighting conditions or pose of the individual prevents derivation of reliable quantitative data regarding physiological conditions from the captured images.

16. The method of claim 1, further comprising:

deriving quantitative data regarding physiological conditions of the individual based at least on the captured image; and

expressing the derived quantitative data as wellness parameters, wherein the wellness parameters are indicative of the wellness of the individual.

17. The method of claim 1, wherein the capturing the image of the individual comprises capturing only a portion of the image of the individual according to the privacy setting.

18. The method of claim 1, wherein the capturing the image of the individual further comprises blurring an area of the image of the individual according to the privacy setting.

19. A system comprising:

one or more processors configured to;

capture an image of an individual based at least on a privacy setting;

capture condition data associated with the captured image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data is a measure of a light level of an image capture environment of the captured image;

assess image acceptability of the captured image for determining a physiological condition of the individual, wherein assessing the image acceptability of the captured image comprises assessing at least the ambient lighting data of the condition data, and wherein the image acceptability of the captured image is based at least on predefined condition criteria; and

accumulate a longitudinal record from two or more acceptable captured images of the individual and associated condition data, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period.

20. The system of claim 19, wherein the predefined condition criteria are partially defined by semantic data associated with the individual.

21. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions to capture an image of an individual based at least on a privacy setting;

instructions to capture condition data associated with the captured image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data is a measure of a light level of an image capture environment of the captured image;

instructions to assess image acceptability of the captured image for determining a physiological condition of the individual, wherein assessing the image acceptability of the captured image comprises assessing at least the ambient lighting data of the condition data, and wherein the image acceptability of the captured image is based at least on predefined condition criteria; and

instructions to accumulate a longitudinal record from two or more acceptable captured images of the individual and associated condition data, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period.

22. The non-transitory computer-readable medium of claim 21, wherein the predefined condition criteria are partially defined by semantic data associated with the individual.

23. A method comprising:

receiving, by a processor, an image of an individual based at least on a privacy setting;

receiving, by the processor, condition data associated with the image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data comprises a measure of a light level of an image capture environment associated with the image;

accumulating, by the processor, a longitudinal record from two or more acceptable images of the individual and condition data associated with the two or more acceptable images, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period; and

determining, by the processor, a physiological condition associated with the individual based at least on the longitudinal record from two or more acceptable images and the condition data.

24. The method of claim 23, further comprising:

assessing image acceptability of the image for determining the physiological condition of the individual, wherein the image acceptability of the image is based at least on predefined condition criteria; and

performing automatic image capture and automatic image assessment until an acceptable image is acquired or the individual leaves the image capture environment.

25. A system comprising:

a memory; and

one or more processors coupled to the memory, wherein the one or more processors are configured to;

receive an image of an individual based at least on a privacy setting;

receive condition data associated with the image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data comprises a measure of a light level of an image capture environment associated with the image;

accumulate a longitudinal record from two or more acceptable images of the individual and condition data associated with the two or more acceptable images, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period; and

determine a physiological condition associated with the individual based at least on the longitudinal record from two or more acceptable images and the condition data.

26. The system of claim 25, wherein the one or more processors are further configured to:

assess image acceptability of the image for determining the physiological condition of the individual, wherein the image acceptability of the image is based at least on predefined condition criteria; and

perform automatic image capture and automatic image assessment until an acceptable image is acquired or the individual leaves the image capture environment.

27. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions to receive an image of an individual based at least on a privacy setting;

instructions to receive condition data associated with the image, wherein the condition data includes ambient lighting data, and wherein the ambient lighting data comprises a measure of a light level of an image capture environment associated with the image;

instructions to accumulate a longitudinal record from two or more acceptable images of the individual and condition data associated with the two or more acceptable images, wherein the longitudinal record provides a visual history of the individual over a time period with the captured images in the visual history not more frequent than weekly to enable detection of changes in physiological conditions of the individual over the time period; and

instructions to determine a physiological condition associated with the individual based at least on the longitudinal record from two or more acceptable images and the condition data.

28. The non-transitory computer-readable medium of claim 27, wherein the instructions further comprise:

instructions to assess image acceptability of the image for determining the physiological condition of the individual, wherein the image acceptability of the image is based at least on predefined condition criteria; and

instructions to perform automatic image capture and automatic image assessment until an acceptable image is acquired or the individual leaves the image capture environment.