IMAGE-ANALYSIS FOR ASSESSING HEART FAILURE

• US 20170245759A1
• Filed: 02/20/2017
• Published: 08/31/2017
• Est. Priority Date: 02/25/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jain, Jawahar, Wortham, Cody, Young, James, Sadi, Sajid, Mistry, Pranav, Bendale, Abhijit Z.
• Granted Patent: US 10,172,517 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/004 adapted for image acquisition of a particular organ or body part A61B5/0082 takes precedence; arrangements for optical scanning A61B5/0062
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/02028 Determining haemodynamic parameters not otherwise provided for, e.g. cardiac contractility or left ventricular ejection fraction
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/087 Measuring breath flow
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/44 Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails A61B5/117 takes precedence
• CPC Class Codes: A61B 5/441 Skin evaluation, e.g. for skin disorder diagnosis
• CPC Class Codes: A61B 5/4842 Monitoring progression or stage of a disease
• CPC Class Codes: A61B 5/4875 Hydration status, fluid retention of the body
• CPC Class Codes: A61B 5/7221 Determining signal validity, reliability or quality A61B5/7207 and A61B5/7217 take precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: A61B 5/747 in case of emergency, i.e. alerting emergency services
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 : for calculating health indices; for individual health risk assessment
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders

Abstract

An apparatus for assessing heart failure can include an image sensor configured to capture image data of a patient, a sensor configured to capture sensor data for the patient, a memory configured to store the image data and the sensor data, and a processor coupled to the image sensor, the sensor, and the memory. The processor is configured to receive image data in response to detecting a biological condition from the sensor data, wherein the biological condition is indicative of psychophysiological health and cardiac health. The processor is further configured to detect a visual characteristic from the image data, wherein the visual characteristic is indicative of heart health, and, in response to detecting the visual characteristic, provide an indication that the patient is experiencing a worsening of heart failure.

Claims

1. An apparatus for assessing heart failure, comprising:

an image sensor configured to capture image data of a patient;

a sensor configured to capture sensor data for the patient;

a memory configured to store the image data and the sensor data; and

a processor coupled to the image sensor, the sensor, and the memory, wherein the processor is configured to;

receive image data in response to detecting a biological condition from the sensor data, wherein the biological condition is indicative of psychophysiological health and cardiac health;

detect a visual characteristic from the image data, wherein the visual characteristic is indicative of heart health; and

in response to detecting the visual characteristic, provide an indication that the patient is experiencing a worsening of heart failure.

2. The apparatus of claim 1, wherein the visual characteristic indicates edema.

3. The apparatus of claim 2, wherein the visual characteristic indicates size of an eye of the patient.

4. The apparatus of claim 2, wherein the processor is further configured to:

determine a body part of the patient as a candidate for the edema based upon detected activity of the patient from the sensor data; and

prompt the patient to capture image data of the body part.

5. The apparatus of claim 2, wherein the processor is configured to:

generate a morphable model of a body part of the patient from the image data; and

determine geometric characteristics of pitting in the body part based upon a deformation to the morphable model specified by an input.

6. The apparatus of claim 1, wherein the visual characteristic includes skin color.

7. The apparatus of claim 1, wherein the visual characteristic includes pupil dilation.

8. The apparatus of claim 1, wherein the visual characteristic includes a facial feature of the patient indicating emotional state.

9. The apparatus of claim 1, wherein the biological condition includes chronotropic incompetence.

10. The apparatus of claim 1, wherein the biological condition includes deterioration in ventilation threshold.

11. The apparatus of claim 1, wherein the biological condition includes stress.

12. The apparatus of claim 1, wherein the biological condition includes depression.

13. A method for assessing heart failure, comprising:

processing, using a processor, sensor data for a patient obtained from a sensor to detect a biological condition, wherein the biological condition is indicative of psychophysiological health and cardiac health;

receiving, using the processor, image data in response to detecting the biological condition from the sensor data;

detecting, using the processor, a visual characteristic from the image data, wherein the visual characteristic is indicative of heart health; and

in response to detecting the visual characteristic, providing, using the processor, an indication that the patient is experiencing a worsening of heart failure.

14. The method of claim 13, wherein the visual characteristic indicates edema.

15. The method of claim 14, wherein the visual characteristic indicates size of an eye of the patient.

16. The method of claim 14, further comprising:

determining a body part of the patient as a candidate for the edema based upon detected activity of the patient from the sensor data; and

prompting the patient to capture image data of the body part.

17. The method of claim 14, further comprising:

generating a morphable model of a body part of the patient from the image data; and

determining geometric characteristics of pitting in the body part based upon a deformation to the morphable model specified by an input.

18. The method of claim 13, wherein the visual characteristic includes skin color.

19. The method of claim 13, wherein the visual characteristic includes pupil dilation.

20. The method of claim 13, wherein the visual characteristic includes a facial feature of the patient indicating emotional state.

21. The method of claim 13, wherein the biological condition includes chronotropic incompetence.

22. The method of claim 13, wherein the biological condition includes deterioration in ventilation threshold.

23. The method of claim 13, wherein the biological condition includes stress.

24. The method of claim 13, wherein the biological condition includes depression.

25. A computer program product comprising a computer readable storage medium having program code stored thereon for assessing heart failure, the program code executable by a processor to perform operations comprising:

processing sensor data for a patient obtained from a sensor to detect a biological condition, wherein the biological condition is indicative of psychophysiological health and cardiac health;

receiving image data in response to detecting the biological condition from the sensor data;

detecting a visual characteristic from the image data, wherein the visual characteristic is indicative of heart health; and

in response to detecting the visual characteristic, providing an indication that the patient is experiencing a worsening of heart failure.

26. The computer program product of claim 25, wherein the visual characteristic indicates edema.

27. The computer program product of claim 26, wherein the visual characteristic indicates size of an eye of the patient.

28. The computer program product of claim 26, wherein the program code is executable by the processor to perform operations further comprising:

determining a body part of the patient as a candidate for the edema based upon detected activity of the patient from the sensor data; and

prompting the patient to capture image data of the body part.

29. The computer program product of claim 26, wherein the program code is executable by the processor to perform operations further comprising:

generating a morphable model of a body part of the patient from the image data; and

determining geometric characteristics of pitting in the part based upon a deformation to the morphable model specified by an input.

30. The computer program product of claim 25, wherein the visual characteristic includes skin color.

31. The computer program product of claim 25, wherein the visual characteristic includes pupil dilation.

32. The computer program product of claim 25, wherein the visual characteristic includes a facial feature of the patient indicating emotional state.

33. The computer program product of claim 25, wherein the biological condition includes chronotropic incompetence.

34. The computer program product of claim 25, wherein the biological condition includes deterioration in ventilation threshold.

35. The computer program product of claim 25, wherein the biological condition includes stress.

36. The computer program product of claim 25, wherein the biological condition includes depression.

37. An apparatus for assessing heart failure, comprising:

an image sensor configured to capture image data;

a memory configured to store the image data; and

a processor coupled to the image sensor and the memory, wherein the processor is configured to;

generate a morphable model based upon image data for a selected part of a patient'"'"'s body;

receive a user specified deformation to the morphable model, wherein deformation approximates an amount of pitting experienced by the patient for the selected part of the patient'"'"'s body; and

determine severity of edema experienced by the patient based upon the deformation to the morphable model.

38. The apparatus of claim 37, wherein the processor is configured to:

determine a rate at which pitting in the selected part of the patient'"'"'s body rebounds using the morphable model.

39. The apparatus of claim 37, wherein the processor is configured to:

determine a rate at which pitting in the selected part of the patient'"'"'s body rebounds based upon image analysis of further image data of the part of the patient'"'"'s body.

40. The apparatus of claim 37, wherein the processor is configured to:

determine a dilation ratio of a pupil of the patient based upon extracted contours of an iris of the patient and the pupil of the patient from the image data; and

determine an amount of deviation in pupil dilation of the patient based upon a comparison of the dilation ratio with a reference dilation ratio.