Automated systems and methods for skin assessment and early detection of a latent pathogenic bio-signal anomaly

• US 10,117,617 B2
• Filed: 10/07/2015
• Issued: 11/06/2018
• Est. Priority Date: 10/08/2014
• Status: Active Grant

• Current Assignee: Revealix Inc.
• Original Assignee: Revealix Inc.
• Inventors: Cantu, Adrianna, Johnson, Gary
• Primary Examiner(s): Berhanu, Etsub
• Application Number:
  US14/876,818
• Publication Number:
  US 20160100790A1
• Time in Patent Office: 1,126 Days
• Field of Search: 600306
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/0531 Measuring skin impedance
• CPC Class Codes: A61B 5/1075 for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer A61B8/0858 takes precedence
• CPC Class Codes: A61B 5/145 Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissuemeasuring of blood pressure or blood flow A61B5/02; non-radiation detecting or locating of foreign bodies in blood A61B5/06
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: A61B 5/72 Signal processing specially adapted for physiological signals or for diagnostic purposes character recognition, recognising digital ink, document-oriented image-based pattern recognition G06V30/00; recognition or understanding of postal images G06V30/424

Abstract

The present invention relates to systems and methods for early detection, assessment, monitoring and prevention of pathophysiological conditions originating and/or emanating from skin or localized tissues, including but not limited to acute or chronic episodes of soft tissue pathology, wound, injury, dermatological or rheumatoid condition where bio-signal patterns, biomarkers or other identifiable elements or references would deviate from baseline. Specifically, the present invention relates to methods and systems specially designed and adapted for early detection of a latent pathogenic bio-signal anomaly using multiple aggregated sensors before the anomaly would otherwise be detectable.

Claims

1. A scanner for detecting a latent pathogenic skin condition in a patient comprising:

an infrared sensor configured to generate a first data set;

an optical sensor configured to generate a second data set;

an input module configured to receive one or more key factor input for the patient;

a metrics module electrically connected to the infrared sensor, the optical sensor, and the input module, comprising a combinational and adaptive processor and memory, programmed to;

receive the one or more key factor input for the patient from the input module,

acquire and store the first data set and the second data set,

determine a combination weighted function based on the first and the second data sets, and

compare the combination weighted function to a baseline of key indicators to determine that the latent pathogenic skin condition is present; and

perform simultaneous localization and mapping of a portion of the patient'"'"'s body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set; and

an accelerometer and a feature matching engine configured to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image.

2. The scanner of claim 1 wherein the combinational and adaptive processor is programmed to generate temperature profiles for the portion of the patient'"'"'s body from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set.

3. The scanner of claim 1 wherein the combinational and adaptive processor is programmed to perform sizing and location analysis for the portion of the patient'"'"'s body from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set.

4. The scanner of claim 1 wherein the combinational and adaptive processor is programmed to perform the functions selected from the group consisting of skin matching, skin texture analysis, intelligent skin location identification, reflection analysis, color analysis, environmental temperature detection, and range determination from the first data set and the second data set while the combinational and adaptive processor acquires the first data set and the second data set.

5. The scanner of claim 1 further comprising:

the feature matching engine is configured to use incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing.

6. The scanner of claim 1 further comprising:

a visible-light projector configured to project user interface elements onto the skin of the patient; and

the infrared sensor is configured to detect user interactions with the projected user interface elements.

7. A monitoring system for detecting a latent pathogenic skin condition in a patient comprising:

an infrared sensor configured to generate a first data set and an optical sensor configured to generate a second data set;

an input module configured to receive one or more key factor input for the patient;

a metrics module electrically connected to the infrared sensor and the optical sensor and the input module, comprising a combinational and adaptive processor and memory, programmed to;

receive the one or more key factor input for the patient from the input module,

acquire and store the first data set and the second data set,

determine a combination weighted function based on the first and the second data sets, and

compare the combination weighted function to a baseline of key indicators to determine that the latent pathogenic skin condition is present; and

perform simultaneous localization and mapping of a portion of the patient'"'"'s body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set;

a feature matching engine configured to use an incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing; and

an accelerometer and the feature matching engine configured to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image.

8. The system of claim 7 further comprising:

a visible-light projector configured to project user interface elements onto the skin of the patient; and

the infrared sensor is configured to detect user interactions with the projected user interface elements.

9. The system of claim 7 further comprising:

multiple real-time sensors selected from the group consisting of mono visible cameras, stereo visible cameras, mono infrared cameras, stereo infrared cameras, infrared pile sensors, spot measuring sensors, ambient temperature sensors, ambient light sensors, gas sensors, ultrasound sensors, near-infrared light sensors, gyroscopes, accelerometers, GPS sensors, Wi-Fi sensors, other location aware sensors, depth sensing sensors, bar ID scanners, patient ID scanners, terahertz sub-dermal scanners, ultrasound scanners, impedance spectroscopy sensors, and moisture sensors.

10. The system of claim 7 wherein the key indicator is selected from the group consisting of bio-signals, temperature profile, temperature differences, temperature comparisons, color indicators, color gradient indications, reflectivity indexes, texture indexes, area, areas interest, volume, contour heights, key performance markers, and key indicating factors.

11. The system of claim 7 wherein the one or more key factors are selected from the group consisting of data from the patient'"'"'s Electronic Health Record (“

EHR”

), the patient'"'"'s profile, key ratios for the combinational and adaptive processor, trigger points for the combinational and adaptive processor, priming functions for the combinational and adaptive processor, and override parameters.

12. The system of claim 7 wherein the baseline of key indicators is a population key indicator baseline.

13. The system of claim 7 wherein the baseline of key indicators is an individual key indicator baseline.

14. A method for detecting a latent pathogenic skin condition in a patient comprising:

using an infrared sensor to generate a first data set;

using an optical sensor to generate a second data set;

using an input module to receive one or more key factor input for the patient;

using a metrics module electrically connected to the infrared sensor, the optical sensor, and the input module, comprising a combinational and adaptive processor and memory, to

receive with the metrics module the one or more key factor input for the patient from the input module,

acquire and store with the metrics module the first data set and the second data set,

determine with the metrics module a combination weighted function based on the first and the second data sets, and

compare with the metrics module the combination weighted function to a baseline of key indicators to determine if that the latent pathogenic skin condition is present; and

perform with the metrics module simultaneous localization and mapping of a portion of the patient'"'"'s body with the infrared sensor and the optical sensor while the combinational and adaptive processor acquires the first data set and the second data set;

projecting with a visible-light projector user interface elements onto the skin of the patient; and

determining with the infrared sensor interactions with the projected user interface elements.

15. The method of claim 14 further comprising:

using an accelerometer and a feature matching engine to receive simultaneously-captured visual images from the optical sensor and thermal images from the infrared sensor, perform feature detection on the visual images and thermal images, perform a homography calculation on the visual images and thermal images using timestamps from the accelerometer to align the detected features in the visual and thermal images, perform homography transformations on one or both of the visual images and thermal images, and perform image fusion on the resulting transformed image.

16. The method of claim 15 further comprising:

using the feature matching engine to use an incremental alignment of successive visual images from the optical sensor to augment a thermal image from the infrared sensor to provide a super resolution thermal image adequate for anatomical referencing.