SYSTEMS AND METHODS FOR HYPERSPECTRAL MEDICAL IMAGING

• US 20090318815A1
• Filed: 05/22/2009
• Published: 12/24/2009
• Est. Priority Date: 05/23/2008
• Status: Abandoned Application

• Current Assignee: Spectral Image, Inc.
• Original Assignee: Spectral Image, Inc.
• Inventors: Barnes, Michael, Pan, Zhihong, Zhang, Sizhong
• Application Number:
  US12/471,141
• Publication Number:
  US 20090318815A1
• Time in Patent Office: Days
• US Class Current: 600/473
• CPC Class Codes: A61B 2560/0223 of calibration, e.g. protocols for calibrating sensors
• CPC Class Codes: A61B 2562/0233 Special features of optical sensors or probes classified in A61B5/00
• CPC Class Codes: A61B 2562/046 in a matrix array
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/0079 using mirrors, i.e. for self-examination
• CPC Class Codes: A61B 5/1077 Measuring of profiles
• CPC Class Codes: A61B 5/417 the bone marrow
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: A61B 5/726 using Wavelet transforms
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 2201/03 Recognition of patterns in medical or anatomical images
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients

Abstract

Under one aspect, an apparatus for analyzing the skin of a subject includes a hyperspectral sensor for obtaining a hyperspectral image of the subject. The apparatus further includes a control computer that is in electronic communication with the hyperspectral sensor and which controls at least one operating parameter of the hyperspectral sensor. The control computer includes a processor unit and a computer readable memory. The memory includes executable instructions for controlling the at least one operating parameter of the hyperspectral sensor. The memory includes executable instructions for applying a wavelength dependent spectral calibration standard constructed for the hyperspectral sensor to a hyperspectral image collected by the hyperspectral sensor. The apparatus further includes a light source that illuminates the skin of the subject for the hyperspectral sensor.

Claims

1. An apparatus for analyzing the skin of a subject, the apparatus comprising:

(A) a hyperspectral sensor that is configured to take a hyperspectral image of the skin of said subject;

(B) a control computer for controlling the hyperspectral sensor, wherein the control computer is in electronic communication with the hyperspectral sensor and wherein the control computer controls at least one operating parameter of the hyperspectral sensor, and wherein the control computer comprises a processor unit and a computer readable memory comprising;

(i) executable instructions for controlling said at least one operating parameter of the hyperspectral sensor; and

(ii) executable instructions for applying a wave-length dependent spectral calibration standard constructed for the hyperspectral sensor to a hyperspectral image collected by the hyperspectral sensor; and

(C) a light source that illuminates the skin of the subject for the hyperspectral sensor.

2. The apparatus of claim 1, wherein the at least one operating parameter is a sensor control.

3. The apparatus of claim 1, wherein the at least one operating parameter is an exposure setting.

4. The apparatus of claim 1, wherein the at least one operating parameter is a frame rate.

5. The apparatus of claim 1, wherein the at least one operating parameter is an integration rate.

6. The apparatus of claim 1, the apparatus further comprising a scan mirror that simulates motion for a hyperspectral scan of the skin of the subject.

7. The apparatus of claim 1, wherein the light source comprises a polarizer that polarizes a light that illuminates the skin of the subject for the hyperspectral sensor.

8. The apparatus of claim 7, wherein the hyperspectral sensor comprises a cross polarizer.

9. The apparatus of claim 1, wherein the hyperspectral sensor comprises a sensor head, and wherein the executable instructions for controlling said at least one operating parameter comprises moving the sensor head through a range of distances relative to the subject, including a first distance that permits a wide field view of a portion of the subject'"'"'s skin, and a second distance that permits a detailed view of a portion of the subject'"'"'s skin.

10. The apparatus of claim 1, wherein the hyperspectral sensor is mounted on a sensor tripod.

11. The apparatus of claim 1, wherein the hyperspectral sensor is mounted on a mobile rack.

12. The apparatus of claim 1, wherein the computer readable memory further comprises:

a plurality of signatures, each signature in the plurality of signatures corresponding to a characterized human lesion; and

instructions for comparing a spectrum acquired using the hyperspectral sensor to a signature in the plurality of signatures.

13. The apparatus of claim 1, wherein the computer readable memory further comprises a trained data analysis algorithm that identifies a region of the subject'"'"'s skin of biological interest using a hyperspectral image obtained by the apparatus.

14. The apparatus of claim 13, wherein the trained data analysis algorithm is a trained neural network, a trained support vector machine, a decision tree, or a multiple additive regression tree.

15. The apparatus of claim 1, wherein the computer readable memory further comprises a trained data analysis algorithm that characterizes a region of the subject'"'"'s skin of biological interest using a hyperspectral image obtained by the apparatus.

16. The apparatus of claim 15, wherein the trained data analysis algorithm is a trained neural network, a trained support vector machine, a decision tree, or a multiple additive regression tree.

17. The apparatus of claim 1, wherein the computer readable memory further comprises a trained data analysis algorithm that determines a portion of a hyperspectral data cube that contains information about a biological insult to the subject'"'"'s skin.

18. The apparatus of claim 17, wherein the trained data analysis algorithm is a trained neural network, a trained support vector machine, a decision tree, or a multiple additive regression tree.

19. The apparatus of claim 1, wherein the computer readable memory further comprises

a plurality of spectra of the subject'"'"'s skin taken at different time points;

and

executable instructions for using the plurality of spectra to form a normalization baseline of the skin.

20. The apparatus of claim 19, wherein the different time points span one or more contiguous years.

21. The apparatus of claim 19, wherein the executable instructions for using the plurality of spectra to form a normalization baseline of the skin comprise executable instructions for analyzing the plurality of spectra to determine a time when a biological insult to the skin originated.

22. The apparatus of claim 21, wherein the biological insult is a lesion.

23. The apparatus of claim 1, the apparatus further comprising a digital camera, a LIDAR sensor, or a terahertz sensor that is configured for taking a secondary image of the skin.

24. The apparatus of claim 23, wherein the computer readable memory further comprises executable instructions for fusing the secondary image with the hyperspectral image.

25. The apparatus of claim 23, wherein the computer readable memory further comprises executable instructions for color coding or greyscaling data from the hyperspectral image into the secondary image.

26. The apparatus of claim 23, wherein the computer readable memory further comprises executable instructions for color coding or greyscaling data from the secondary image into the hyperspectral image.

27. The apparatus of claim 1, further comprising an integrated display for displaying they hyperspectral image and a value of the at least one operating parameter in response to instructions from the control computer.

28. The apparatus of claim 27, wherein the integrated display further displays the probabilistic presence of a biological insult to the skin of the subject.

29. The apparatus of claim 1, wherein the computer readable memory further comprises executable instructions for determining a boundary of an image of a biological insult in the hyperspectral image.

30. The apparatus of claim 29, wherein the executable instructions for determining a boundary of an image of a biological insult in the hyperspectral image receives manual input from a user in order to determine the boundary

31. The apparatus of claim 29, wherein the executable instructions for determining a boundary of an image of a biological insult in the hyperspectral image implements a trained data analysis algorithm in order to determine the boundary.

32. The apparatus of claim 29, wherein the executable instructions for determining a boundary of an image of a biological insult in the hyperspectral image further comprise executable instructions for communicating the boundary of the image to a local or remote computer over a network connection.

33. The apparatus of claim 32, wherein the executable instructions for determining a boundary of an image of a biological insult in the hyperspectral image further comprise executable instructions for communicating a frame of reference of the skin of the subject with the boundary of the image to the local or remote computer over the network connection.

34. A method of diagnosing a medical condition in a subject, the subject having a plurality of regions, the method comprising:

obtaining light from each region of the plurality of regions without regard to a visible characteristic of the plurality of regions;

resolving the light obtained from each region of the plurality of regions into a corresponding spectrum;

determining, based on a stored spectral signature corresponding to the medical condition, a numeric probability that each spectrum includes indicia of the medical condition being present in the corresponding region; and

displaying an indicator representing the numeric probability of a presence of the medical condition in the corresponding region when the numeric probability exceeds a pre-defined threshold,

wherein the resolving or the determining are performed using one or more suitably programmed computers.

35. A method of diagnosing a medical condition in subject, the subject having a plurality of regions, the method comprising:

resolving light obtained from each region of the plurality of regions into a corresponding spectrum;

obtaining, based on a stored spectral signature corresponding to the medical condition, a numeric probability that each spectrum includes indicia of the medical condition being present in the corresponding region;

displaying an indicator representing the probable presence of the medical condition in the corresponding region when the numeric probability exceeds a first pre-defined threshold,

accepting user input setting a second pre-defined threshold; and

displaying an indicator representing the probable presence of the medical condition in the corresponding region when the probability exceeds the second pre-defined threshold,

wherein the obtaining is performed using a suitably programmed computer.

36. A method of diagnosing a medical condition in subject, the subject having a plurality of regions, the method comprising:

resolving light obtained from each region of the plurality of regions into a corresponding spectrum;

obtaining, based on a stored spectral signature corresponding to the medical condition, a numeric probability that each spectrum includes indicia of the medical condition being present in the corresponding region; and

displaying, when the numeric probability exceeds a first pre-defined threshold, an indicator representing the probable presence of the medical condition in the corresponding region, and displaying at least one of a type of the medical condition, a category of the medical condition, an age of the medical condition, a boundary of the medical condition, and a new area of interest for examination,

wherein the obtaining is performed using a suitably programmed computer.

37. A method of diagnosing a medical condition in subject, the method comprising:

(A) obtaining, at a first distance from the subject, light from each region of a first plurality of regions of the subject;

(B) resolving the light obtained from each region of the first plurality of regions into a corresponding spectrum;

(C) determining, based on a spectral characteristic present in a subset of the first plurality of regions, a second distance from the subject allowing for closer examination of the subset;

(D) obtaining, at a second distance from the subject, light from each region of a second plurality of regions of the subject, the second plurality of regions including the subset;

(E) resolving the light obtained from each region of the second plurality of regions into a corresponding spectrum;

(F) obtaining, based on a stored spectral signature corresponding to the medical condition, a numeric probability that each spectrum includes indicia of the medical condition being present in the corresponding region; and

(G) displaying, when the numeric probability exceeds a pre-defined threshold, an indicator representing the probable presence of the medical condition in the corresponding region, wherein the resolving (B), determining (C), or resolving (E) is determined using a suitably programmed computer.

38. A method of characterizing a medical condition in a subject, the subject having a plurality of regions, the method comprising:

at a first time, resolving light obtained from each region of the plurality of regions into a corresponding spectrum;

storing the spectra corresponding to the first time;

at a second time subsequent to the first time, resolving light obtained from each region of the plurality of regions into a corresponding spectrum;

based on a comparison of the spectra corresponding to the second time to the spectra corresponding to the first time, determining that the medical condition had been present at the first time although it had not been apparent at the first time; and

displaying an indicator representing the probable presence of the medical condition in the subject.