System and Method for Three Dimensional Medical Imaging with Structured Light

• US 20110218428A1
• Filed: 03/04/2011
• Published: 09/08/2011
• Est. Priority Date: 03/04/2010
• Status: Abandoned Application

• Current Assignee: Medical Scan Technologies, Inc.
• Original Assignee: Medical Scan Technologies, Inc.
• Inventors: Troy, Michael Spencer, Westmoreland, Robert Joe
• Application Number:
  US13/040,952
• Publication Number:
  US 20110218428A1
• Time in Patent Office: Days
• US Class Current: 600/425
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1079 using optical or photographic means
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 6/00 Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment instruments measuring radiation intensity for application in the field of nuclear medicine, e.g. in vivo counting, G01T1/161; apparatus for taking X-ray photographs G03B42/02
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30088 Skin; Dermal
• CPC Class Codes: G06T 2207/30096 Tumor; Lesion
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/521 from laser ranging, e.g. using interferometry; from the projection of structured light
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

An SLI medical image sensor system captures one or more images of a skin lesion and generates a 3D surface map of the skin lesion using SLI techniques. A feature detection module processes the 3D surface map to detect certain characteristics of the skin lesion. Feature data of the skin lesion is generated such as size, shape and texture. A feature analysis module processes the feature data of the skin lesion. The feature analysis module compares the skin lesion to prior images and feature data for the skin lesion. The feature analysis module categorizes the skin lesion based on templates and correlations of types of features.

Claims

1. A structured light illumination (SLI) medical imaging system, comprising:

an SLI image sensor system that captures one or more two dimensional (2D) images of a skin area while a structured light pattern is projected onto the skin area;

a medical image processing module that receives the one or more 2D images and generates a three dimensional (3D) surface map of the skin area;

a feature detection module that identifies and categorizes a skin lesion from the 3D surface map of the skin area and generates feature data of the identified skin lesion; and

a feature analysis module that analyzes the feature data of the identified skin lesion to generate analysis data.

2. The SLI medical imaging system of claim 1, wherein the feature detection module generates feature data that includes texture data and position and size measurements of the identified skin lesion.

3. The SLI medical imaging system of claim 2, wherein the feature analysis module is operable to:

determine a correlation of one or more characteristics of a plurality of other identified skin lesions in the skin area of the 3D surface map;

compare the feature data of the identified skin lesion with the correlation of one or more characteristics of the other identified skin lesions to generate deviations of the feature data from the correlation;

determine whether the deviations exceed a predetermine threshold; and

generate a flag for the identified skin lesion when the deviations of the correlation exceed the predetermined threshold.

4. The SLI medical imaging system of claim 2, wherein the feature analysis module is operable to:

receive previous feature data of the identified skin lesion generated from a prior 3D surface map;

compare the feature data of the identified skin lesion with the previous feature data of the skin lesion; and

determine whether changes in the feature data exceed a predetermined threshold.

5. The SLI medical imaging system of claim 1, wherein the feature detection module comprises:

a template comparison module that compares a set of points of the 3D surface map to a skin feature template to identify the skin lesion and assign an initial category of the skin lesion with a quality assessment value.

6. The SLI medical imaging system of claim 5, wherein the skin feature template includes a feature vector, wherein each point of the vector includes 3D coordinates and texture information, corresponding to a type of skin lesion.

7. The SLI medical imaging system of claim 6, wherein the feature detection module further comprises:

a skin feature validation module that receives the initial category of the skin lesion with a quality assessment value; and

processes the set of points of the 3D surface map with one or more additional feature vectors to identify and categorize the skin lesion.

8. The SLI medical imaging system of claim 7, wherein the feature detection module further comprises:

a skin feature data module that receives the set of points of the 3D surface map of the identified skin lesion and generates feature data for the identified skin lesion, wherein the feature data includes 3D coordinates of points comprising the skin lesion, size of the skin lesion, shape of the skin lesion, color information of the skin lesion and relative placement of the skin lesion.

9. The SLI medical imaging system of claim 1, wherein the SLI image sensor system comprises:

a projection system for projecting the structured light pattern onto the skin area; and

a camera system for capturing the one or more 2D images of the skin area while the projection system projects the structured light pattern onto the skin area.

10. The SLI medical imaging system of claim 1, wherein the medical image processing module is operable to:

receive the one or more 2D images of the skin area;

segment pixels of object points from the one or more 2D images for processing; and

determine 3D coordinates and texture data from the segmented pixels of the object points to generate the 3D surface map of the skin area.

11. A method for processing images of a skin area by a processing module, comprising:

receiving a 3D surface map of a skin area for processing by a processing module;

identifying a skin lesion from the 3D surface map of the skin area and categorizing the identified skin lesion as one of a plurality of types of skin lesion by the processing module; and

generating feature data of the identified skin lesion from the 3D surface map of the identified skin lesion by the processing module, wherein the feature data includes texture data and position and size measurements of the identified skin lesion.

12. The method of claim 11, further comprising:

determining a correlation of one or more characteristics of a plurality of other identified skin lesions in the skin area of the 3D surface map;

comparing the feature data of the identified skin lesion with the correlation of one or more characteristics of the other identified skin lesions to generate deviations of the feature data from the correlation;

determining whether the deviations exceed a predetermine threshold; and

generating a flag for the identified skin lesion when the deviations of the correlation exceed the predetermined threshold.

13. The method of claim 12, further comprising:

receiving previous feature data of the identified skin lesion generated from a prior 3D surface map;

comparing the feature data of the identified skin lesion with the previous feature data of the skin lesion; and

determining whether changes in the feature data exceed a predetermined threshold.

14. The method of claim 11, wherein identifying a skin lesion from the 3D surface map of the skin area and categorizing the identified skin lesion as one of a plurality of types of skin lesion by the processing module, includes:

comparing a set of points of the 3D surface map to a skin feature template to identify the skin lesion and assign an initial category of the skin lesion with a quality assessment value, wherein the skin feature template includes a feature vector and wherein each point of the vector includes 3D coordinates and texture information, corresponding to a type of skin lesion.

15. The method of claim 11, further comprising:

receiving one or more two dimensional (2D) images of a skin area with a structured light pattern projected onto the skin area; and

generating the 3D surface map of the skin area from the 2D images.

16. The method of claim 15, further comprising:

segmenting pixels of object points from the one or more 2D images for processing; and

determining 3D coordinates and texture data from the segmented pixels of the object points to generate the 3D surface map of the skin area.

17. A method for imaging a skin area for screening for melanoma, comprising:

capturing one or more two dimensional (2D) images of a skin area with a structured light pattern projected onto the skin area;

generating the 3D surface map of the skin area from the 2D images, wherein each point of the 3D surface map includes 3D coordinates and texture data;

identifying a plurality of skin lesions from the 3D surface map of the skin area and categorizing the plurality of identified skin lesions as one of a plurality of types of skin lesion;

determining a correlation of one or more characteristics of the plurality of identified skin lesions in the skin area of the 3D surface map;

comparing one or more characteristics of one of the plurality of identified skin lesions with the correlation to generate deviations from the correlation;

determine whether the deviations exceed a predetermined threshold; and

generate a flag for the one of the plurality of identified skin lesions when the deviations of the correlation exceed the predetermined threshold.

18. The method of claim 17, further comprising:

determining feature data for the one of the plurality of identified skin lesions, wherein the feature data includes texture data and size measurements;

receiving previous feature data for the one of the plurality of identified skin lesions;

comparing the feature data for the one of the plurality of identified skin lesions with the previous feature data; and

determining whether changes in the feature data exceed a predetermined threshold.

19. The method of claim 18, further comprising:

processing the feature data for the one of the plurality of identified skin lesions to determine whether the one of the plurality of identified skin lesions includes one or more characteristics of melanoma, wherein the one or more characteristics of melanoma asymmetrical shape, irregular border, multiple colors and size approximately greater than 6 mm diameter.

20. The method of claim 19, further comprising:

providing analysis data for the one of the plurality of identified skin lesions, wherein the analysis data includes information on changes in the feature data exceeding a predetermined threshold, any detected characteristics of melanoma and whether the deviations exceed a predetermined threshold.