Method of assessing localized shape and temperature of the human body

• US 7,519,210 B2
• Filed: 09/09/2005
• Issued: 04/14/2009
• Est. Priority Date: 09/09/2004
• Status: Expired due to Fees

• Current Assignee: Carnegie Mellon University, University of Pittsburgh of The Commonwealth System of Higher Education
• Original Assignee: Carnegie Mellon University
• Inventors: Hirsch, Raphael, Huber, Daniel, Osborn, James, Denes, Louis J., Kwoh, Chian Kent
• Primary Examiner(s): Azarian; Seyed
• Application Number:
  US11/223,565
• Publication Number:
  US 20060062448A1
• Time in Patent Office: 1,313 Days
• Field of Search: 382/100, 382/103, 382/108, 382/128, 382/129, 382/130, 382/131, 382/132, 382/133, 382/154, 382/168, 382/181, 382/193, 382/199, 382/203, 382/219, 382/224, 382/232, 382/274, 382/276, 382/285, 382/305, 382/312, 382/318, 382/134, 280/33.991, 280/33, 280/991, 370/331, 600/427, 600/416, 427/140, 378/41
• US Class Current: 382/128
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/103 Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes A61B5/08 takes precedence; measuring aids for tailors A41H1/00; measuring instruments specially adapted for dentistry A61C19/04
• CPC Class Codes: A61B 5/4528 Joints A61B5/4533, A61B5/4538 take precedence
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06T 2207/20212 Image combination
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 10/70 using pattern recognition or machine learning optical pattern recognition or electronic computations therefor G06V10/88
• CPC Class Codes: G06V 40/11 Hand-related biometrics; Hand pose recognition

Abstract

A method of objectively quantifying assessments of joints having arthritis for purposes of assessment, diagnosis and treatment. The objective measurements utilize known imaging modalities including 3D scanning, thermal imaging, visible and near-infrared imaging and two-dimensional imaging to quantify swelling, heat distribution, erythema, and range or motion. The objective measurements can be combined in various ways to assess the extent of the disease and can be used to adjust treatment protocols.

Claims

1. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model;

comparing said three dimensional surface model to a reference model;

using a computer; and

calculating the change in volume between said imaged three dimensional surface model and said reference three dimensional model, where in said step of calculating comprises the steps of;

taking a cross section of said imaged model;

performing a three dimensional alignment of the surface of said imaged model and the corresponding surface of said reference models;

determining pairs of corresponding points between the outer bounds of each model;

constructing a line segment between each pair of corresponding points;

constructing three dimensional solids whose boundaries are said line segments

calculating the volumes of said solids; and

summing said volumes.

2. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model;

comparing said three dimensional surface model to a reference model;

using a computer; and

calculating the change in volume between said imaged three dimensional surface model and said reference three dimensional model, wherein said step of calculating comprises the steps of;

taking a cross section of said imaged model;

superimposing said cross-section of said imaged model with the cross section of said reference model;

placing squares of a pre-determined size into the area between said imaged cross section and said reference cross section; and

summing the area of said squares.

3. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model;

comparing said three dimensional surface model to a reference model;

using a computer; and

calculating the change in volume between said imaged three dimensional surface model and said reference three dimensional model, wherein said step of calculating comprises the steps of;

taking a cross section of said imaged model;

superimposing said cross-section of said imaged model with the cross section of said reference model;

placing squares of a pre-determined size into the area between said imaged cross section and said reference cross section; and

summing the area of said squares; and

repeating said steps for cross sections at multiple, different areas of said body part.

4. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model;

comparing said three dimensional surface model to a reference model;

imaging said body part with a thermal camera;

specifying a region of interest within said image; and

combining said thermal image with said three dimensional surface model in said region of interest;

determining any differences in shape of said body part between said three dimensional surface model and said reference model;

calculating any changes in volume between said three dimensional surface model and said reference model;

correlating said differences in shape and said changes in volume with said thermal image; and

assessing, based on said differences in shape and said changes in volume, and said correlation with said thermal image, if said body part is arthritic, wherein said body part is a joint.

5. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model;

comparing said three dimensional surface model to a reference model;

imaging said body part with a thermal camera;

specifying a region of interest within said image; and

combining said thermal image with said three dimensional surface model in said region of interest;

calculating the heat distribution index across said region of interest;

calculating a composite disease activity index having both volume and temperature components, said index representing the degree of severity of said arthritis, wherein said body part is a joint.

6. The method of claim 5 further comprising the step of recommending a course of treatment for said arthritis based on said composite disease activity index.

7. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model; and

comparing said three-dimensional surface model to a reference model;

imaging said body part with a near-infrared imager;

comparing said image with a reference image to determine the degree of erythema on the surface of the skin in the vicinity of said body part; and

combining said image with said three dimensional surface model to provide an overall assessment of said body part; and

wherein said near-infrared imager images a range of wavelengths between 700 nm and 1100 nm.

8. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model;

comparing said three-dimensional surface model to a reference model;

imaging said body part with a thermal camera;

imaging said body part with a near-infrared imager;

imaging said body part with a visual imager; and

combining said three dimensional surface model, said thermal image, said near-infrared image and said visual image into one composite image; and

calculating a composite disease activity index having components selected from a group consisting of shape , volume, temperature and erythema, said index representing the degree of severity of said arthritis.

9. A method of diagnosing or treating arthritis in a joint comprising the steps of:

imaging said joint with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model of said joint;

comparing said three dimensional surface model with a reference model of said joint;

determining any changes in shape between said three dimensional surface model and said reference model;

calculating changes in volume between said three dimensional surface model and said reference model;

diagnosing or adjusting said treatment based on said changes in shape or volume;

wherein said step of calculating comprises the steps of;

taking a cross section of said surface model;

superimposing said imaged cross section with the cross section of said reference model;

placing squares of a pre-determined size into the area between said imaged cross section and said reference model cross section;

summing the area of said squares; and

repeating the above steps at pre-determined intervals across the surface of said body part.

10. A method of assessing the shape of a body part comprising the steps of:

imaging said body part with a three dimensional scanner from one or more angles;

using a computer;

combining said images to create a three dimensional surface model; and

comparing said three-dimensional surface model to a reference model;

imaging said joint with a near-infrared imager;

comparing said image with a reference image to determine the degree of erythema on the surface of the skin in the vicinity of said body part; and

combining said image with said three dimensional surface model to provide an overall assessment of said body part;

wherein said near-infrared imager images a range of wavelengths between 700 nm and 1100 nm.

11. The method of claim 10 further comprising the step of calculating a composite disease activity index having shape, volume and erythema components, said index representing the degree of severity of said arthritis.

12. The method of claim 11 further comprising the step of adjusting said course of treatment for said arthritis based on said the change in said composite disease activity index.

13. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

wherein said step of calculating comprises the steps of;

superimposing said imaged cross section with the cross section of said reference model;

placing squares of a pre-determined size into the area between said imaged cross section and said cross section of said reference model;

summing the area of said squares; and

repeating the above steps at pre-determined intervals across the surface of said joint.

14. The method of claim 13 further comprising the step of repeating said steps for cross sections at multiple, different areas of said joint.

15. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

wherein said step of calculating comprises the steps of;

aligning said three dimensional surface model and said reference model;

superimposing a grid of voxels over said aligned models; and

summing the volumes of said voxels which lie between boundaries defined on the models.

16. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging each of said joints with a thermal camera;

specifying a region of interest within said image for each of said joints, said region of interest including said joint; and

combining said thermal image of each of said joints with said three dimensional surface model of each of said joints;

wherein said combining step includes texture mapping said thermal image onto said three dimensional surface model.

17. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging each of said joints with a thermal camera;

specifying a region of interest within said image for each of said joints, said region of interest including said joint; and

combining said thermal image of each of said joints with said three dimensional surface model of each of said joints;

wherein said combining step includes projecting said three dimensional surface model onto said thermal image.

18. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging each of said joints with a thermal camera;

specifying a region of interest within said image for each of said joints, said region of interest including said joint; and

combining said thermal image of each of said joints with said three dimensional surface model of each of said joints;

determining if the areas of said three dimensional surface model having said volume changes are consistent with areas of said thermal image having elevated temperatures for each of said joints.

19. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging each of said joints with a thermal camera;

specifying a region of interest within said image for each of said joints, said region of interest including said joint; and

combining said thermal image of each of said joints with said three dimensional surface model of each of said joints;

calculating a composite disease activity index having shape, volume and temperature components for each of said joints, to determine how many of said joints have active arthritis; and

substituting said composite disease activity index for said an assessment of the number of joints with active arthritis in the calculation of said global assessment.

20. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging said joint with a visible range imager and a near infrared imager;

comparing said image with a reference image to determine the degree of erythema on the surface of the skin in the vicinity of said joint; and

combining said image with said thermal image and said three dimensional surface model to provide an overall assessment of said joint.

21. The method of claim 20 further comprising the steps of:

calculating a composite disease activity index having shape, volume and erythema components; and

substituting said composite disease activity index for said an assessment of the number of joints with active arthritis in the calculation of said global assessment.

22. In a method of calculating a global assessment of a patient afflicted with arthritis, said global assessment having components including a physician global assessment of disease activity, a parent/patient assessment of overall well-being, a functional ability assessment, an assessment of the number of joints with active arthritis, an assessment of the number of joints with limited range of motion and erythrocyte sedimentation rate, an improvement comprising the steps of:

imaging one or more joints of the body with a three dimensional scanner from one or more angles;

combining said images to create a three dimensional surface model of each joint;

using a computer;

taking a cross section of said each model;

obtaining an assessment of each joint by determining any difference in shape or calculating any difference in volume between said imaged three dimensional model and a reference three dimensional model to determine how many of said joints have active arthritis; and

substituting said determination for said an assessment of the number of joints with active arthritis in the calculation of said global assessment;

imaging each of said joints in two dimensions as said joint is rotated though its full range of motion;

measuring the range of motion on said two dimensional images for each of said joints to determine if the range of motion is limited for any of said joints; and

using the number of joints determined to be limited in range of motion in the calculation of said global assessment.