Method of indexing biological imaging data using a three-dimensional body representation

• US 20050033142A1
• Filed: 05/07/2004
• Published: 02/10/2005
• Est. Priority Date: 05/09/2003
• Status: Active Grant

• Current Assignee: University of Rochester Medical Center (University of Rochester)
• Original Assignee: University of Rochester Medical Center (University of Rochester)
• Inventors: Pentland, Alice P., Miller, Craig C., Madden, Brian C.
• Granted Patent: US 7,546,156 B2
• Time in Patent Office: Days
• US Class Current: 600/407
• CPC Class Codes: A61B 5/0059 using light, e.g. diagnosis by transillumination, diascopy, fluorescence A61B5/0093, A61B5/1455, A61B5/02416 and A61B5/0261 take precedence
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/1077 Measuring of profiles
• CPC Class Codes: A61B 5/442 Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders

Abstract

A system and method for managing imaging data related to a biological trait, including generating a three-dimensional representation of the external surface of the body a patient; obtaining the imaging data; associating the imaging data with a coordinate location of the three-dimensional representation, to generate an associated imaging data; and managing the associated imaging data using the surface representation. The association includes uniquely associating numerical values (e.g., Cartesian coordinates) to particular surface features. The three-dimensional model includes the ability to adjust the pose of the 3D models made from data taken at different times so that the coordinate systems closely correspond.

Claims

1. A method of managing imaging data related to a biological trait, comprising:

generating a three-dimensional representation of the external surface of the body a patient;

obtaining an imaging data related to a biological trait;

associating said imaging data with a coordinate location of said three-dimensional representation, to generate an associated imaging data; and

managing said associated imaging data using said surface representation.

2. The method of claim 1 wherein said generating comprises generating a representation comprising a three-dimensional surface grid of the body of a patient.

3. The method of claim 2 wherein said generating comprises generating a surface grid comprising a variable resolution discretization.

4. The method of claim 1 wherein said generating comprises generating a representation comprising a three-dimensional representation of the epithelial surfaces accessible through the bodily surfaces of the patient.

5. The method of claim 4 wherein said epithelial surface comprises the gastrointestinal surface of the patient.

6. The method of claim 4 wherein said epithelial surface comprises the vaginal and reproductive tract.

7. The method of claim 4 wherein said epithelial surface comprises the sinus area.

8. The method of claim 4 wherein said epithelial surface comprises eye ground findings.

9. The method of claim 1 wherein said generating a three-dimensional surface comprises generating a three-dimensional surface having a rigging, so as to enable the three-dimensional surface to be adjusted for the patient'"'"'s pose.

10. The method of claim 1 wherein said generating a three-dimensional surface comprises generating a three-dimensional surface having a geometric reference coordinate system.

11. The method of claim 1 wherein said generating a three-dimensional surface comprises generating a three-dimensional surface having cardinal reference points to form local coordinate systems.

12. The method of claim 1 wherein said obtaining comprises obtaining an imaging data comprising dermatological data.

13. The method of claim 1 wherein said obtaining comprises obtaining an imaging data comprising external surface and subsurface structure of the body of the patient.

14. The method of claim 1 wherein said obtaining comprises obtaining an imaging data comprising dermatological data including skin markings comprising nevi, vascularities, lesions, scars or combinations thereof.

15. The method of claim 1 wherein said obtaining comprises obtaining an imaging data comprising a follicular pattern.

16. The method of claim 1 wherein said obtaining said imaging data comprises obtaining a high resolution imaging data comprising a dermatological data.

17. The method of claim 16 wherein said high resolution imaging data is a dermatological data including skin markings comprising nevi, vascularities, lesions or a follicular pattern.

18. The method of claim 16 wherein said obtaining a high resolution imaging data is obtaining an imaging data having a resolution that is sufficiently high for the purposes of a medical diagnosis, or cosmetic or forensic identification.

19. The method of claim 1 wherein said obtaining comprises obtaining a two-dimensional imaging data.

20. The method of claim 1 wherein said associating comprises mapping a two-dimensional image having a surface landmark onto a three-dimensional representation, wherein said landmark is retained in said three-dimensional representation and wherein said landmark is used for said managing.

21. The method of claim 20 wherein said two-dimensional image is obtained using a camera and wherein said two-dimensional image is one of a plurality of two-dimensional images, taken with a camera or cameras at different camera positions, wherein each of said images includes a surface landmark, and wherein said three-dimensional representation accommodates said different camera positions to maintain a relationship between the two-dimensional image, its three-dimensional mapped version and its landmark.

22. The method of claim 21 wherein said three-dimensional representation of said two-dimensional image is maintained at a different resolution than said two-dimensional image, and wherein said three-dimensional representation maintains information related to the resolution of said two-dimensional image before said two-dimensional image was mapped to said three-dimensional representation.

23. The method of claim 1 wherein said associating comprises mapping said imaging data to a portion of said surface representation, wherein said portion includes said coordinate location.

24. The method of claim 1 wherein said managing is labeling, indexing, cataloging, accessing, retrieving, displaying, monitoring or comparing said associated imaging data.

25. The method of claim 1 wherein said imaging data comprises data used for the identification of an individual and said managing comprises an indexing for said identification.

26. A method of managing imaging data related to a biological trait, comprising:

generating a three-dimensional representation of the external surface of the body a patient, wherein said generating a three-dimensional surface comprises generating a three-dimensional surface having a rigging, so as to enable the three-dimensional surface to be adjusted for the patient'"'"'s pose;

obtaining an imaging data related to a biological trait, wherein said obtaining comprises obtaining a high resolution imaging data comprising dermatological data including skin markings comprising nevi, vascularities, lesions, scars or combinations thereof;

associating said imaging data with a coordinate location of said three-dimensional representation, to generate an associated imaging data, wherein said associating comprises mapping a two-dimensional image having a surface landmark onto a portion of the three-dimensional representation, wherein said portion includes said coordinate location and wherein said landmark is retained in said three-dimensional representation and wherein said landmark is used for said managing; and

managing said associated imaging data using said surface representation,

wherein said imaging data is a two-dimensional image and is obtained using a camera and wherein said two-dimensional image is one of a plurality of two-dimensional images, taken with a camera or cameras at different camera positions, wherein each of said images includes a surface landmark, and wherein said three-dimensional representation accommodates said different camera positions to maintain a relationship between the two-dimensional image, its three-dimensional mapped version and its landmark.

27. A method of assigning a body-surface coordinate system to an imaging data related to a dermatological characteristics, comprising:

generating a three-dimensional representation of the external surface of the body a patient;

rigging the three-dimensional representation to generate an articulated representation;

normalizing the three-dimensional representation for overall geometric reference dimensions;

normalizing the three-dimensional representation for cardinal reference points;

texture mapping the three-dimensional representation using low resolution 2D surface images;

texture mapping portions of the three-dimensional representation with high resolution dermatological images;

assigning the coordinate dimensions of the underlying mesh of the three-dimensional representation to the high resolution dermatological images;

interpolating 3D coordinates of the dermatological characteristics of the high resolution dermatological images from the nearest mesh vertices; and

assigning the interpolated coordinates to the dermatological characteristics.

28. A system for managing imaging data related to a biological trait, comprising:

means for generating a three-dimensional representation of the external surface of the body a patient;

means for obtaining an imaging data related to a biological trait;

means for associating said imaging data with a coordinate location of said three-dimensional representation, to generate an associated imaging data; and

means for managing said associated imaging data using said surface representation.

29. The system of claim 28 wherein said three-dimensional representation comprises a three-dimensional surface grid of the body of a patient.

30. The system of claim 29 wherein said three-dimensional representation comprises a surface grid comprising a variable resolution discretization.

31. The system of claim 28 wherein said three-dimensional representation comprises a representation comprising a three-dimensional representation of the epithelial surfaces accessible through the bodily surfaces of the patient.

32. The system of claim 31 wherein said epithelial surface comprises the gastrointestinal surface of the patient.

33. The system of claim 31 wherein said epithelial surface comprises vaginal and reproductive tract.

34. The system of claim 31 wherein said epithelial surface comprises the sinus area.

35. The system of claim 31 wherein said epithelial surface comprises eye ground findings.

36. The system of claim 28 wherein said means for generating a three-dimensional surface generate a three-dimensional surface having a rigging, so as to enable the three-dimensional surface to be adjusted for the patient'"'"'s pose.

37. The system of claim 28 wherein said means for generating a three-dimensional surface generates a three-dimensional surface having a geometric reference coordinate system.

38. The system of claim 28 wherein said means for generating a three-dimensional surface generates a three-dimensional surface having cardinal reference points to form local coordinate systems.

39. The system of claim 28 wherein said imaging data comprises an imaging data comprising dermatological data.

40. The system of claim 28 wherein said imaging data comprises imaging data comprising external surface and subsurface structure of the body of the patient.

41. The system of claim 28 wherein said imaging data comprises imaging data comprising dermatological data including skin markings comprising nevi, vascularities or lesions.

42. The system of claim 28 wherein said imaging data comprises imaging data comprising a follicular pattern.

43. The system of claim 28 wherein said imaging data comprises a high resolution imaging data comprising a dermatological data.

44. The system of claim 43 wherein said high resolution imaging data is a dermatological data including skin markings comprising nevi, vascularities, lesions or a follicular patter.

45. The system of claim 43 wherein said high resolution imaging data is an imaging data having a resolution that is sufficiently high for the purposes of a medical diagnosis, or cosmetic or forensic identification.

46. The system of claim 28 wherein said imaging data is a two-dimensional imaging data.

47. The system of claim 28 wherein said means for associating comprises routines for mapping a two-dimensional image having a surface landmark onto a three-dimensional representation, wherein said landmark is retained in said three-dimensional representation and wherein said landmark is used for said managing.

48. The system of claim 47 wherein said two-dimensional image is one of a plurality of two-dimensional images, taken with a camera or cameras at different camera positions, wherein each of said images includes a surface landmark, and wherein said three-dimensional representation accommodates said different camera positions to maintain a relationship between the two-dimensional image, its three-dimensional mapped version and its landmark.

49. The system of claim 47 wherein said three-dimensional representation of said two-dimensional image is maintained at a different resolution than said two-dimensional image, and wherein said three-dimensional representation maintains information related to the resolution of said two-dimensional image before said two-dimensional image was mapped to said three-dimensional representation.

50. The system of claim 28 wherein said means for associating comprises routines for mapping said imaging data to a portion of said surface representation, wherein said portion includes said coordinate location.

51. The system of claim 28 wherein said means for managing comprises a routine for labeling, indexing, cataloging, accessing, retrieving, displaying, monitoring or comparing said associated imaging data.

52. The system of claim 28 wherein said imaging data comprises data used for the identification of an individual and said means for managing comprises a routine for an indexing for said identification.

53. A system for managing imaging data related to a biological trait, comprising:

means for generating a three-dimensional representation of the external surface of the body a patient, wherein said generating a three-dimensional surface comprises generating a three-dimensional surface having a rigging, so as to enable the three-dimensional surface to be adjusted for the patient'"'"'s pose;

means for obtaining an imaging data related to a biological trait, wherein said obtaining comprises obtaining a high resolution imaging data comprising dermatological data including skin markings comprising nevi, vascularities, lesions, scars or combinations thereof;

means for associating said imaging data with a coordinate location of said three-dimensional representation, to generate an associated imaging data, wherein said associating comprises mapping a two-dimensional image having a surface landmark onto a portion of the three-dimensional representation, wherein said portion includes said coordinate location and wherein said landmark is retained in said three-dimensional representation and wherein said landmark is used for said managing; and

means managing said associated imaging data using said surface representation,

wherein said imaging data is a two-dimensional image and is obtained using a camera and wherein said two-dimensional image is one of a plurality of two-dimensional images, taken with a camera or cameras at different camera positions, wherein each of said images includes a surface landmark, and wherein said three-dimensional representation accommodates said different camera positions to maintain a relationship between the two-dimensional image, its three-dimensional mapped version and its landmark.

54. A system for assigning a body-surface coordinate system to an imaging data related to a dermatological characteristics, comprising:

means for generating a three-dimensional representation of the external surface of the body a patient;

means for rigging the three-dimensional representation to generate an articulated representation;

means for normalizing the three-dimensional representation for overall geometric reference dimensions;

means for normalizing the three-dimensional representation for cardinal reference points;

means for texture mapping the three-dimensional representation using low resolution 2D surface images;

means for texture mapping portions of the three-dimensional representation with high resolution dermatological images;

means for assigning the coordinate dimensions of the underlying mesh of the three-dimensional representation to the high resolution dermatological images;

means for interpolating 3D coordinates of the dermatological characteristics of the high resolution dermatological images from the nearest mesh vertices; and

means for assigning the interpolated coordinates to the dermatological characteristics.