Apparatus, method, and computer readable medium for assisting medical image diagnosis using 3-D images representing internal structure

• US 8,417,009 B2
• Filed: 01/26/2011
• Issued: 04/09/2013
• Est. Priority Date: 03/29/2010
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Mizuno, Osamu
• Primary Examiner(s): Bella, Matthew
• Assistant Examiner(s): HEIDEMANN, JASON E
• Application Number:
  US13/014,295
• Publication Number:
  US 20110237938A1
• Time in Patent Office: 804 Days
• Field of Search: None
• US Class Current: 382/131
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/30056 Liver; Hepatic
• CPC Class Codes: G06T 2207/30061 Lung
• CPC Class Codes: G06T 2207/30096 Tumor; Lesion
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/187 involving region growing; involving region merging; involving connected component labelling

Abstract

A lesion area detection unit detects an abnormal peripheral structure (lesion area), a pulmonary blood vessel extraction unit extracts a branch structure (pulmonary blood vessel) from the three-dimensional medical image, an associated blood vessel identification unit identifies an associated branch structure functionally associated with the abnormal peripheral structure based on position information of each point in the extracted branch structure, and an associated lung parenchymal area identification unit identifies an associated peripheral area (lung parenchyma) functionally associated with the identified associated branch structure based on the position information of each point in the extracted branch structure.

Claims

1. A medical image diagnosis assisting apparatus, comprising:

an abnormal peripheral structure detection means for detecting, from a three-dimensional medical image representing a subject'"'"'s internal structure having a branch structure and a peripheral structure which is a structure located in a periphery of the branch structure and functionally associated with the branch structure, an abnormal peripheral structure which is an abnormal portion of the peripheral structure;

a branch structure extraction means for extracting the branch structure from the three-dimensional medical image;

an association identification means for identifying a point in the branch structure functionally associated with each point in the peripheral structure based on position information of each point in the extracted branch structure and for obtaining a control area of each branch of the extracted branch structure based on the identified functional correspondence between each point in the peripheral structure and each point in the branch structure;

an associated branch structure identification means for identifying a portion of the branch structure functionally associated with the abnormal peripheral structure as an associated branch structure based on the obtained control area of each branch of the extracted branch structure; and

an associated peripheral structure identification means for identifying a portion of the peripheral structure functionally associated with the identified associated branch structure as an associated peripheral structure based on the obtained control area of each branch of the extracted branch structure and the identified associated branch structure,

wherein the associated peripheral structure is an area functionally associated with the branch structure from the associated branch structure to a periphery leading from the associated branch structure.

2. The medical image diagnosis assisting apparatus of claim 1, wherein:

the apparatus further comprises an abnormal peripheral structure enlargement means for enlarging the abnormal peripheral structure according to a given growth condition representing a degree of future growth of the abnormal peripheral structure; and

the associated branch structure identification means identifies a portion of the branch structure functionally associated with the abnormal peripheral structure after the enlargement as the associated branch structure.

3. The medical image diagnosis assisting apparatus of claim 2, wherein:

the given growth condition represents a plurality of growth steps;

the abnormal peripheral structure enlargement means enlarges the abnormal peripheral structure with respect to each growth step;

the associated branch structure identification means identifies the associated branch structure with respect to each growth step;

the associated peripheral structure identification means identifies the associated peripheral structure with respect to each growth step; and

the apparatus further comprises a means for generating, from the three-dimensional medical image, one or more images which represent at least the associated peripheral structure and the associated branch structure, and indicate a change in the associated peripheral structure between each of the growth steps in a visually recognizable manner.

4. The medical image diagnosis assisting apparatus of claim 3, wherein the one or more images further indicate a change in the abnormal peripheral structure between each of the growth steps in a visually recognizable manner.

5. The medical image diagnosis assisting apparatus of claim 1, wherein the associated branch structure identification means extends the portion of the branch structure functionally associated with the abnormal peripheral structure to the proximal side of the branch structure according to a given growth condition representing a degree of future growth of the abnormal peripheral structure and identifies the portion after the extension as the associated branch structure.

6. The medical image diagnosis assisting apparatus of claim 1, wherein the associated peripheral structure identification means identifies a portion of the peripheral structure functionally associated with the portion of the branch structure functionally associated with the abnormal peripheral structure and a portion of the branch structure on the distal side of the portion functionally associated with the abnormal peripheral structure as the associated peripheral structure.

7. The medical image diagnosis assisting apparatus of claim 1, wherein:

the subject'"'"'s internal structure comprises a second branch structure different from the branch structure; and

the apparatus further comprises a second branch structure extraction means for extracting the second branch structure from the three-dimensional medical image and an intersection point detection means for detecting an intersection point between a boundary plane of the associated peripheral structure and the second branch structure.

8. The medical image diagnosis assisting apparatus of claim 7, further comprising a means for generating, from the three-dimensional medical image, an image which represents at least the associated peripheral structure, the associated branch structure, and the second branch structure adjacent to the two structures, and indicates the intersection point in a visually recognizable manner.

9. The medical image diagnosis assisting apparatus of claim 1, wherein the subject'"'"'s internal structure is a lung and the branch structure is a blood vessel or a bronchus.

10. The medical image diagnosis assisting apparatus of claim 1, wherein the subject'"'"'s internal structure is a liver and the branch structure is a blood vessel.

11. A medical image diagnosis assisting method, comprising the steps of:

detecting, from a three-dimensional medical image representing a subject'"'"'s internal structure having a branch structure and a peripheral structure which is a structure located in a periphery of the branch structure and functionally associated with the branch structure, an abnormal peripheral structure which is an abnormal portion of the peripheral structure;

extracting the branch structure from the three-dimensional medical image;

identifying a point in the branch structure functionally associated with each point in the peripheral structure based on position information of each point in the extracted branch structure and obtaining a control area of each branch of the extracted branch structure based on the identified functional correspondence between each point in the peripheral structure and each point in the branch structure;

identifying a portion of the branch structure functionally associated with the abnormal peripheral structure as an associated branch structure based on the obtained control area of each branch of the extracted branch structure; and

identifying a portion of the peripheral structure functionally associated with the identified associated branch structure as an associated peripheral structure based on the obtained control area of each branch of the extracted branch structure and the identified associated branch structure,

wherein the associated peripheral structure is an area functionally associated with the branch structure from the associated branch structure to a periphery leading from the associated branch structure.

12. A non-transitory computer readable recording medium on which is recorded a medical image diagnosis assisting program for causing a computer to perform the steps of:

detecting, from a three-dimensional medical image representing a subject'"'"'s internal structure having a branch structure and a peripheral structure which is a structure located in a periphery of the branch structure and functionally associated with the branch structure, an abnormal peripheral structure which is an abnormal portion of the peripheral structure;

extracting the branch structure from the three-dimensional medical image;

identifying a point in the branch structure functionally associated with each point in the peripheral structure based on position information of each point in the extracted branch structure and obtaining a control area of each branch of the extracted branch structure based on the identified functional correspondence between each point in the peripheral structure and each point in the branch structure;

identifying a portion of the branch structure functionally associated with the abnormal peripheral structure as an associated branch structure based on the obtained control area of each branch of the extracted branch structure; and

identifying a portion of the peripheral structure functionally associated with the identified associated branch structure as an associated peripheral structure based on the obtained control area of each branch of the extracted branch structure and the identified associated branch structure,

wherein the associated peripheral structure is an area functionally associated with the branch structure from the associated branch structure to a periphery leading from the associated branch structure.

13. A medical image diagnosis assisting apparatus, comprising:

an abnormal peripheral structure detection means for detecting, from a three-dimensional medical image representing a subject'"'"'s internal structure having a branch structure and a peripheral structure which is a structure located in a periphery of the branch structure and functionally associated with the branch structure, an abnormal peripheral structure which is an abnormal portion of the peripheral structure;

a branch structure extraction means for extracting the branch structure from the three-dimensional medical image;

an associated branch structure identification means for identifying a portion of the branch structure functionally associated with the abnormal peripheral structure as an associated branch structure based on position information of each point in the extracted branch structure; and

an associated peripheral structure identification means for identifying a portion of the peripheral structure functionally associated with the identified associated branch structure as an associated peripheral structure based on the position information of each point in the extracted branch structure,

wherein the subject'"'"'s internal structure comprises a second branch structure different from the branch structure; and

the apparatus further comprises a second branch structure extraction means for extracting the second branch structure from the three-dimensional medical image and an intersection point detection means for detecting an intersection point between a boundary plane of the associated peripheral structure and the second branch structure.