Image processing method and system, and medical examination apparatus, for extracting a path following a threadlike structure in an image

• US 7,016,521 B1
• Filed: 06/05/2000
• Issued: 03/21/2006
• Est. Priority Date: 06/04/1999
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Florent, Raoul
• Primary Examiner(s): Mancuso, Joseph
• Assistant Examiner(s): GORADIA, SHEFALI DINESH
• Application Number:
  US09/587,394
• Time in Patent Office: 2,115 Days
• Field of Search: 382/197, 382/202, 382/226, 382/128, 382/156, 382/157, 382/158, 600/407, 128/920
• US Class Current: 382/128
• CPC Class Codes: G06T 2207/10121 Fluoroscopy
• CPC Class Codes: G06T 2207/30021 Catheter; Guide wire
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06V 10/267 by performing operations on regions, e.g. growing, shrinking or watersheds

Abstract

An image processing method of extracting the points of a path following a threadlike structure in an image (IP) formed by a grid of Potential points. A first processing step (4) implements a first path-tracking operation using a front marching technique denoted Filiation Front Marching Technique (FFM) for supplying at least one First Track of the threadlike structure, formed by succeeding points denoted Fathers and Children, by marching a Front of points forwards from a fixed Start point (A) to a fixed End point (B). A second processing step (5) implements a second path-tracking operation using the Filiation Front Marching Technique for supplying a Best Path from one First Track by back propagating the Front starting at the End Point and going through already determined Children and Fathers until the Start Point is reached.

Claims

1. An image processing method of extracting points of a path following a threadlike structure in an image formed by a grid of potential points, the image processing method comprising:

marching a front of points forward starting at a predetermined start point until a predetermined end point of the grid is reached to thereby identify at least one track formed by succeeding points denoted fathers and corresponding children of the threadlike structure; and

back propagating the front along a first track starting at the end point through the children and the fathers of the first track until the start point is reached whereby the points of the path following the threadlike structure in the image are extracted.

2. The method of claim 1, wherein the marching the front of points forward starting at the predetermined start point until the predetermined end point of the grid is reached includes:

conditionally selecting a first child of the grid to succeed a first father of the grid.

3. The method of claim 2,

wherein the first child is conditionally selected in accordance with a location for the first father that pertains to the front, and a first cumulated cost for the first that is minimal compared to other points of the front.

4. The method of claim 2,

wherein the first child is conditionally selected in accordance with a location for the first child that is on a same row or a same column of the grid as the first father with a one grid point interval, and a second cumulated cost for the first child including a first term of a minimum among cumulated costs of the succeeding points already selected from the start point to the first father and a second term of the potential at the first child.

5. The method of claim 2,

wherein the first child is conditionally selected in accordance with a filiation that determines the first child becomes a possible second father of the front for further forwarding the front.

6. The method of claim 5,

wherein a curvature value (K_k) at the first child along the first track is derived from a turning angle value which is defined as an angle between the tangent to the track at the first child and a reference axis so that a term based on the curvature value (K_k) is taken into account to calculate the function (CC_k) of cumulated costs in order to penalize track trajectories having too many points associated to important curvature values.

7. The method of claim 6,

wherein, from the curvature value (K_k) and from a weight factor (W) which takes the potential at the first child and the curvature into account, the function (CC_k) of cumulated costs is provided by the following recursive relation

CC_K=α

CC<sub>K−

1</sub>+(1−

α

)[Q_K+W.K_K]. 

 

(10)

8. The method of claim 2,

wherein a function of cumulated costs (CC_k) associated with the first child is calculated as follows as a potential mean value (1):

$\begin{array}{cc}{\mathrm{CC}}_k=\frac{1}{L_k}<br><br>\underset{j=1}{\overset{j=k}{\sum <br><br>}}<br><br>Q_j& \left(1\right)\end{array}$

where variable k is the total number of current points between the start point and the first child, (Q_j) are the potentials at the current points located between the start point and the first child, and (L_k) is a length of a path between the start point and the first father calculated using a city block distance law.

9. The method of claim 8,

wherein the length of the path between the start point and the first child is calculated using the city block distance law by adding 1 each time any father along the path fathoms a child, so that when the first father is located at a determined distance (L_k) from the start point, the first child is located at an updated distance, which is the distance of the first father plus one unity (L_k+1, L_k+1) and so that the function of cumulated costs (CC_k) associated with the first child may be written according to relation (2):

$\begin{array}{cc}{\mathrm{CC}}_k=\frac{\left({\mathrm{CC}}_{k+1}\right)<br><br>\left(L_{k-1}\right)+Q_k}{L_k}& \left(2\right)\end{array}$

which is a function of cumulated cost for the first child calculated from the function of cumulated cost of the first father (CC<sub>k−

1</sub>), the potential at the first child (Q_k), and the distance from the start point to the father (L<sub>k−

1</sub>).

10. The method of claim 8,

wherein the function (CC_k) of cumulated cost to attribute to the first child is calculated using an average effected on predetermined limited temporal spans which permits a taking of local events into account.

11. The method of claim 10,

wherein calculating the function (CC_k) of cumulated cost using an average effected on predetermined limited temporal spans is obtained using one parameter α

which is a weight factor progressively minimizing the influence of points situated farther away than at a given distance from the first child so that the function (CC_k) of cumulated costs is given by the following relation (3);

CC_K=α

CC<sub>K−

1</sub>+(1−

α

)Q_K 

 

(3)

where the weight factor α

is a constant and fixes the temporal span, and the number of fathers which is taken into account, where CC<sub>k−

1</sub> is the function of cumulated costs related to the first father and (Q_k) is the potential at the current point.

12. The method of claim 11, wherein:

the span may be approximated by the relation;

1/(1−

α

) where 0<

α

<

1. 

 

(4)

13. A system, comprising:

means for acquiring image data from an original image representing a threadlike structure on a background, the image data including digital intensity levels and pixel coordinates in the original image;

means for constructing an image of potentials in which each pixel of the original image is associated to a potential forming a grid of points;

means for setting end points within the image of potentials, the end points including a start point and an end point between which a path following the threadlike structure is to be determined; and

means for marching a front from the start point through points dented as fathers and children to the end point and to subsequently propagate backwards from the end point through each child and father of a first track until the start point is reached.

14. An image processing system of performing a path-tracking operation to extract points of a threadlike structure in an image formed of a grid of potential points from at least one track formed of succeeding points denoted first points (fathers) and corresponding second points (children) of the threadlike structure by marching a front of points forwards, the method comprising:

means for setting a predetermined start point and a predetermined end point in the grid; and

means for propagating the front forwards between the start point and the end point when the following conditions are satisfied for selecting a second point (child) to succeed a first point (father) of the grid to form the track, wherein the conditions include

a first location for the first point (father) which must already pertain to the front, and a criterion of cost for the first point (father) referred to as cumulated costs which must be minimal compared to the cumulated costs of other points of the front,

a second location for the second point (child), which must be on the same row or column of the grid (city block distance) as the first point (father) with one grid point interval, and a criterion of cost referred to as cumulated costs for said second point (child) which must be minimal compared to cumulated costs obtained with other possible first points (fathers), and

a filiation according to which said determined second point (child) becomes a possible further first point (father) of the front for further forwarding the front, said cumulated costs including a term of the minimum among the cumulated costs of the succeeding points already selected from the start point to a so-called first point and a term of the potential at a so-called second point.