Quantitative analysis, visualization and movement correction in dynamic processes
First Claim
1. A method for the quantitative and visual analysis of motion in a time sequence of images comprising the steps of:
- a) determination of the motion vectors for each point in the image space between images of directly or not directly subsequent time steps (i.e., the transformation of the corresponding image space) preferably by means of rigid, affine and/or “
elastic”
(including local deformations) overlapping/registration of images of an image sequence and calculation of the transformation parameter comprising the following further method steps;
a1) for the non-rigid registration, local transformation types are given stepwise from coarse to fine, first global and then increasingly more local;
a2) for more then two time steps, in order to obtain the transformation for not directly subsequent timesteps, the transformation is not only calculated in pairs for subsequent image pairs, but also a correction-registration step is further added thereto;
a3) from the transformation result directly the local, defined for each point in the image/time space, quantities velocity, acceleration, warp, tension, deviation from the finest registration (i.e., distance between the point transformed by the selected transformation type and by the most local fineness level), etc. as well as the global quantities warp energy for the entire motion as well as for each “
principal warp”
separately (Bookstein
1989), entropy, “
directedness”
of the motion and the transformation parameters for various fineness levels of the transformation;
b) reconstruction of the space-time-structure within the image space and visualization thereof by means of b1) (optionally interactive) determination of a point (or a region;
or according to a regular scheme selected point in the space or on the surface of a region) for a selectable moment, the automatic calculation of its (their) position for all other moments by means of the under a) calculated transformation (for not directly subsequent time steps) as well as the interpolated representation as 3D rendered (surface rendering) path (or “
tube”
for regions); and
/or b2) a 3D rendered reference grid, deformed according to the transformation calculated in a), animated (interpolation of intermediate time steps) or not (animation also continuously over several time steps), the image space overlapped (inserted) or not;
in an image record having several color channels, the reference grids corresponding to the various separately treated color channels can be represented in different color but simultaneously; and
/or b3) color/pattern encoding (including gray value encoding) of quantities (quantities having vector values by means of absolute values), which are assigned to a point in the image/time space as described under a), particularly for (i) all points, lying within an interactively selectable level of the image space, (ii) interactively (or regularly) selected points or surface points of interactively selected regions/shapes/surfaces (iii) the points of the under b1) determined path (or tubes) of the time space; and
/or b4) a motion corrected representation of the paths (or tubes), corrected by a rigid, affine or a selected level of the non-global transformation, or by means of a motion corrected playing of the original image sequence, particularly the color encoding can be back projected onto the original image or any other given moment.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention relates to the quantitative analysis and/or visualization (virtual or real) of moving processes and to the detection, description, correction and the comparison of global movements inside the image space. The invention particularly relates to a method and device for precisely and, while being limited to few parameters, quantitatively describing the global and local movement occurring in the image space and for the single representation of the movement of the quantitative parameters with regard to the image space. A rough to fine recording and a detection of and compensation for global movements occurs whereby enabling a tracking and a corrected visualization. The detection of the movement, which corresponds as precisely as possible to the real movement occurring in the image space is effected by a splines a plaques minces recording technique that enables the number of movement parameters to be kept low. A fully automatic execution of all partial steps is made possible.
-
Citations
14 Claims
-
1. A method for the quantitative and visual analysis of motion in a time sequence of images comprising the steps of:
-
a) determination of the motion vectors for each point in the image space between images of directly or not directly subsequent time steps (i.e., the transformation of the corresponding image space) preferably by means of rigid, affine and/or “
elastic”
(including local deformations) overlapping/registration of images of an image sequence and calculation of the transformation parameter comprising the following further method steps;
a1) for the non-rigid registration, local transformation types are given stepwise from coarse to fine, first global and then increasingly more local;
a2) for more then two time steps, in order to obtain the transformation for not directly subsequent timesteps, the transformation is not only calculated in pairs for subsequent image pairs, but also a correction-registration step is further added thereto;
a3) from the transformation result directly the local, defined for each point in the image/time space, quantities velocity, acceleration, warp, tension, deviation from the finest registration (i.e., distance between the point transformed by the selected transformation type and by the most local fineness level), etc. as well as the global quantities warp energy for the entire motion as well as for each “
principal warp”
separately (Bookstein
1989), entropy, “
directedness”
of the motion and the transformation parameters for various fineness levels of the transformation;
b) reconstruction of the space-time-structure within the image space and visualization thereof by means of b1) (optionally interactive) determination of a point (or a region;
or according to a regular scheme selected point in the space or on the surface of a region) for a selectable moment, the automatic calculation of its (their) position for all other moments by means of the under a) calculated transformation (for not directly subsequent time steps) as well as the interpolated representation as 3D rendered (surface rendering) path (or “
tube”
for regions); and
/orb2) a 3D rendered reference grid, deformed according to the transformation calculated in a), animated (interpolation of intermediate time steps) or not (animation also continuously over several time steps), the image space overlapped (inserted) or not;
in an image record having several color channels, the reference grids corresponding to the various separately treated color channels can be represented in different color but simultaneously; and
/orb3) color/pattern encoding (including gray value encoding) of quantities (quantities having vector values by means of absolute values), which are assigned to a point in the image/time space as described under a), particularly for (i) all points, lying within an interactively selectable level of the image space, (ii) interactively (or regularly) selected points or surface points of interactively selected regions/shapes/surfaces (iii) the points of the under b1) determined path (or tubes) of the time space; and
/orb4) a motion corrected representation of the paths (or tubes), corrected by a rigid, affine or a selected level of the non-global transformation, or by means of a motion corrected playing of the original image sequence, particularly the color encoding can be back projected onto the original image or any other given moment. - View Dependent Claims (2, 3, 4, 5, 6, 8, 9, 12, 13, 14)
-
-
7. A method for the registration of a data point (DP) set on a reference point (RP) set, which determines iteratively for a series of given transformation types, which allow an increasing number of local deformations, its free parameters in such a manner, that an error functional is minimized, which compares the positions of the transformed data points with those of the reference points, thereby selecting as transformation types first a rigid (rotation and translation), then an affine transformation and then transformation types, defined by a number of checkpoints, which can freely be displaced (the free parameter of the transformation) and between the displacement vectors of which with thin-plate splines is interpolated (Bookstein 1989) and, the number of checkpoints is iteratively increased (in order to allow an increasing number of local deformation), and the initial position of the checkpoints is adapted to the form of the data points and/or the reference points or the relative position thereof,
particularly for the determination of the initial position of the data point set— - whereby each point can be weight depending on its distance to the next reference point—
a point-lustering-algorithm can be exerted und the cluster center points (or the point with the highest density within each cluster, etc.) can be selected as the initial position,particularly also the sum of the quadratic distances of each DP to the next RP (to this term the distances of each reference point to the next data point can be added and/or a regularization term which smoothes too high warp) can be selected as error functional, outliers can be suppressed in several ways;
(i) starting from the distribution of the distances between the data points and the next reference point, all data points/reference points having higher distances as the median or average+standard deviation of the distribution are eliminated or (ii) instead of the quadratic distances another function of the distance is used (e.g., amount function or see Miesmator in Press et al.
1992).
- whereby each point can be weight depending on its distance to the next reference point—
-
10. A method for the partition of the space into regions of different, internally homogeneous motion, whereby the dynamic parameters are separately determined for the various regions and for this purpose first for the point set of a series of time steps a “
- point distribution model”
is established, for which the dominating main components of motion are selected, and then each point of the space is coordinated to the component which contributes the dominating part to its displacement during the time step under examination, the various region are represented by different colors.
- point distribution model”
-
11. A method for the continuous numerical description of the motion by means of statistic techniques, like clustering and histogram analysis, which simplifies the comparison of motions, application of these techniques on the pointwise determined local quantities (e.g. on the in 1b3) (i) selected level), in order to mark regions, in which a certain quantity occurs especially intensive or in which particularly those values occur, which are assumed especially often (clustering on the basis of the histogram).
Specification