Apparatus and method for digital microscopy imaging
First Claim
Patent Images
1. A method for rendering a mosaic representation of an object from a series of image frames of the object, the method comprising:
- acquiring a current image frame of the object;
determining a current image frame tracking position of the current image frame based on a previous image frame position of a previous image frame and a relative displacement of the current image frame from the previous image frame;
identifying at least one neighboring keyframe within a search area defined relative to the current image frame tracking position, the at least one neighboring keyframe being one of a plurality of keyframes stored in a keyframe database, each keyframe having an associated keyframe position;
determining relative displacements of the current image frame from each of the at least one neighboring keyframes;
determining current image frame positions of the current image frame based on the keyframe positions of each of the at least one neighboring keyframes and the relative displacement of the current image frame from each of the at least one neighboring keyframes;
determining a current image frame position as an average of the current image frame positions;
storing the current image frame as a new keyframe in the keyframe database upon determining that each of the relative displacements of the current image frame from each of the at least one neighboring keyframes is greater than a threshold value;
storing the current image frame position as a new keyframe position associated with the new keyframe in the keyframe database;
rendering the current image frame at its current image frame position and the keyframes from the keyframe database on a display at their respective associated keyframe positions to obtain the mosaic representation of the object.
1 Assignment
0 Petitions
Accused Products
Abstract
A microscopy imaging system and method for rendering a mosaic representation of an object from a series of image frames of the object are disclosed. A current image frame is processed to determine its relative location or position within the mosaic representation based on relative displacement of the current image from one or more keyframes. Once the current image frame'"'"'s position has been determined, it is rendered along with its neighboring keyframes to provide the mosaic representation of the object.
-
Citations
35 Claims
-
1. A method for rendering a mosaic representation of an object from a series of image frames of the object, the method comprising:
-
acquiring a current image frame of the object; determining a current image frame tracking position of the current image frame based on a previous image frame position of a previous image frame and a relative displacement of the current image frame from the previous image frame; identifying at least one neighboring keyframe within a search area defined relative to the current image frame tracking position, the at least one neighboring keyframe being one of a plurality of keyframes stored in a keyframe database, each keyframe having an associated keyframe position; determining relative displacements of the current image frame from each of the at least one neighboring keyframes; determining current image frame positions of the current image frame based on the keyframe positions of each of the at least one neighboring keyframes and the relative displacement of the current image frame from each of the at least one neighboring keyframes; determining a current image frame position as an average of the current image frame positions; storing the current image frame as a new keyframe in the keyframe database upon determining that each of the relative displacements of the current image frame from each of the at least one neighboring keyframes is greater than a threshold value; storing the current image frame position as a new keyframe position associated with the new keyframe in the keyframe database; rendering the current image frame at its current image frame position and the keyframes from the keyframe database on a display at their respective associated keyframe positions to obtain the mosaic representation of the object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 33)
-
-
31. An imaging system comprising:
-
an image acquisition module to acquire a current image frame of an object; a processor configured to; determine a current image frame tracking position of the current image frame based on a previous image frame position of a previous image frame and a relative displacement of the current image frame from the previous image frame; identify at least one neighboring keyframe within a search area defined relative to the current image frame tracking position, the at least one neighboring keyframe being one of a plurality of keyframes stored in a keyframe database, each keyframe having an associated keyframe position; determine relative displacements of the current image frame from each of the at least one neighboring keyframes; determine current image frame positions of the current image frame from the associated keyframe frame position of each of the at least one neighboring keyframes and the relative displacement of the current image frame from each of the at least one neighboring keyframes; determine a current image frame position as an average of the current image frame positions; store the current image frame as a new keyframe in the keyframe database upon determining that each of the relative displacements of the current image frame from each of the at least one neighboring keyframes is greater than a threshold value; store the current image frame position as a new keyframe position associated with the new keyframe in the keyframe database; and
,a renderer to render the current image frame at its current image frame position and the keyframes from the keyframe database on a display at their respective associated keyframe positions to display a mosaic representation of the object. - View Dependent Claims (32)
-
-
34. A method for generating keyframes from a series of image frames of an object for rendering a mosaic representation of the object, the method comprising:
-
determining a current image frame tracking position based on a displacement of a current image frame relative to known position of a previous image frame; identifying at least one neighboring keyframe within a predetermined search area surrounding the current image frame tracking position; determining a current position of the current image frame relative to each of the at least one neighboring keyframe based on known respective keyframes positions of each of the at least one neighboring keyframes and relative displacements of the current image frame from each of the at least one neighboring keyframes; storing the current image frame as a new keyframe when the relative displacements of the current image frame from each of the at least one neighboring keyframes is greater than a threshold value.
-
-
35. A method of registering a first image and a second image comprising:
-
identifying a set of features in the first image and a corresponding set of features in the second image, each identified feature including a coordinate, an orientation parameter, a scale parameter, and a descriptor row vector of N elements, N being an integer; determining a set of match candidates for each feature in the set of features of the first image frame from the corresponding set of features in the second image frame, each match candidate having its orientation parameter and scale parameter similar to that of the corresponding feature in the first image frame; for each feature in the set of features of the first image, determining a best-match candidate from the set of match candidates, the best-match candidate having the least descriptor distance from the feature in the first image, to form a matched feature pair; computing a feature displacement for each matched feature pair based on their respective x-coordinates and y-coordinates; accumulating the computed feature displacements in a 2D histogram; selecting the matched feature pairs accumulated in a bin having the highest accumulation in the 2D histogram and in its neighboring bins; determining an average feature displacement from the selected matched feature pairs; determining the residual values of each selected matched feature pair from the average feature displacement; determining the average residual value from all selected matched feature pairs; retaining matched feature pairs having a residual value less than a threshold factor of the average residual value as acceptable matched feature pairs; and determining average displacement between the first image and the second image based on the relative displacement of the acceptable matched feature pairs for image registration.
-
Specification