Method and system for motion estimation in digital imaging applications
First Claim
Patent Images
1. A method of estimating global motion magnitude in digital video frames, the method comprising:
- identifying for each of a plurality of features in the digital video frames a best motion vector among a plurality of candidate motion vectors that most closely corresponds to the motion of the feature between a first frame and a second frame and a second best motion vector that second most closely corresponds to the motion of the feature between the first frame and the second frame;
assigning a confidence level to each best vector based on a comparison of the best motion vector with a respective second best motion vector;
calculating a magnitude of each best motion vector;
determining an average motion magnitude based on the magnitude and confidence level of the best motion vectors; and
estimating the global motion magnitude based on the magnitude and confidence level of each best motion vector having magnitudes within a window of magnitudes surrounding the average motion magnitude, wherein the best and second best motion vectors satisfy the following condition;
|mmin2−
mmin|+|nmin2−
nmin|>
1wherein mmin, is the horizontal component of the best motion vector, nmin is the vertical component of the best motion vector, mmin2 is the horizontal component of the second best motion vector, and nmin2 is the vertical component of the second best motion vector.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for estimating global motion in digital imaging applications with confidence level filtering. Motion search yields a plurality of vectors describing the movement of feature blocks from one frame to another. A confidence level is assigned to each motion vector. Based on the confidence levels, vectors are given more or less weight when estimating global motion. High-confidence vectors are given more weight than low-confidence vectors. Embodiments for estimating both the magnitude of global motion and the magnitude and direction of global motion are disclosed.
18 Citations
11 Claims
-
1. A method of estimating global motion magnitude in digital video frames, the method comprising:
-
identifying for each of a plurality of features in the digital video frames a best motion vector among a plurality of candidate motion vectors that most closely corresponds to the motion of the feature between a first frame and a second frame and a second best motion vector that second most closely corresponds to the motion of the feature between the first frame and the second frame; assigning a confidence level to each best vector based on a comparison of the best motion vector with a respective second best motion vector; calculating a magnitude of each best motion vector; determining an average motion magnitude based on the magnitude and confidence level of the best motion vectors; and estimating the global motion magnitude based on the magnitude and confidence level of each best motion vector having magnitudes within a window of magnitudes surrounding the average motion magnitude, wherein the best and second best motion vectors satisfy the following condition;
|mmin2 −
mmin|+|nmin2 −
nmin|>
1wherein mmin, is the horizontal component of the best motion vector, nmin is the vertical component of the best motion vector, mmin2 is the horizontal component of the second best motion vector, and nmin2 is the vertical component of the second best motion vector. - View Dependent Claims (2, 3, 4)
-
-
5. A method of estimating global motion magnitude in digital video frames, the method comprising:
-
identifying for each of a plurality of features in the digital video frames a best motion vector among a plurality of candidate motion vectors that most closely corresponds to the motion of the feature between a first frame and a second frame and a second best motion vector that second most closely corresponds to the motion of the feature between the first frame and the second frame; assigning a confidence level to each best vector based on a comparison of the best motion vector with a respective second best motion vector; calculating a magnitude of each best motion vector; determining an average motion magnitude based on the magnitude and confidence level of the best motion vectors; and estimating the global motion magnitude based on the magnitude and confidence level of each best motion vector having magnitudes within a window of magnitudes surrounding the average motion magnitude, wherein the average motion magnitude is calculated as follows;
-
-
6. A method of estimating global motion magnitude in digital video frames, the method comprising:
-
identifying for each of a plurality of features in the digital video frames a best motion vector among a plurality of candidate motion vectors that most closely corresponds to the motion of the feature between a first frame and a second frame and a second best motion vector that second most closely corresponds to the motion of the feature between the first frame and the second frame; assigning a confidence level to each best vector based on a comparison of the best motion vector with a respective second best motion vector; calculating a magnitude of each best motion vector; determining an average motion magnitude based on the magnitude and confidence level of the best motion vectors; and estimating the global motion magnitude based on the magnitude and confidence level of each best motion vector having magnitudes within a window of magnitudes surrounding the average motion magnitude, wherein a magnitude of a best motion vector is determined to be within the window if the following condition is true;
-
-
7. A method of estimating global motion magnitude in digital video frames, the method comprising:
-
identifying for each of a plurality of features in the digital video frames a best motion vector among a plurality of candidate motion vectors that most closely corresponds to the motion of the feature between a first frame and a second frame and a second best motion vector that second most closely corresponds to the motion of the feature between the first frame and the second frame; assigning a confidence level to each best vector based on a comparison of the best motion vector with a respective second best motion vector; calculating a magnitude of each best motion vector; determining an average motion magnitude based on the magnitude and confidence level of the best motion vectors; and estimating the global motion magnitude based on the magnitude and confidence level of each best motion vector having magnitudes within a window of magnitudes surrounding the average motion magnitude, wherein the global motion magnitude is estimated as follows;
-
-
8. A method of estimating a global motion vector in digital video frames, the method comprising:
-
identifying for each of a plurality of feature blocks a first motion vector that most closely corresponds to the motion of the feature block between a first frame and a second frame and a second motion vector that second most closely corresponds to the motion of the feature block between the first frame and the second frame; computing a first sum of absolute differences associated with the first motion vector and a second sum of absolute differences associated with the second motion vector; assigning a confidence level to each first motion vector based on a comparison of the second sum of absolute differences with the first sum of absolute differences multiplied by an empirically-determined constant; assigning a weight to each first motion vector based on the location of the first motion vector within the first or second frame; calculating a weighted distance of each first motion vector; selecting a subset of the first motion vectors having lowest weighted distances among the first motion vectors; and estimating the global motion vector based on the subset of first motion vectors and the confidence level assigned to each first motion vector in the subset, wherein the weighted distance of a motion vector is calculated as follows; - View Dependent Claims (9)
-
-
10. A method of estimating a global motion vector in digital video frames, the method comprising:
-
identifying for each of a plurality of feature blocks a first motion vector that most closely corresponds to the motion of the feature block between a first frame and a second frame and a second motion vector that second most closely corresponds to the motion of the feature block between the first frame and the second frame; computing a first sum of absolute differences associated with the first motion vector and a second sum of absolute differences associated with the second motion vector; assigning a confidence level to each first motion vector based on a comparison of the second sum of absolute differences with the first sum of absolute differences multiplied by an empirically-determined constant; assigning a weight to each first motion vector based on the location of the first motion vector within the first or second frame; calculating a weighted distance of each first motion vector; selecting a subset of the first motion vectors having lowest weighted distances among the first motion vectors; and estimating the global motion vector based on the subset of first motion vectors and the confidence level assigned to each first motion vector in the subset, wherein the number of first motion vectors in the subset is calculated as follows;
-
-
11. A method of estimating a global motion vector in digital video frames, the method comprising:
-
identifying for each of a plurality of feature blocks a first motion vector that most closely corresponds to the motion of the feature block between a first frame and a second frame and a second motion vector that second most closely corresponds to the motion of the feature block between the first frame and the second frame; computing a first sum of absolute differences associated with the first motion vector and a second sum of absolute differences associated with the second motion vector; assigning a confidence level to each first motion vector based on a comparison of the second sum of absolute differences with the first sum of absolute differences multiplied by an empirically-determined constant; assigning a weight to each first motion vector based on the location of the first motion vector within the first or second frame; calculating a weighted distance of each first motion vector; selecting a subset of the first motion vectors having lowest weighted distances among the first motion vectors; and estimating the global motion vector based on the subset of first motion vectors and the confidence level assigned to each first motion vector in the subset, wherein the global motion vector is estimated as follows;
-
Specification