Three-frame technique for analyzing two motions in successive image frames dynamically
First Claim
1. A feedback loop for iteratively motion-processing image-data pixels within respective analysis regions of a first-occurring frame, a second-occurring frame, and a third-occurring frame of a motion-picture during each of successive cycles of operation thereof;
- wherein the image-data pixels within said analysis regions of these motion-picture frames may define first and second differently-moving patterns;
said feedback loop comprising;
first warp means for shifting the position of said first of said moving patterns within said first-occurring frame analysis region toward the position of said first of said moving patterns within said second-occurring frame analysis region by an amount determined by the value of a warp-control signal applied to said first warp means during any odd cycle of iterative operation of said feedback loop;
second warp means for shifting the position of said first of said moving patterns within said second-occurring frame analysis region toward the position of said first of said moving patterns within said third-occurring frame analysis region by an amount determined by the value of said warp-control signal applied to said second warp means during that odd cycle of iterative operation of said feedback loop;
first computation means coupled to said first warp means for performing a predetermined computation on corresponding image-data pixel values of said second-occurring frame and said shifted-pattern first-occurring frame for deriving first computation image data;
second computation means coupled to said second warp means for performing said predetermined computation on corresponding image-data pixel values of said third-occurring frame and said shifted-pattern second-occurring frame for deriving second computation image data; and
motion estimation means, responsive to both said first and said second computation image data derived during that odd cycle of iterative operation, for computing a first warp-control-signal value for application to said first and second warp means during the immediately following even cycle of iterative operation, which first computed value results in the position of said second of said moving patterns within said respective first-occurring and second-occurring frame analysis regions being shifted toward the position of said second of said moving patterns within said respective second-occurring and third-occurring frame analysis regions by an amount determined by said first computed value.
2 Assignments
0 Petitions
Accused Products
Abstract
An iterative process, implemented by a feedback loop, responds to all the image data in the respective analysis regions of three consecutive frames of a motion picture, to provide, after a plurality of cycles of operation thereof, an accurate estimation of the motion of either one or both of two differently moving patterns defined by the image data of these respective analysis regions. The analysis region of each frame is preferably large, and may occupy the entire frame area of a frame. The type of differently moving patterns include (1) separation by a motion bounty, (2) overlapping transparent surface in motion, (3) "picket fence" motion (4) masking of a small and/or low-contrast pattern by a dominant pattern, and (5) two-component aperture effects. Also, the operation of this iterative process inherently accurately estimates the motion of image data defining a single moving pattern.
-
Citations
18 Claims
-
1. A feedback loop for iteratively motion-processing image-data pixels within respective analysis regions of a first-occurring frame, a second-occurring frame, and a third-occurring frame of a motion-picture during each of successive cycles of operation thereof;
- wherein the image-data pixels within said analysis regions of these motion-picture frames may define first and second differently-moving patterns;
said feedback loop comprising;first warp means for shifting the position of said first of said moving patterns within said first-occurring frame analysis region toward the position of said first of said moving patterns within said second-occurring frame analysis region by an amount determined by the value of a warp-control signal applied to said first warp means during any odd cycle of iterative operation of said feedback loop; second warp means for shifting the position of said first of said moving patterns within said second-occurring frame analysis region toward the position of said first of said moving patterns within said third-occurring frame analysis region by an amount determined by the value of said warp-control signal applied to said second warp means during that odd cycle of iterative operation of said feedback loop; first computation means coupled to said first warp means for performing a predetermined computation on corresponding image-data pixel values of said second-occurring frame and said shifted-pattern first-occurring frame for deriving first computation image data; second computation means coupled to said second warp means for performing said predetermined computation on corresponding image-data pixel values of said third-occurring frame and said shifted-pattern second-occurring frame for deriving second computation image data; and motion estimation means, responsive to both said first and said second computation image data derived during that odd cycle of iterative operation, for computing a first warp-control-signal value for application to said first and second warp means during the immediately following even cycle of iterative operation, which first computed value results in the position of said second of said moving patterns within said respective first-occurring and second-occurring frame analysis regions being shifted toward the position of said second of said moving patterns within said respective second-occurring and third-occurring frame analysis regions by an amount determined by said first computed value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
- wherein the image-data pixels within said analysis regions of these motion-picture frames may define first and second differently-moving patterns;
-
12. A method for iteratively motion-processing image-data pixels within respective analysis regions of a first-occurring frame, a second-occurring frame, and a third-occurring frame of a motion-picture during each of successive cycles of operation thereof;
- wherein the image-data pixels within said analysis regions of these motion-picture frames may define a first moving pattern having a motion p and a second moving pattern having a motion q different from p;
said method comprising the steps of;a) setting the initial estimate of motion p of said first moving pattern at pO ; b) shifting the position of said first moving pattern within each of said respective first-occurring and second-occurring frame analysis regions toward the position of said first moving pattern within each of said respective second-occurring and third-occurring frame analysis regions by an amount in accordance with the latest estimate pn of the motion p of said first moving pattern (where n indicates the ordinal number of that iterative cycle of operation that derived that estimate), and said estimate pn of motion p has a first certain accuracy; c) performing a predetermined computation on corresponding image-data pixel values of said second-occurring frame and said step (b) shifted-pattern first-occurring frame for deriving step (c) first computation image data D1, and performing said predetermined computation on corresponding image-data pixel values of said third-occurring frame and said step (b) shifted-pattern second-occurring frame for deriving step (c) second computation image data D2 ; d) using step (c) computation image data D1 and D2 to derive an estimate qn+1 of the motion q of said second moving pattern with a second certain accuracy which is higher than the accuracy of the estimate of motion q made by any preceding cycle of iterative operation; e) shifting the position of said second moving pattern within each of said respective first-occurring and second-occurring frame analysis regions toward the position of said second moving pattern within each of said respective second-occurring and third-occurring frame analysis regions by an amount in accordance with the estimate qn+1 of the motion q of said second moving pattern; f) performing said predetermined computation on corresponding image-data pixel values of said second-occurring frame and said step (e) shifted-pattern first-occurring frame for deriving step (f) first computation image data D1, and performing said predetermined computation on corresponding image-data pixel values of said third-occurring frame and said step (e) shifted-pattern second-occurring frame for deriving step (f) second computation image data D2 ; and g) using step (f) difference image data D1 and D2 to derive an estimate pn+2 of the motion p of said first moving pattern with an accuracy which is higher than the first certain accuracy of the estimate pn of motion p. - View Dependent Claims (13, 14, 15, 16, 17, 18)
- wherein the image-data pixels within said analysis regions of these motion-picture frames may define a first moving pattern having a motion p and a second moving pattern having a motion q different from p;
Specification