Systems and methods for a motion compensated picture rate converter
First Claim
1. A method for applying motion estimation, the method comprising:
- receiving an input signal having at least a current frame and a reference frame;
estimating global motion between the reference frame and the current frame to generate at least one affine motion parameter;
estimating local motion between the reference frame and the current frame to generate at least one motion vector, whereinthe at least one affine motion parameter estimates the global motion of a first region between the reference frame and the current frame, and the at least one motion vector estimates a local motion in a second region between the reference frame and the current frame;
identifying neighboring areas adjacent to the second region of the reference frame; and
generating a modified global motion vector by modifying the at least one motion vector of the second region using affine motion parameters corresponding to the adjacent neighboring areas.
6 Assignments
0 Petitions
Accused Products
Abstract
Disclosed herein are systems and methods for estimating global and local motions between a pair of temporally adjacent frames of an input signal and for applying these motion vectors to produce at least one interpolated, motion-compensated frame between the adjacent frames. In particular, the systems and methods comprise designs for a motion compensated frame rate converter including a global affine motion estimation engine, a global translation motion estimation engine, a segmentation mask generator, an object edge strength map generator and a local motion estimation engine. Combinations of these features are implemented in a motion compensated picture rate converter to accurately and efficiently provide motion estimation and compensation for a sequence of frames.
21 Citations
69 Claims
-
1. A method for applying motion estimation, the method comprising:
-
receiving an input signal having at least a current frame and a reference frame; estimating global motion between the reference frame and the current frame to generate at least one affine motion parameter; estimating local motion between the reference frame and the current frame to generate at least one motion vector, wherein the at least one affine motion parameter estimates the global motion of a first region between the reference frame and the current frame, and the at least one motion vector estimates a local motion in a second region between the reference frame and the current frame; identifying neighboring areas adjacent to the second region of the reference frame; and generating a modified global motion vector by modifying the at least one motion vector of the second region using affine motion parameters corresponding to the adjacent neighboring areas. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method for performing global motion estimation, the method comprising:
-
receiving an input signal having at least a current frame and a reference frame; phase-correlating the current frame and the reference frame; and computing at least one affine parameter for estimating a global translation motion between the current frame and the reference frame based on the phase correlation. - View Dependent Claims (8, 9, 10, 11)
-
-
12. A method for generating at least one motion vector for an interest area of a current frame in relation to a reference frame, the method comprising:
-
providing at least one affine parameter for estimating a global motion between the current frame and the reference frame; generating a segmentation mask based on the at least one affine parameter for identifying foreground and background regions of the current frame; generating an object edge strength map for identifying regions of significant edge strengths in the current frame; and computing the at least one motion vector for the interest area based on the foreground, background and significant edge strength regions in relation to the interest area. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A method for performing motion compensated frame rate conversion, the method comprising:
-
receiving an input signal having at least a current frame and a reference frame; processing the current frame and the reference frame, wherein the processing comprises; identifying neighboring areas adjacent to a region of the reference frame, and generating a local motion vector of a region of the current frame using motion vectors of the adjacent neighboring areas; providing at least one of an affine global motion parameter and the local motion vector that characterize respective global and local motions between the processed current frame and the processed reference frame; and enabling motion compensated interpolation, wherein the motion compensated interpolation generates at least one interpolated frame between the processed current frame and the processed reference frame using at least one of the affine global motion parameter and the local motion vector. - View Dependent Claims (20, 21, 22)
-
-
23. A motion compensated frame rate converter comprising:
-
circuitry for receiving an input signal having at least a current frame and a reference frame; a global affine motion estimation module for estimating global motion between the reference frame and the current frame to generate at least one affine motion parameter; a local motion correction module for estimating local motion between the reference frame and the current frame to generate at least one motion vector, wherein the at least one affine motion parameter estimates the global motion of a first region between the reference frame and the current frame, and the at least one motion vector estimates a local motion in a second region between the reference frame and the current frame; circuitry for identifying neighboring areas adjacent to the second region of the reference frame; and a modified global motion estimation module for generating a modified global motion vector by modifying the at least one motion vector of the second region using affine motion parameters corresponding to the adjacent neighboring areas. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30)
-
-
31. A global translation estimation module comprising:
-
circuitry for receiving an input signal having at least a current frame and a reference frame; a phase correlation module for phase correlating the current frame and the reference frame; and circuitry for computing at least one affine parameter that estimates a global translation motion between the current frame and the reference frame based on the phase correlation. - View Dependent Claims (32, 33, 34, 35)
-
-
36. A local motion correction module, comprising:
-
a segmentation mask for identifying foreground and background regions of a current frame; an object edge strength map for identifying regions of significant edge strengths in the current frame; and circuitry for computing at least one motion vector for an interest area based on the foreground, background and significant edge strength regions in relation to the interest area. - View Dependent Claims (37, 38, 39, 40, 41, 42)
-
-
43. A motion compensated picture rate converter, comprising:
-
circuitry for receiving an input signal having at least a reference frame and a current frame; a processing module for processing the reference frame and the current frame, wherein the processing comprises; identifying neighboring areas adjacent to a region of the reference frame, and generating a local motion vector of a region of the current frame using motion vectors of the adjacent neighboring areas; and a motion compensated frame rate converter including; circuitry for providing at least one of an affine global motion parameter and a motion vector that characterize respective global and local motions between the processed current frame and the processed reference frame, and motion compensated interpolation circuitry for generating at least one interpolated frame between the processed current frame and the processed reference frame using at least one of the affine global motion parameter and the motion vector. - View Dependent Claims (44, 45, 46)
-
-
47. A motion compensated frame rate converter comprising:
-
means for receiving an input signal having at least a reference frame and a current frame; means for estimating global motion between the reference frame and the current frame to generate at least one affine motion parameter; means for estimating local motion between the reference frame and the current frame to generate at least one motion vector, wherein the at least one affine motion parameter estimates the global motion of a first region between the reference frame and the current frame, and the at least one motion vector estimates a local motion in a second region between the reference frame and the current frame; means for identifying neighboring areas adjacent to the second region of the reference frame; and means for generating a modified global motion vector by modifying the at least one motion vector of the second region using affine motion parameters corresponding to the adjacent neighboring areas. - View Dependent Claims (48, 49, 50, 51, 52, 53)
-
-
54. A global translation estimation module comprising:
-
means for receiving an input signal having at least a current frame and a reference frame; means for phase correlating the current frame and the reference frame; and means for computing at least one affine parameter for estimating a global translation motion between the current frame and the reference frame based on the phase correlation. - View Dependent Claims (55, 56, 57, 58)
-
-
59. A local motion correction module, comprising:
-
means for producing a segmentation mask for identifying foreground and the background regions of a current frame; means for producing an object edge strength map for identifying regions of significant edge strengths in the current frame; and means for computing at least one motion vector for an interest area based on the foreground, background and significant edge strength regions in relation to the interest area. - View Dependent Claims (60, 61, 62, 63, 64, 65)
-
-
66. A motion compensated picture rate converter, comprising:
-
means for receiving an input signal having at least a current frame and a reference frame; means for processing the current frame and the reference frame, wherein the processing comprises; identifying neighboring areas adjacent to a region of the reference frame, and generating a local motion vector of a region of the current frame using motion vectors of the adjacent neighboring areas; means for providing at least one of an affine global motion parameter and a motion vector characterizing respective global and local motions between the processed current frame and the processed reference frame; and means for enabling motion compensated interpolation, wherein the motion compensated interpolation generates at least one interpolated frame between the processed current frame and the processed reference frame using at least one of the affine global motion parameter and the motion vector. - View Dependent Claims (67, 68, 69)
-
Specification