Content based video compression system
First Claim
1. A method of compressing a video segment comprised of a series of frames, comprising the steps of:
- preprocessing a frame to obtain figure motion data for each moving figure, said preprocessing comprising the steps of;
comparing said frame to another frame;
estimating image velocity at certain locations;
estimating background velocity of said frame;
adjusting said image velocity to compensate for said background velocity;
segmenting each said moving figure; and
estimating figure velocity of each segmented moving figure of said frame;
tessellating any moving figures to produce an instance of a template for each moving figure and an instance of a background template;
storing said figure motion data in a manner so as to associate said figure motion data with said frame;
storing frame information representative of the size and position of said frame with respect to a background world image;
comparing each of said instances of a template to a world image for that template to cut material common to both from one and to add the remaining material to form a new world image;
repeating each step until all the frames in the series are processed; and
outputting each world image, said figure motion data, and said frame information.
1 Assignment
0 Petitions
Accused Products
Abstract
A content based method of compressing a segment of video is implemented in two stages. In a spatial integration stage, figures are represented in terms of compact models. In a temporal integration stage, which uses the information from the spatial integration stage, constructs, i.e., world images and data describing relationships between world images and frames, are generated. In operation, each frame in a series of frames is preprocessed to tessellate any moving figures and to obtain motion data for the moving figures and for the image background. The figure motion data is stored in a manner so as to associate the motion data with the original frame. Frame information identifying the size and position of each frame with respect to a background world image is also stored. Each tessellated figure is compared to the original frame to produce a template for each moving figure and a template for the background. Each template is compared to a world image that is associated with that template so that material common to both can be cut and the remaining material added to form a new world image. The steps are repeated until all frames in the segment are processed. The resulting world image data, figure motion data, and frame information are output for transmission or storage. The world image data may be compressed prior to transmission or storage.
-
Citations
13 Claims
-
1. A method of compressing a video segment comprised of a series of frames, comprising the steps of:
-
preprocessing a frame to obtain figure motion data for each moving figure, said preprocessing comprising the steps of; comparing said frame to another frame; estimating image velocity at certain locations; estimating background velocity of said frame; adjusting said image velocity to compensate for said background velocity; segmenting each said moving figure; and estimating figure velocity of each segmented moving figure of said frame; tessellating any moving figures to produce an instance of a template for each moving figure and an instance of a background template; storing said figure motion data in a manner so as to associate said figure motion data with said frame; storing frame information representative of the size and position of said frame with respect to a background world image; comparing each of said instances of a template to a world image for that template to cut material common to both from one and to add the remaining material to form a new world image; repeating each step until all the frames in the series are processed; and outputting each world image, said figure motion data, and said frame information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. An apparatus for compressing a video segment comprised of a series of frames, comprising:
-
means for preprocessing a frame to obtain figure motion data for each moving figure, said means for preprocessing comprising; means for comparing said frame to another frame; means for estimating image velocity at certain locations; means for estimating background velocity of said frame; means for adjusting said image velocity to compensate for said background velocity; means for segmenting each said moving figure; and means for estimating figure velocity of each segmented moving figure of said frame; means for tessellating any moving figures to produce an instance of a template for each moving figure and an instance of a background template; first means for storing said figure motion data in a manner so as to associate said figure motion data with said frame; second means for storing frame information representative of the size and position of said frame with respect to a background world image; and means for comparing each of said instances of a template to a world image for that template, for cutting material common to both from one, and for adding the remaining material to form a new world image.
-
Specification