Dynamic sprites for encoding video data
First Claim
1. A computer implemented method for processing video data representing a scene, comprising the steps of:
- segmenting the video data into rigidly and non-rigidly moving video objects;
estimating motion information for the rigidly moving objects; and
integrating the rigidly moving objects, using the motion information, incrementally into corresponding dynamic sprites stored in memory.
3 Assignments
0 Petitions
Accused Products
Abstract
Video data representing a scene are processed to improve encoding efficiencies. The video data are segmented into rigidly and non-rigidly moving video objects. The segmentation is preformed by estimating local motion vectors for the video data of a sequence of frames. The local motion vectors are clustered to determine dominant motions, and video data having motion vectors similar to the dominant motions are segmented out as rigidly moving video objects. For these objects, motion parameters are robustly estimated. Using the motion parameters, the rigid video objects of the frames are integrated in one or more corresponding sprites stored in a long-term memory. The sprites can be used in a two-way motion compensated prediction technique for encoding video data where blocks of video data are encoded either from sprites based on rigid motion parameters, or from a previous frame based on local motion parameters. In addition, the sprites can be used to construct a high resolution panoramic view of the background of a scene.
98 Citations
23 Claims
-
1. A computer implemented method for processing video data representing a scene, comprising the steps of:
-
segmenting the video data into rigidly and non-rigidly moving video objects; estimating motion information for the rigidly moving objects; and integrating the rigidly moving objects, using the motion information, incrementally into corresponding dynamic sprites stored in memory. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. An apparatus for processing video data representing a scene, comprising:
-
a camera acquiring video data representing light intensity values of a scene; means for segmenting the video data into rigidly and non-rigidly moving video objects; means for estimating motion information for the rigidly moving objects; and a memory incrementally storing an integration of the rigidly moving objects as dynamic sprites.
-
-
18. A computer-implemented method for processing video data representing a scene comprising the steps of:
-
segmenting the video data into rigidly and non-rigidly moving video objects; estimating motion information for the rigidly moving objects; integrating the rigidly moving objects, using the motion information into at least one corresponding sprite in a memory; wherein the video data are organized as a temporal sequence of frames, each frame includes a plurality of blocks of pixels, and a particular block of pixels of a first of the temporal sequence of frames is selected for encoding from one of the sprite and a second of the temporal sequence of frames which occurs prior to the first of the temporal sequence of frames. - View Dependent Claims (19)
-
-
20. An apparatus for processing video data representing a scene comprising:
-
a processor configured to receive the video data, to segment the video data into rigidly and non-rigidly moving objects, and to estimate motion information for the rigidly moving objects; a memory configured to incrementally store an integration of the rigidly moving objects as at least one dynamic sprite; and an encoder configured to encode the video data using the at least one dynamic sprite. - View Dependent Claims (21)
-
-
22. A computer-implemented method for processing video data representing a scene comprising the steps of:
-
estimating motion information for a rigidly moving object within the scene; and building at least one dynamic sprite by incrementally integrating the rigidly moving object using the motion information. - View Dependent Claims (23)
-
Specification