ADVANCE VIDEO CODING WITH PERCEPTUAL QUALITY SCALABILITY FOR REGIONS OF INTEREST
First Claim
1. A digital video encoder, comprising:
- a segmentation module configured to segment frames in a digital video sequence into background regions and object regions; and
an object parameter generator configured to generate object motion and object appearance parameters based on segmented object regions, the motion parameters defining a location of an object and including at least one motion parameter defining an orientation of a segmented object region.
4 Assignments
0 Petitions
Accused Products
Abstract
A video compression framework based on parametric object and background compression is proposed. At the encoder, an object is detected and frames are segmented into regions corresponding to the foreground object and the background. The encoder generates object motion and appearance parameters. The motion or warping parameters may include at least two parameters for object translation; two parameters for object scaling in two primary axes and one object orientation parameter indicating a rotation of the object. Particle filtering may be employed to generate the object motion parameters. The proposed methodology is the formalization of the concept and usability for perceptual quality scalability layer for Region(s) of Interest. A coded video sequence format is proposed which aims at “network friendly” video representation supporting appearance and generalized motion of object(s).
86 Citations
40 Claims
-
1. A digital video encoder, comprising:
-
a segmentation module configured to segment frames in a digital video sequence into background regions and object regions; and an object parameter generator configured to generate object motion and object appearance parameters based on segmented object regions, the motion parameters defining a location of an object and including at least one motion parameter defining an orientation of a segmented object region. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method, comprising:
-
segmenting frames in a digital video sequence into background regions and object regions; generating object motion parameters of a segmented object region, the object motion parameters including at least two motion parameters defining a location of a segmented object region inside the video frame, including at least one motion parameter indicating an orientation of the segmented object region; generating object appearance parameters of the segmented object region; and encoding the object motion parameters and the object appearance parameters in a bit stream. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
-
-
26. A non-transitory computer-readable medium whose contents cause an encoder to perform a method of encoding a video image sequence, the method comprising:
-
segmenting frames in a digital video sequence into background regions and object regions; generating object motion parameters of a segmented object region, the object motion parameters including at least one motion parameter defining an orientation of the segmented object region; generating object appearance parameters of the segmented object region; and encoding the object motion parameters and the object appearance parameters in a bit stream. - View Dependent Claims (27, 28, 29)
-
-
30. A digital video decoder, comprising:
-
a decoding block configured to decode background I frames in an encoded video sequence; an object appearance estimator configured to estimate an object appearance based on object appearance parameters in the encoded video sequence; and an object motion compensator configured to compensate for object motion based on object motion parameters in the encoded video sequence, the object motion parameters including at least one motion parameter defining an orientation of a segmented object region. - View Dependent Claims (31, 32, 33, 34, 35)
-
-
36. A method, comprising:
-
decoding background I frames in an encoded video sequence; estimating an object appearance based on object appearance parameters in the encoded video sequence; and compensation for object motion based on object motion parameters in the encoded video sequence, the object motion parameters including at least one motion parameter defining an orientation of a segmented object region. - View Dependent Claims (37)
-
-
38. A system comprising:
-
means for segmenting frames in a digital video sequence into background regions and object regions; means for generating object motion parameters of a segmented object region, the object motion parameters including at least one parameter defining an object orientation; means for generating object appearance parameters of the segmented object region; and means for encoding the object motion parameters and the object appearance parameters in a bit stream. - View Dependent Claims (39, 40)
-
Specification