Texture replacement in video sequences and images
First Claim
1. A method comprising:
- removing a region of interest belonging to a background portion of an initial frame in a video sequence;
determining, via a processor, texture parameters associated with the region of interest;
synthesizing replacement texture using the texture parameters;
modifying the replacement texture by applying a set of constraints to the replacement texture, wherein the set of constraints comprises a first set of constraints when the region of interest is structured and a second set of constraints when the region of interest in unstructured, the first set of constraints having a sequence of application which is distinct from the second set of constraints, wherein the first set of constraints shares a dominant texture orientation constraint with the second set of constraints, to yield new texture; and
inserting the new texture into the video sequence.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for reducing bit rates by replacing original texture in a video sequence with synthesized texture. Reducing the bit rate of the video sequence begins by identifying and removing selected texture from frames in a video sequence. The removed texture is analyzed to generate texture parameters. New texture is synthesized using the texture parameters in combination with a set of constraints. Then, the newly synthesized texture is mapped back into the frames of the video sequence from which the original texture was removed. The resulting frames are then encoded. The bit rate of the video sequence with the synthesized texture is less than the bit rate of the video sequence with the original texture. Also, the ability of a decoder to decode the new video sequence is not compromised because no assumptions are made about the texture synthesis capabilities of the decoder.
-
Citations
20 Claims
-
1. A method comprising:
-
removing a region of interest belonging to a background portion of an initial frame in a video sequence; determining, via a processor, texture parameters associated with the region of interest; synthesizing replacement texture using the texture parameters; modifying the replacement texture by applying a set of constraints to the replacement texture, wherein the set of constraints comprises a first set of constraints when the region of interest is structured and a second set of constraints when the region of interest in unstructured, the first set of constraints having a sequence of application which is distinct from the second set of constraints, wherein the first set of constraints shares a dominant texture orientation constraint with the second set of constraints, to yield new texture; and inserting the new texture into the video sequence. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a processor; and a computer readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising; removing a region of interest belonging to a background portion of an initial frame in a video sequence; determining, via a processor, texture parameters associated with the region of interest; synthesizing replacement texture using the texture parameters; modifying the replacement texture by applying a set of constraints to the replacement texture, wherein the set of constraints comprises a first set of constraints when the region of interest is structured and a second set of constraints when the region of interest in unstructured, the first set of constraints having a sequence of application which is distinct from the second set of constraints, wherein the first set of constraints shares a dominant texture orientation constraint with the second set of constraints, to yield new texture; and inserting the new texture into the video sequence. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer-readable storage device having instructions stored which, when executed on a computing device, cause the computing device to perform operations comprising:
-
removing a region of interest belonging to a background portion of an initial frame in a video sequence; determining, via a processor, texture parameters associated with the region of interest; synthesizing replacement texture using the texture parameters; modifying the replacement texture by applying a set of constraints to the replacement texture, wherein the set of constraints comprises a first set of constraints when the region of interest is structured and a second set of constraints when the region of interest in unstructured, the first set of constraints having a sequence of application which is distinct from the second set of constraints, wherein the first set of constraints shares a dominant texture orientation constraint with the second set of constraints, to yield new texture; and inserting the new texture into the video sequence. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification