System and method for encoding and decoding using texture replacement

• US 7,545,989 B1
• Filed: 10/22/2007
• Issued: 06/09/2009
• Est. Priority Date: 02/21/2002
• Status: Expired due to Term

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Haskell, Barin Geoffry, Dumitras, Adriana
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US11/876,262
• Time in Patent Office: 596 Days
• Field of Search: 382/108, 382/118, 382/166, 382/190, 382/192, 382/199, 382/203, 382/204, 382/206, 382/232, 382/233, 382/243, 382/246, 382/254, 382/277, 345/427, 345/582, 345/583, 345/587, 345/600, 345/605, 345/619, 345/689, 348/571, 375/240.24
• US Class Current: 382/233
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 7/40 Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G06T 7/41 based on statistical description of texture
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: G06T 9/001 Model-based coding, e.g. wire frame
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 19/27 involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]

Abstract

The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Claims

1. A processor-implemented method of decoding a received signal, the received signal representing a video sequence having its texture removed and texture parameters, the method comprising:

The processor performing the steps of,

recovering contours of regions in the received signal having texture removed; and

mapping synthesized texture based on the texture parameters into the recovered contours of regions, wherein the synthesized texture differs from an original texture due to a decoder applying at least one of a dominant texture orientation, overall color, and a different color saturation from the original texture.

2. The method of claim 1, wherein the received video sequence and the texture parameters are received in different channels.

3. The method of claim 1, wherein the texture parameters are not coded.

4. The method of claim 1, further comprising:

decoding frames associated with the received signal using at least one of fixed, variable length and inverse transformation decoding.

5. The method of claim 1, wherein recovering contours of regions in the received signal further comprising identifying all background regions having a particular color.

6. The method of claim 5, wherein the color represents a color identical to a substitution color.

7. The method of claim 1, wherein the synthesized texture is artifact free.

8. The method of claim 1, wherein the texture is synthesized based on at least one reference constraint comprising at least one of:

marginal saturation, coefficient correlations, coefficient magnitude correlations, cross-scale statistics, overall color, and color saturation constraints.

9. A device that decodes a received signal, the received signal representing a video sequence having its texture removed and texture parameters, the device comprising:

a module configured to recover contours of regions in the received signal having texture removed; and

a module configured to map synthesized texture based on the texture parameters into the recovered contours of regions, wherein the synthesized texture differs from an original texture due to a decoder applying at least one of a dominant texture orientation, overall color, and a different color saturation from the original texture.

10. The device of claim 9, wherein the received video sequence and the texture parameters are received in different channels.

11. The device of claim 9, wherein the texture parameters are not coded.

12. The device of claim 9, further comprising:

a module configured to decode frames associated with the received signal using at least one of fixed, variable length and inverse transformation decoding.

13. The device of claim 9, wherein the module configured to recover contours of regions in the received signal further identifies all background regions having a particular color.

14. The device of claim 13, wherein the color represents a color identical to a substitution color.

15. The device of claim 9, wherein the synthesized texture is artifact free.

16. The device of claim 9, wherein the texture is synthesized based on at least one reference constraint comprising at least one of:

marginal saturation, coefficient correlations, coefficient magnitude correlations, cross-scale statistics, overall color, and color saturation constraints.

17. A tangible computer-readable medium storing instructions to control a device to decode a received signal, the received signal representing a video sequence having its texture removed and texture parameters, the instructions comprising:

recovering contours of regions in the received signal having texture removed; and

mapping synthesized texture based on the texture parameters into the recovered contours of regions, wherein the synthesized texture differs from an original texture due to a decoder applying at least one of a dominant texture orientation, overall color, and a different color saturation from the original texture.

18. The computer readable medium of claim 17, wherein the received video sequence and the texture parameters are received in different channels.