System and method for encoding and decoding using texture replacement

• US 7,945,104 B2
• Filed: 09/15/2009
• Issued: 05/17/2011
• Est. Priority Date: 02/21/2002
• Status: Expired due to Fees

• Current Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Haskell, Barin Geoffry, Dumitras, Adriana
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US12/559,854
• Publication Number:
  US 20090322778A1
• Time in Patent Office: 609 Days
• Field of Search: 382/162, 382/164, 382/166, 382/190, 382/192, 382/199, 382203-206, 382/232, 382/233, 382/243, 382/246, 382/254, 345/427, 345/582, 345/583, 345/587, 345/600, 345/605, 345/619, 345/689, 348/571, 375/240.24
• US Class Current: 382/243
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic

Abstract

The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Claims

1. A system for processing images having texture, the system comprising:

a processor;

an identification module configured to control the processor to identify similar texture regions in a video sequence;

an extraction module configured to control the processor to extract texture from the similar texture regions to obtain a video sequence with the texture removed and texture parameters, wherein a resulting video sequence with texture extracted is represented by an equation in which a first background region is unmodified and a second background region is modified by texture extraction, wherein the texture parameters are represented by a reference value, which represents an extracted texture and a color; and

an encoding module configured to control the processor to encode the video sequence with the texture removed.

2. The system of claim 1, further comprising an output module configured to control the processor to output on a first channel the encoded video sequence and output on a second channel the texture parameters.

3. The system of claim 1, wherein the encoding module is further configured to control the processor to encode the video sequence using low bit-rate coding.

4. The system of claim 1, wherein the video sequence is encoded using intra-coding, predicted coding or bidirectionally predicted coding based at least in part on the texture.

5. The system of claim 1, wherein the encoding module further controls the processor to encode the video sequence without the use of region shape parameters.

6. The system of claim 1, further comprising:

a second encoding module configured to control the processor to encode the texture parameters.

7. A non-transitory computer-readable storage medium storing a computer program having instructions which when executed by a processor control the processor to process images having texture, the instructions comprising:

identifying similar texture regions in a video sequence;

extracting texture from the similar texture regions to obtain a video sequence with the texture removed and texture parameters, wherein a resulting video sequence with texture extracted is represented by an equation in which a first background region is unmodified and a second background region is modified by texture extraction, wherein the texture parameters are represented by a reference value, which represents an extracted texture and a color; and

encoding the video sequence with the texture removed.

8. The non-transitory computer-readable storage medium of claim 7, the instructions further comprising outputting on a first channel the encoded video sequence and outputting on a second channel the texture parameters.

9. The non-transitory computer-readable storage medium of claim 7, wherein encoding the video sequence is performed at a low bit-rate coding.

10. The non-transitory computer-readable storage medium of claim 7, wherein the video sequence is encoded using intra-coding, predicted coding or bidirectionally predicted coding based at least in part on the texture.

11. The non-transitory computer-readable storage medium of claim 7, wherein encoding the video sequence is performed without the use of region shape parameters.

12. The non-transitory computer-readable storage medium of claim 7, the instructions further comprising:

encoding the texture parameters.

13. The non-transitory computer-readable storage medium of claim 12, wherein the encoded texture parameters are artifact free.

14. The non-transitory computer-readable storage medium of claim 12, wherein the texture is encoded based on at least one reference constraint comprising at least one of:

marginal saturation, coefficient correlations, coefficient magnitude correlations, cross-scale statistics, overall color, and color saturation constraints.

15. The non-transitory computer-readable storage medium of claim 7, the instructions further comprising encoding the video sequence and the texture parameters in different channels.

16. The non-transitory computer-readable storage medium of claim 7, the instructions further comprising encoding the video sequence into frames using at least one of fixed, variable length and inverse transformation decoding.