SYSTEM AND METHOD FOR ENCODING AND DECODING USING TEXTURE REPLACEMENT

• US 20110206120A1
• Filed: 05/06/2011
• Published: 08/25/2011
• Est. Priority Date: 02/21/2002
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Haskell, Barin Geoffry, Dumitras, Adriana
• Granted Patent: US 8,401,319 B2
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic

Abstract

The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Claims

1. A method for processing images having texture, the method comprising:

identifying, via a processor, a similar texture region in a first video sequence;

extracting from the first video sequence the similar texture region to yield a second video sequence containing an extracted region; and

encoding the second video sequence to yield an encoded second video sequence.

2. The method of claim 1, wherein extracting from the first video sequence further yields extracted texture parameters.

3. The method of claim 2, further comprising:

transmitting the encoded second video sequence and the extracted texture parameters.

4. The method of claim 3, further comprising separate channels for transmitting the encoded second video sequence and the extracted texture parameters.

5. The method of claim 1, wherein the second video sequence is encoded using low bit-rate encoding.

6. The method of claim 1, wherein the second video sequence is encoded using at least one of intra-coding, predicted coding and bidirectionally predicted coding, where selection is based at least in part on the extracted region.

7. The method of claim 1, wherein the second video sequence is encoded without the use of extracted region shape parameters.

8. A non-transitory computer-readable medium storing a computer program having instructions which when executed by a processor control the processor to process images having texture, the instructions comprising:

identifying a similar texture region in a first video sequence;

extracting from the first video sequence the similar texture region, yielding a second video sequence containing an extracted region; and

encoding the second video sequence.

9. The non-transitory computer-readable medium of claim 8, wherein extracting from the first video sequence the similar texture region further yields extracted texture parameters.

10. The non-transitory computer-readable medium of claim 8, wherein encoding the second video sequence is performed at a low bit-rate encoding.

11. The non-transitory computer-readable medium of claim 8, wherein the second video sequence is encoded using at least one of intra-coding, predicted coding and bidirectionally predicted coding, where choice of encoding is based at least in part on the extracted region.

12. The non-transitory computer-readable medium of claim 9, the instructions further comprising encoding the extracted texture parameters.

13. The non-transitory computer-readable medium of claim 9, the instructions further comprising encoding the second video sequence and the extracted texture parameters in separate channels.

14. The non-transitory computer-readable medium of claim 13, wherein the separate channels comprise unique wavelengths.

15. The non-transitory computer-readable medium of claim 12, wherein the encoded texture parameters are artifact free.

16. The non-transitory computer-readable storage medium of claim 12, wherein the texture is encoded based on at least one reference constraint comprising at least one of:

marginal saturation, coefficient correlations, coefficient magnitude correlations, cross-scale statistics, overall color, and color saturation constraints.

17. A system for processing images having texture, the system comprising:

a processor;

a first module configured to control the processor to identify a similar texture region in a first video sequence;

a second module configured to control the processor to extract the similar texture region from the first video sequence, to yield a second video sequence; and

a third module configured to control the processor to encode the second video sequence, to yield an encoded second video sequence.

18. The system of claim 17, the second module further configured to yield extracted texture parameters.

19. The system of claim 18, further comprising:

a fourth module configured to control the processor to encode the extracted texture parameters, to yield an encoded extracted texture parameters.

20. The system of claim 19, further comprising:

a fifth module configured to control the processor to transmit the encoded second video sequence and the encoded extracted texture parameters.