System and method for encoding and decoding using texture replacement

• US 10,026,200 B2
• Filed: 06/23/2016
• Issued: 07/17/2018
• Est. Priority Date: 02/21/2002
• Status: Expired due to Term

• Current Assignee: AT&T Corporation (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Dumitras, Adriana, Haskell, Barin
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US15/190,318
• Publication Number:
  US 20160300365A1
• Time in Patent Office: 754 Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic

Abstract

The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Claims

1. A method comprising:

identifying a region of a received video sequence having a color similar to a substitution color;

receiving texture parameters associated with the region; and

mapping synthesized texture based on the texture parameters into the region.

2. The method of claim 1, wherein the texture parameters are received in a different channel than the video sequence.

3. The method of claim 1, wherein the synthesized texture has distinct dominant texture orientation.

4. The method of claim 1, wherein the color is identical to the substitution color.

5. The method of claim 1, further comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

6. The method of claim 1, wherein the video sequence is encoded and decoded in real-time.

7. The method of claim 1, wherein the mapping is performed independently of a particular codec.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

identifying a region of a received video sequence having a color similar to a substitution color;

receiving texture parameters associated with the region; and

mapping synthesized texture based on the texture parameters into the region.

9. The system of claim 8, wherein the texture parameters are received in a different channel than the video sequence.

10. The system of claim 8, wherein the synthesized texture has distinct dominant texture orientation.

11. The system of claim 8, wherein the color is identical to the substitution color.

12. The system of claim 8, the computer-readable storage medium having additional instructions stored which result in operations comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

13. The system of claim 8, wherein the video sequence is encoded and decoded in real-time.

14. The system of claim 8, wherein the mapping is performed independently of a particular codec.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

identifying a region of a received video sequence having a color similar to a substitution color;

receiving texture parameters associated with the region; and

mapping synthesized texture based on the texture parameters into the region.

16. The computer-readable storage device of claim 15, wherein the texture parameters are received in a different channel than the video sequence.

17. The computer-readable storage device of claim 15, wherein the synthesized texture has distinct dominant texture orientation.

18. The computer-readable storage device of claim 15, wherein the color is identical to the substitution color.

19. The computer-readable storage device of claim 15, having additional instructions stored which result in operations comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

20. The computer-readable storage device of claim 15, wherein the video sequence is encoded and decoded in real-time.