System and method for encoding and decoding using texture replacement

• US 9,378,565 B2
• Filed: 07/18/2014
• Issued: 06/28/2016
• Est. Priority Date: 02/21/2002
• Status: Expired due to Term

• Current Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property II LP (AT&T, Inc.)
• Inventors: Dumitras, Adriana, Haskell, Barin Geoffry
• Primary Examiner(s): Alavi, Amir
• Application Number:
  US14/335,325
• Publication Number:
  US 20140328410A1
• Time in Patent Office: 711 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic

Abstract

The invention provides devices and methods that process images. The invention processes a received signal representing information of texture and information of an image, which has the texture removed from at least one region. The image information is encoded to obtain encoded information of the image. An output signal is generated representing the texture information and the encoded image information. In another embodiment, the invention synthesizes texture based on the received texture information, decodes received image information, which is encoded, to obtain a decoded image, and then maps the synthesized texture onto the decoded image.

Claims

1. A method comprising:

receiving texture parameters associated with a video sequence, the video sequence having a region with removed texture; and

mapping synthesized texture based on the texture parameters into the region, wherein the synthesized texture differs from the removed texture by being artifact free.

2. The method of claim 1, wherein the texture parameters are received in a different channel than the video sequence.

3. The method of claim 1, wherein the synthesized texture and the removed texture have distinct dominant texture orientation.

4. The method of claim 1, further comprising:

identifying an additional region within the video sequence having a color identical to that of the region; and

mapping the synthesized texture into the additional region.

5. The method of claim 1, further comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

6. The method of claim 1, wherein the video sequence is encoded and decoded in real-time.

7. The method of claim 1, wherein the mapping is performed independently of a particular codec.

8. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising;

receiving texture parameters associated with a video sequence, the video sequence having a region with removed texture; and

mapping synthesized texture based on the texture parameters into the region, wherein the synthesized texture differs from the removed texture by being artifact free.

9. The system of claim 8, wherein the texture parameters are received in a different channel than the video sequence.

10. The system of claim 8, wherein the synthesized texture and the removed texture have distinct dominant texture orientation.

11. The system of claim 8, the computer-readable storage medium having additional instructions stored which result in operations comprising:

identifying an additional region within the video sequence having a color identical to that of the region; and

mapping the synthesized texture into the additional region.

12. The system of claim 8, the computer-readable storage medium having additional instructions stored which result in operations comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

13. The system of claim 8, wherein the video sequence is encoded and decoded in real-time.

14. The system of claim 8, wherein the mapping is performed independently of a particular codec.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

receiving texture parameters associated with a video sequence, the video sequence having a region with removed texture; and

mapping synthesized texture based on the texture parameters into the region, wherein the synthesized texture differs from the removed texture by being artifact free.

16. The computer-readable storage device of claim 15, wherein the texture parameters are received in a different channel than the video sequence.

17. The computer-readable storage device of claim 15, wherein the synthesized texture and the removed texture have distinct dominant texture orientation.

18. The computer-readable storage device of claim 15, having additional instructions stored which result in operations comprising:

identifying an additional region within the video sequence having a color identical to that of the region; and

mapping the synthesized texture into the additional region.

19. The computer-readable storage device of claim 15, having additional instructions stored which result in operations comprising outputting a signal representing the video sequence with the synthesized texture mapped into the region.

20. The computer-readable storage device of claim 15, wherein the video sequence is encoded and decoded in real-time.