Methods and apparatus for video imaging pruning

• US 9,571,857 B2
• Filed: 09/01/2009
• Issued: 02/14/2017
• Est. Priority Date: 09/18/2008
• Status: Active Grant

• Current Assignee: InterDigital Madison Patent Holdings (InterDigital, Inc.)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Vo, Dung Trung, Sole, Joel, Yin, Peng, Zheng, Yunfei
• Primary Examiner(s): ELAHI, SHAN E
• Application Number:
  US12/998,123
• Publication Number:
  US 20110170615A1
• Time in Patent Office: 2,723 Days
• Field of Search: 375/240.26
• US Class Current: 1/1
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

Methods and apparatus are provided for video image pruning. An apparatus includes a data pruner for pre-processing a picture prior to, and in preparation for, compression by encoding. The data pruner selectively removes, in the spatial domain, at least one region within the picture. At the decoder end, an apparatus includes a data restorer for receiving a decompressed picture subsequent to decompression by decoding, and post-processing the decompressed picture by selectively restoring, in the spatial domain, at least one region in the decompressed picture based on information indicating a removal of the at least one region prior to a previously performed encoding process.

Claims

1. An apparatus, comprising:

a data pruner for pre-processing a picture prior to, and in preparation for, compression by encoding, wherein said data pruner selectively removes, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portions of said picture to be encoded.

2. The apparatus of claim 1, wherein said data pruner is comprised in an encoder.

3. The apparatus of claim 1, further comprising an encoder coupled to said data pruner for encoding the picture with the at least one region removed.

4. The apparatus of claim 1, wherein side information indicating a location of the at least one region within the picture is transmitted to a decoder.

5. The apparatus of claim 1, wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

6. The apparatus of claim 1, wherein only even or odd lines are removed by said data pruner.

7. The apparatus of claim 1, wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

8. The apparatus of claim 1, wherein the at least one region selectively removed is determined responsive to an evaluation of at least one of an image distortion metric, a rate distortion metric, a dropped pixel metric, and a complexity metric.

9. The apparatus of claim 1, wherein 6-order interpolation is used for removing the at least one region in one dimension, and 8-order interpolation is used for removing the at least one region in two dimensions.

10. A method, comprising:

pre-processing a picture prior to, and in preparation for, compression by encoding, wherein said pre-processing comprises selectively removing, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portions of said picture to be encoded, using a data pruner having a processor.

11. The method of claim 10, wherein the method is comprised in an encoder.

12. The method of claim 10, further comprising encoding the picture with the at least one region removed.

13. The method of claim 10, wherein side information indicating a location of the at least one region within the picture is transmitted to a decoder.

14. The method of claim 10, wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

15. The method of claim 10, wherein only even or odd lines are removed by said pre-processing.

16. The method of claim 10, wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

17. The method of claim 10, wherein the at least one region selectively removed is determined responsive to an evaluation of at least one of an image distortion metric, a rate distortion metric, a dropped pixel metric, and a complexity metric.

18. The method of claim 10, wherein 6-order interpolation is used for removing the at least one region in one dimension, and 8-order interpolation is used for removing the at least one region in two dimensions.

19. An apparatus, comprising:

a data restorer for receiving a decompressed picture subsequent to decompression by decoding, and post-processing the decompressed picture by selectively restoring, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the decompressed picture, from the remaining portions of said picture that was encoded, based on information indicating a removal of the at least one region prior to a previously performed encoding process.

20. The apparatus of claim 19, wherein said data restorer is comprised in a decoder.

21. The apparatus of claim 19, further comprising a decoder coupled to said data restorer for decoding the picture with the at least one region removed.

22. The apparatus of claim 19, wherein said data restorer receives side information indicating a location of the at least one region within the picture is transmitted to a decoder.

23. The apparatus of claim 19, wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

24. The apparatus of claim 19, wherein only even or odd lines are restored by said data restorer.

25. The apparatus of claim 19, wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

26. The apparatus of claim 19, wherein 6-order interpolation is used for restoring the at least one region in one dimension, and 8-order interpolation is used for restoring the at least one region in two dimensions.

27. A method, comprising:

receiving a decompressed picture subsequent to decompression by decoding; and

post-processing, using a data restorer having a processor, the decompressed picture by selectively restoring, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the decompressed picture, from the remaining portions of said picture that was encoded, based on information indicating a removal of the at least one region prior to a previously performed encoding process.

28. The method of claim 27, wherein the method is comprised in a decoder.

29. The method of claim 27, further comprising decoding the picture with the at least one region removed prior to said receiving.

30. The method of claim 27, wherein said data restorer receives side information indicating a location of the at least one region within the picture is transmitted to a decoder.

31. The method of claim 27, wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

32. The method of claim 27, wherein only even or odd lines are restored by said post-processing.

33. The method of claim 27, wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

34. The method of claim 27, wherein 6-order interpolation is used for restoring the at least one region in one dimension, and 8-order interpolation is used for restoring the at least one region in two dimensions.

35. A non-transitory computer readable media having video signal data encoded thereupon, comprising:

an encoded picture pre-processed prior to compression by encoding, wherein the picture is pre-processed to selectively remove, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising, at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portion of said picture to be encoded.