Method and apparatus for macroblock adaptive inter-layer intra texture prediction

• US 8,374,239 B2
• Filed: 05/18/2006
• Issued: 02/12/2013
• Est. Priority Date: 07/11/2005
• Status: Active Grant

• Current Assignee: InterDigital Madison Patent Holdings (InterDigital, Inc.)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Yin, Peng, Boyce, Jill MacDonald, Pandit, Purvin Bibhas
• Primary Examiner(s): Kizou, Hassan
• Assistant Examiner(s): MAGLO, EMMANUEL K
• Application Number:
  US11/988,696
• Publication Number:
  US 20090074061A1
• Time in Patent Office: 2,462 Days
• Field of Search: 375/240.1, 375/240.12, 375/240.16, 375/240.26
• US Class Current: 375/240.12
• CPC Class Codes: B63B 25/12 closed
• CPC Class Codes: B63B 25/16 heat-insulated insulating panelling B63B3/68; heating or cooling B63J
• CPC Class Codes: F17C 11/007 for hydrocarbon gases, such as methane or natural gas, propane, butane or mixtures thereof [LPG]
• CPC Class Codes: F17C 13/082 for large sea-borne storage vessels load-accommodating arrangements for ships or waterborne vessels B63B25/12
• CPC Class Codes: F17C 2201/0138 tubular
• CPC Class Codes: F17C 2201/032 with substantially vertical main axis
• CPC Class Codes: F17C 2201/035 with substantially horizontal main axis
• CPC Class Codes: F17C 2201/052 large (>1000 m3)
• CPC Class Codes: F17C 2201/054 medium (>1 m3)
• CPC Class Codes: F17C 2205/0142 bundled in parallel
• CPC Class Codes: F17C 2221/033 Methane, e.g. natural gas, CNG, LNG, GNL, GNC, PLNG
• CPC Class Codes: F17C 2227/0157 Compressors
• CPC Class Codes: F17C 2227/0337 by cooling
• CPC Class Codes: F17C 2227/0388 separate
• CPC Class Codes: F17C 2265/015 by separating
• CPC Class Codes: F17C 2265/025 different fluids
• CPC Class Codes: F17C 2270/0105 Ships
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/29 : involving scalability at the object level, e.g. video object layer [VOL]
• CPC Class Codes: H04N 19/31 : in the temporal domain
• CPC Class Codes: H04N 19/33 : in the spatial domain
• CPC Class Codes: H04N 19/36 : Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 : Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/593 : involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: Y10T 137/2496 : Self-proportioning or correlating systems
• CPC Class Codes: Y10T 137/2931 : Diverse fluid containing pressure systems
• CPC Class Codes: Y10T 137/4456 : With liquid valves or liquid trap seals
• CPC Class Codes: Y10T 137/6416 : With heating or cooling of the system
• CPC Class Codes: Y10T 137/8593 : Systems

Abstract

There are provided scalable video encoders and decoders and corresponding methods for scalable video encoding and decoding. A scalable video encoder includes an encoder for selectively using spatial intra prediction to code, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

Claims

1. An apparatus comprising an encoder, selectively using spatial intra prediction to code, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

2. The apparatus of claim 1, wherein the spatial intra prediction used to code the enhancement layer residue is compliant with spatial intra prediction techniques of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard.

3. The apparatus of claim 1, wherein said encoder adds a syntax field in a macroblock header to indicate which prediction mode is used for the enhancement layer residue.

4. The apparatus of claim 1, wherein said encoder modifies a syntax of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard to provide an inference as to which prediction mode is used for the enhancement layer residue, when the base layer prediction mode is intra.

5. The apparatus of claim 4, wherein said encoder uses a prediction mode other than the spatial intra prediction to code the enhancement layer residue, when the base layer prediction mode is constrained to inter.

6. The apparatus of claim 1, wherein said encoder determines which prediction mode to use on the enhancement layer from among different available prediction modes, the different available prediction modes comprising an enhancement layer residue without spatial intra prediction mode, an enhancement layer residue with spatial intra prediction mode, and an enhancement layer pixel with spatial intra prediction mode.

7. The apparatus of claim 6, wherein said encoder determines which prediction mode to use for the enhancement layer from the different available prediction modes based on an a posteriori decision criteria, or on past statistics of the different available prediction modes and properties of the enhancement layer residue and enhancement layer pixels.

8. A method for scalable video encoding, comprising selectively using spatial intra prediction to code, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

9. The method of claim 8, wherein the spatial intra prediction used to code the enhancement layer residue is compliant with spatial intra prediction techniques of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard.

10. The method of claim 8, further comprising adding a syntax field in a macroblock header to indicate which prediction mode is used for the enhancement layer residue.

11. The method of claim 8, further comprising modifying a syntax of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard to provide an inference as to which prediction mode is used for the enhancement layer residue, when the base layer prediction mode is intra.

12. The method of claim 11, further comprising using a prediction mode other than the spatial intra prediction to code the enhancement layer residue, when the base layer prediction mode is constrained to inter.

13. The method of claim 8, further comprising determining which prediction mode to use on the enhancement layer from among different available prediction modes, the different available prediction modes comprising an enhancement layer residue without spatial intra prediction mode, an enhancement layer residue with spatial intra prediction mode, and an enhancement layer pixel with spatial intra prediction mode.

14. The method of claim 13, further comprising determining which prediction mode to use for the enhancement layer from the different available prediction modes based on an a posteriori decision criteria, or on past statistics of the different available prediction modes and properties of the enhancement layer residue and enhancement layer pixels.

15. An apparatus comprising an encoder, coding an enhancement layer using both a spatial neighboring intra prediction mode in the enhancement layer and an upsampled corresponding base layer prediction mode.

16. The apparatus of claim 15, wherein said encoder adds a flag in a macroblock header without signaling a prediction mode, when the spatial neighboring intra prediction mode used in the enhancement layer is the same as the upsampled corresponding base layer prediction mode.

17. The apparatus of claim 15, wherein said encoder forces a current intra prediction mode to be the same as the upsampled corresponding base layer mode without sending corresponding syntax, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer prediction mode.

18. A method for scalable video encoding, comprising coding an enhancement layer using both a spatial neighboring intra prediction mode in the enhancement layer and an upsampled corresponding base layer prediction mode.

19. The method of claim 18, further comprising adding a flag in a macroblock header without signaling a prediction mode, when the spatial neighboring intra prediction mode used in the enhancement layer is the same as the upsampled corresponding base layer prediction mode.

20. The method of claim 18, further comprising forcing a current intra prediction mode to be the same as the upsampled corresponding base layer mode without sending corresponding syntax, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer prediction mode.

21. An apparatus comprising a decoder, selectively using spatial intra prediction to decode, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

22. The apparatus of claim 21, wherein the spatial intra prediction used to decode the enhancement layer residue is compliant with spatial intra prediction techniques of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard.

23. The apparatus of claim 21, wherein said decoder determines which prediction mode to use for the enhancement layer residue using a syntax field in a macroblock header.

24. The apparatus of claim 21, wherein said decoder evaluates an inference, provided in a modified syntax of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard, as to which prediction mode was used to code the enhancement layer residue, when the base layer prediction mode is intra.

25. The apparatus of claim 24, wherein said decoder uses a prediction mode other than the spatial intra prediction to decode the enhancement layer residue, when the base layer prediction mode is constrained to inter.

26. The apparatus of claim 21, wherein said decoder determines a prediction mode for use on the enhancement layer residue based on parsed syntax, the prediction mode determined from among any of an enhancement layer residue without spatial intra prediction mode, an enhancement layer residue with spatial intra prediction mode, and an enhancement layer pixel with spatial intra prediction mode.

27. A method for scalable video decoding, comprising selectively using spatial intra prediction to decode, on a macroblock adaptive basis, an enhancement layer residue generated between an enhancement layer macroblock and a corresponding upsampled base layer macroblock.

28. The method of claim 27, wherein the spatial intra prediction used to decode the enhancement layer residue is compliant with spatial intra prediction techniques of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard.

29. The method of claim 27, further comprising determining which prediction mode to use for the enhancement layer residue using a syntax field in a macroblock header.

30. The method of claim 27, further comprising evaluating an inference, provided in a modified syntax of the International Telecommunication Union, Telecommunication Sector (ITU-T) H.264 standard, as to which prediction mode was used to code the enhancement layer residue, when the base layer prediction mode is intra.

31. The method of claim 30, further comprising using a prediction mode other than the spatial intra prediction to decode the enhancement layer residue, when the base layer prediction mode is constrained to inter.

32. The method of claim 27, further comprising determining, based on parsed syntax, which prediction mode to use on the enhancement layer residue from among an enhancement layer residue without spatial intra prediction mode, an enhancement layer residue with spatial intra prediction mode, and an enhancement layer pixel with spatial intra prediction mode.

33. An apparatus comprising a decoder, decoding an enhancement layer using both a spatial neighboring intra prediction mode in the enhancement layer and an upsampled corresponding base layer prediction mode.

34. The apparatus of claim 33, wherein said decoder forces a current intra prediction mode to be the same as the upsampled corresponding base layer mode without receiving corresponding syntax, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer prediction mode.

35. The apparatus of claim 33, wherein said decoder determines which intra prediction mode to use for the enhancement layer based on a flag in a macroblock header.

36. The apparatus of claim 33, wherein said decoder determines an intra prediction mode for the enhancement layer to be the same as the upsampled corresponding base layer mode, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer mode.

37. A method for scalable video decoding, comprising decoding an enhancement layer using both a spatial neighboring intra prediction mode in the enhancement layer and an upsampled corresponding base layer prediction mode.

38. The method of claim 37, further comprising forcing a current intra prediction mode to be the same as the upsampled corresponding base layer mode without receiving corresponding syntax, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer prediction mode.

39. The method of claim 37, further comprising determining which intra prediction mode to use for the enhancement layer based on a flag in a macroblock header.

40. The method of claim 37, further comprising determining an intra prediction mode for the enhancement layer to be the same as the upsampled corresponding base layer mode, when the spatial neighboring intra prediction mode is the same as the upsampled corresponding base layer mode.