Methods and device for data alignment with time domain boundary

• US 20070074266A1
• Filed: 09/26/2006
• Published: 03/29/2007
• Est. Priority Date: 09/27/2005
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Chen, Peisong, Shi, Fang, Raveendran, Vijayalakshmi, Tian, Tao, Bhamidipati, Phanikumar, Subramania, Sitaraman, Walker, Gordon, Oguz, Seyfullah
• Granted Patent: US 8,879,635 B2
• Time in Patent Office: Days
• US Class Current: 725/135
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/194 involving only two passes
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/65 : using error resilience
• CPC Class Codes: H04N 19/86 : involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 19/87 : involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 19/89 : involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/234309 : by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/2353 : specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2389 : Multiplex stream processing, e.g. multiplex stream encrypting
• CPC Class Codes: H04N 5/144 : Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/147 : Scene change detection
• CPC Class Codes: H04N 5/21 : Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 7/0115 : with details on the detection of a particular field or frame pattern in the incoming video signal, e.g. 3:2 pull-down pattern
• CPC Class Codes: H04N 7/012 : Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229

Abstract

Apparatus and methods of using content information for encoding multimedia data are described. A method of processing multimedia data includes obtaining content information of multimedia data, and encoding the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information. In another aspect, a method of processing multimedia data includes obtaining a content classification of the multimedia data, and encoding blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data. Apparatus that can process multimedia data described in these methods are also disclosed.

Claims

1. A method of processing multimedia data, comprising:

obtaining content information of multimedia data; and

encoding the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information.

2. The method of claim 1, wherein the content comprises a content classification.

3. The method of claim 1, wherein obtaining the content information comprises calculating the content information from the multimedia data.

4. The method of claim 1, wherein the data boundary comprises an I-frame data boundary.

5. The method of claim 1, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

6. The method of claim 1, wherein the data boundary comprises a slice boundary.

7. The method of claim 1, wherein the boundary of encoded data is an intra-coded access unit boundary.

8. The method of claim 1, wherein the data boundary comprises a P-frame boundary.

9. The method of claim 1, wherein the data boundary comprises a B-frame boundary.

10. The method of claim 1, wherein the content information comprises a complexity of the multimedia data.

11. The method of claim 10, wherein the complexity comprises temporal complexity, spatial complexity, or temporal complexity and spatial complexity.

12. An apparatus for processing multimedia data comprising:

a content classifier configured to determine a content classification of multimedia data; and

an encoder configured to encode the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information.

13. The apparatus of claim 12, wherein the content information comprises a content classification.

14. The apparatus of claim 12, wherein the content classifier is configured to obtain the content information by calculating the content information from the multimedia data.

15. The apparatus of claim 12, wherein the data boundary comprises an I-frame data boundary.

16. The apparatus of claim 12, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

17. The apparatus of claim 12, wherein the data boundary comprises a slice boundary.

18. The apparatus of claim 12, wherein the boundary of encoded data is an intra-coded access unit boundary.

19. The apparatus of claim 12, wherein the data boundary comprises a P-frame boundary.

20. The apparatus of claim 12, wherein the data boundary comprises a B-frame boundary.

21. The apparatus of claim 12, wherein the content information comprises a complexity of the multimedia data.

22. The apparatus of claim 21, wherein the complexity comprises temporal complexity, spatial complexity, or temporal complexity and spatial complexity.

23. An apparatus for processing multimedia data comprising:

means for obtaining content information of multimedia data; and

means for encoding the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information.

24. A processor being configured to:

obtain content information of multimedia data; and

encode the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information.

25. The processor of claim 24, wherein the content information comprises a content classification.

26. The processor of claim 24, wherein the content classifier is configured to obtain the content information by calculating the content information from the multimedia data.

27. The processor of claim 24, wherein the data boundary comprises an I-frame data boundary.

28. The processor of claim 24, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

29. The processor of claim 24, wherein the data boundary comprises a slice boundary.

30. The processor of claim 24, wherein the boundary of encoded data is an intra-coded access unit boundary.

31. The processor of claim 24, wherein the data boundary comprises a P-frame boundary.

32. The processor of claim 24, wherein the data boundary comprises a B-frame boundary.

33. A machine readable medium comprising instructions that upon execution cause a machine to:

obtain content information of multimedia data; and

encode the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information.

34. The machine-readable medium of claim 33, wherein the content information comprises a content classification.

35. The machine-readable medium of claim 33, further comprising instructions wherein the content classifier is configured to obtain the content information by calculating the content information from the multimedia data.

36. The machine-readable medium of claim 33, wherein the data boundary comprises an I-frame data boundary.

37. The machine-readable medium of claim 33, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

38. The machine-readable medium of claim 33, wherein the data boundary comprises a slice boundary.

39. The machine-readable medium of claim 33, wherein the boundary of encoded data is an intra-coded access unit boundary.

41. The method of claim 39, wherein said encoding comprises increasing the number of macroblocks encoded as intra-coded macroblocks corresponding to a decrease in the content classification.

42. The method of claim 39, wherein the content classification is based on a spatial complexity, temporal complexity or spatial complexity and temporal complexity of the multimedia data.

40. A method of processing multimedia data, comprising:

obtaining a content classification of the multimedia data; and

encoding blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data.

43. An apparatus for processing multimedia data comprising:

a content classifier configured to obtain a content classification of the multimedia data; and

an encoder configured to encode blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data.

44. The apparatus of claim 43, wherein said encoder is further configured to increase the number of macroblocks encoded as intra-coded macroblocks corresponding to a decrease in the content classification.

45. The apparatus of claim 43, wherein the content classification is based on a spatial complexity, temporal complexity or spatial complexity and temporal complexity of the multimedia data.

46. A processor being configured to:

obtain a content classification of the multimedia data; and

encode blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data.

47. The processor of claim 46, wherein the encoding configuration comprises increasing the number of macroblocks encoded as intra-coded macroblocks corresponding to a decrease in the content classification.

48. The processor of claim 46, wherein the content classification is based on a spatial complexity, temporal complexity or spatial complexity and temporal complexity of the multimedia data.

49. An apparatus for processing multimedia data comprising:

means for obtaining a content classification of the multimedia data; and

means for encoding blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data.

50. The apparatus of claim 49, wherein said encoding means comprise increasing the number of macroblocks encoded as intra-coded macroblocks corresponding to a decrease in the content classification.

51. The apparatus of claim 49, wherein the content classification means is based on a spatial complexity, temporal complexity or spatial complexity and temporal complexity of the multimedia data.

52. A machine-readable medium comprising instructions that upon execution cause a machine to:

obtain a content classification of the multimedia data; and

encode blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data.

53. The machine-readable medium of claim 52, wherein said instructions to encode comprise instructions to increase the number of macroblocks encoded as intra-coded macroblocks corresponding to a decrease in the content classification.

54. The apparatus of claim 52, wherein the content classification is based on a spatial complexity, temporal complexity or spatial complexity and temporal complexity of the multimedia data.