Methods and device for data alignment with time domain boundary

• US 8,879,635 B2
• Filed: 09/26/2006
• Issued: 11/04/2014
• Est. Priority Date: 09/27/2005
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Raveendran, Vijayalakshmi Rajasundaram, Walker, Gordon Kent, Tian, Tao, Bhamidipati, Phanikumar Kanakadurga, Shi, Fang, Chen, Peisong, Subramania, Sitaraman Ganapathy, Oguz, Seyfullah Halit
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US11/528,139
• Publication Number:
  US 20070074266A1
• Time in Patent Office: 2,961 Days
• Field of Search: 37524001-24029, 370/280, 370/294, 370/314, 370/321, 370/478, 340/870.13, 348/402.1, 348/413.1, 348/415.1, 348/416.1, 348/420.1
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/194 involving only two passes
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/65 : using error resilience
• CPC Class Codes: H04N 19/86 : involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 19/87 : involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 19/89 : involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/234309 : by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/2353 : specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2389 : Multiplex stream processing, e.g. multiplex stream encrypting
• CPC Class Codes: H04N 5/144 : Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/147 : Scene change detection
• CPC Class Codes: H04N 5/21 : Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 7/0115 : with details on the detection of a particular field or frame pattern in the incoming video signal, e.g. 3:2 pull-down pattern
• CPC Class Codes: H04N 7/012 : Conversion between an interlaced and a progressive signal for graphics images G09G2310/0229

Abstract

Apparatus and methods of using content information for encoding multimedia data are described. A method of processing multimedia data includes obtaining content information of multimedia data, and encoding the multimedia data so as to align a data boundary with a frame boundary in a time domain, wherein said encoding is based on the content information. In another aspect, a method of processing multimedia data includes obtaining a content classification of the multimedia data, and encoding blocks in the multimedia data as intra-coded blocks or inter-coded blocks based on the content classification to increase the error resilience of the encoded multimedia data. Apparatus that can process multimedia data described in these methods are also disclosed.

Claims

1. A method of processing multimedia data in a video encoding device, the method comprising:

obtaining content information of multimedia data, wherein the content information includes content classifications for a plurality of macroblocks in the multimedia data, each content classification for a macroblock determined by

a texture value associated with spatial complexity of the macroblock, and

a motion value associated with temporal complexity of the macroblock; and

encoding the multimedia data, based on the content information, to define slices that comprise independently decodable video data of a frame in the multimedia data, the encoding of the multimedia data including

aligning a data boundary of the slices with a frame boundary in a time domain bitstream, the frame comprising a time division multiplexed block of physical layer packets, and

restricting the physical layer packets to each contain data for only one of the slices.

2. The method of claim 1, wherein obtaining the content information comprises calculating the content information from the multimedia data.

3. The method of claim 1, wherein the data boundary comprises an I-frame data boundary.

4. The method of claim 1, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

5. The method of claim 1, wherein the data boundary comprises an intra-coded access unit boundary.

6. The method of claim 1, wherein the data boundary comprises a P-frame boundary.

7. The method of claim 1, wherein the data boundary comprises a B-frame boundary.

8. An apparatus for processing multimedia data, wherein the apparatus is implemented at least partially in hardware or a processor, the apparatus comprising:

a content classifier configured to determine a content classification for a macroblock in multimedia data, wherein the content classification is determined by a texture value associated with spatial complexity of the macroblock and by a motion value associated with temporal complexity of the macroblock; and

an encoder configured to encode the multimedia data, based on the content information, to define slices that comprise independently decodable video data of a frame in the multimedia data, encoding the multimedia data including

aligning a data boundary of the slices with a frame boundary in a time domain bitstream, the frame comprising a time division multiplexed block of physical layer packets, and

restricting the physical layer packets to each contain data for only one of the slices.

9. The apparatus of claim 8, wherein the content classifier is configured to obtain the content information by calculating the content information from the multimedia data.

10. The apparatus of claim 8, wherein the data boundary comprises an I-frame data boundary.

11. The apparatus of claim 8, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

12. The apparatus of claim 8, wherein the data boundary comprises an intra-coded access unit boundary.

13. The apparatus of claim 8, wherein the data boundary comprises a P-frame boundary.

14. The apparatus of claim 12, wherein the data boundary comprises a B-frame boundary.

15. An apparatus for processing multimedia data, wherein the apparatus is implemented at least partially in hardware or a processor, the apparatus comprising:

means for obtaining content information of multimedia data, wherein the content information includes a content classification for a macroblock in the multimedia data, the content classification determined by

a texture value associated with spatial complexity of the macroblock, and

a motion value associated with temporal complexity of the macroblock; and

means for encoding the multimedia data, based on the content information, to define slices, wherein each slice comprises independently decodable video data of a frame in the multimedia data, and to

align a data boundary of the slices with a frame boundary in a time domain bitstream, the frame comprising a time division multiplexed block of physical layer packets, and

restrict the physical layer packet of a frame to each contain data of only one of the slices.

16. A processor being configured to:

obtain content information of multimedia data, wherein the content information includes a content classification for a macroblock in the multimedia data, the content classification determined by

a texture value associated with spatial complexity of the macroblock, and

a motion value associated with temporal complexity of the macroblock; and

encode the multimedia data, based on the content information, to

define slices that comprise independently decodable video data of a frame in the multimedia data,

align a data boundary of the slices with a frame boundary in a time domain bitstream, the frame comprising a time division multiplexed block of physical layer packets, and

restrict the physical layer packets of to each contain data of only one of the slices.

17. The processor of claim 16, wherein the content information is obtained by calculating the content information from the multimedia data.

18. The processor of claim 16, wherein the data boundary comprises an I-frame data boundary.

19. The processor of claim 16, wherein the data boundary comprises a boundary of independently decodable encoded data of the multimedia data.

20. The processor of claim 16, wherein the data boundary comprises an intra-coded access unit boundary.

21. The processor of claim 16, wherein the data boundary comprises a P-frame boundary.

22. The processor of claim 16, wherein the data boundary comprises a B-frame boundary.

23. A non-transitory machine readable medium comprising instructions that upon execution cause a machine to:

obtain content information of multimedia data, wherein the content information includes content a classification for a macroblock in the multimedia data and the content classification is determined by

a texture value associated with spatial complexity of the macroblock, and

a motion value associated with temporal complexity of the macroblock; and

encode the multimedia data, based on the content information, to define slices, wherein each slice comprises independently decodable video data of a frame in the multimedia data, the encoding of the multimedia data including

aligning a data boundary slices with a frame boundary in a time domain bitstream, the frame comprising a time division multiplexed block of physical layer packets, and

restricting the physical layer packets of a frame so that each physical layer packet contains data of only one of the slices.

24. The machine-readable medium of claim 23, further comprising instructions configured to obtain the content information by calculating the content information from the multimedia data.

25. The machine-readable medium of claim 23, wherein the data boundary further comprises an I-frame data boundary.

26. The machine-readable medium of claim 23, wherein the data boundary further comprises a boundary of independently decodable encoded data of the multimedia data.

27. The machine-readable medium of claim 23, wherein the data boundary further comprises an intra-coded access unit boundary.