MPEG transcoding system and method using motion information

• US 20030206590A1
• Filed: 05/06/2002
• Published: 11/06/2003
• Est. Priority Date: 05/06/2002
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Krishnamachari, Santhana
• Application Number:
  US10/139,174
• Publication Number:
  US 20030206590A1
• Time in Patent Office: Days
• US Class Current: 375/240.16
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/625 using discrete cosine transform [DCT]

Abstract

An open loop system and method of transcoding a stream of compressed video data to a required lower bit rate. The invention includes the steps of: examining motion vectors for each of a set of macroblocks in the stream; determining an importance of each of the set of macroblocks based the motion vectors; and selectively modifying DCT blocks in the set of macroblocks to reduce the bit rate, wherein the modification to each DCT block is based on the determined importance of the macroblock. High coefficient dropping or re-quantization may be utilized.

Claims

1. A system for converting a stream of compressed video data to a required lower bit rate, comprising:

a system for determining an importance of each of a set of macroblocks in the stream; and

a system for selectively bit rate transcoding discrete cosine transform (DCT) blocks in the set of macroblocks based on the determined importance of each macroblock.

2. The system of claim 1, wherein the system for selective bit rate transcoding is further based on a bit rate reduction requirement.

3. The system of claim 1, wherein the importance of each macroblock is based on a number of target macroblocks for which the macroblock was used as a reference macroblock.

4. The system of claim 3, wherein the importance of each macroblock is obtained by examining motion vectors in the stream of data.

5. The system of claim 4, wherein the system for selective bit rate transcoding achieves a reduced bit rate by dropping high frequency coefficients from the DCT blocks based on the importance of the macroblock.

6. The system of claim 5, wherein the system for selective bit rate transcoding drops a greater number of high frequency coefficients from the DCT blocks of less important macroblocks relative to more important macroblocks.

7. The system of claim 5, wherein the number of high frequency coefficients dropped from DCT blocks in a selected macroblock is inversely proportional to the importance of the selected macroblock.

8. The system of claim 4, wherein the system for selective bit rate transcoding lowers the bit rate by re-quantizing DCT coefficients from DCT blocks in a selected macroblock.

9. The system of claim 8, wherein an amount of re-quantization applied to the DCT blocks is based on the importance of the selected macroblock.

10. The system of claim 8, wherein lesser important macroblocks are given a greater amount of re-quantization.

11. The system of claim 1, wherein the system for determining importance includes a P frame analysis system that examines motion vectors from previous and subsequent B frames, and from a subsequent P frame if it exists, to determine how often each macroblock in a current P frame acts as a reference macroblock.

12. The system of claim 11, wherein the system for determining importance further comprises an indirect analysis system that determines how often macroblocks in the subsequent P frame are referenced by other video frames.

13. The system of claim 1, wherein the system for determining importance includes an I frame analysis system that examines motion vectors from previous and subsequent B frames, and from a subsequent P frame, to determine how often each macroblock in a current I frame acts as a reference macroblock.

14. The system of claim 13, wherein the system for determining importance further comprises an indirect analysis system that determines how often target macroblocks in the subsequent P frame act as reference macroblocks.

15. The system of claim 11, further comprising a partial macroblock analysis system that computes an overlap between a current macroblock and a reference macroblock and scales the importance value based on the overlap.

16. The system of claim 1, further comprising a residual analysis system that further determines the importance of each macroblock based on values of a plurality of residual discrete cosine transform (DCT) coefficients of the macroblock.

17. A program product stored on a recordable medium for bit rate transcoding a stream of compressed video data to a required lower bit rate, the program product comprising:

means for determining an importance of each of a set of macroblocks in the stream; and

means for selectively modifying discrete cosine transform (DCT) blocks contained in the set of macroblocks to reduce the bit rate, wherein the modification to each DCT block is based on the determined importance of the macroblock.

18. The program product of claim 17, wherein the modification is further based on a predetermined bit rate reduction requirement for the stream of compressed video data.

19. The program product of claim 17, wherein the importance of each macroblock is based on a number of target macroblocks for which the macroblock was used as a reference macroblock.

20. The program product of claim 19, wherein the importance of each macroblock is obtained by examining motion vectors in the stream of compressed video data.

21. The program product of claim 20, wherein the means for selectively modifying DCT blocks achieves a reduced bit rate by dropping high frequency coefficients from DCT blocks based on the importance of the macroblock.

22. The program product of claim 21, wherein the means for selectively modifying DCT blocks drops a greater number of high frequency coefficients from DCT blocks of less important macroblocks than it drops from more important macroblocks.

23. The program product of claim 21, wherein the number of high frequency coefficients dropped from each DCT block in each macroblock is inversely related to the importance of the macroblock.

24. The program product of claim 20, wherein the means for selectively modifying DCT blocks lowers the bit rate by re-quantizing DCT coefficients from selected macroblocks in the reference frame.

25. The program product of claim 25, wherein an amount of re-quantization applied to each DCT block is based on the importance of the macroblock.

26. The program product of claim 25, wherein lesser important macroblocks are given a greater amount of re-quantization.

27. A method of transcoding a stream of compressed video data to a required lower bit rate, the comprising:

examining motion vectors for each of a set of macroblocks in the stream;

determining an importance of each of the set of macroblocks based the motion vectors; and

selectively modifying discrete cosine transform (DCT) blocks in the set of macroblocks to reduce the bit rate, wherein the modification to each DCT block is based on the determined importance of the macroblock.

28. The method of claim 27, wherein the importance a current macroblock is based on a number of target macroblocks for which the current macroblock was used as a reference macroblock.

29. The method of claim 27, wherein the step of selectively modifying macroblocks includes the step of dropping high frequency coefficients.

30. The method of claim 28, wherein the step of selectively modifying DCT blocks includes the further step of:

dropping more high frequency coefficients for lesser important macroblocks than are dropped for greater important macroblocks.

31. The method of claim 27, wherein the determining step includes the steps of:

reading a current P frame; and

examining motion vectors from previous and subsequent B frames, and from a subsequent P frame if it exists, to determine how often each macroblock in the current P frame acts as a reference macroblock for target macroblocks in the B and P frames.

32. The method of claim 31, wherein the determining step comprises the further step of determining how often target macroblocks in the subsequent P frame act as reference macroblocks.

33. The method of claim 27, wherein the determining step includes the steps of:

reading a current I frame; and

examining motion vectors from previous and subsequent B frames, and from a subsequent P frame, to determine how often each macroblock in the current I frame acts as a reference macroblock for target macroblocks in the B and P frames.

34. The method of claim 33, wherein the determining step comprises the further step of determining how often target macroblocks in the subsequent P frame act as reference macroblocks.

35. The method of claim 27, comprising the further step of assigning B frame data a lowest relative importance.

36. The method of claim 27, wherein if a current macroblock acts as a partial reference macroblock, implementing the steps of:

determining an amount of pixel overlap between the current macroblock and a corresponding reference macroblock; and

scaling the importance of the current macroblock based on the amount of pixel overlap.

37. The method of claim 27, wherein the importance of each macroblock is further determined based on values of a plurality of residual DCT coefficients of the macroblock.