System and method for dynamically switching quality settings of a codec to maintain a target data rate

• US 7,302,102 B2
• Filed: 02/23/2004
• Issued: 11/27/2007
• Est. Priority Date: 09/26/2001
• Status: Expired due to Fees

• Current Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Original Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Inventors: Wilkinson, John E., Reznick, Lawrence S., Prock, Jack A., Reynolds, Jodie L., Mabey, Danny L.
• Primary Examiner(s): Couso; Jose L.
• Application Number:
  US10/784,397
• Publication Number:
  US 20040165783A1
• Time in Patent Office: 1,373 Days
• Field of Search: 382232-236, 382238-240, 382244-251, 348/417.1, 348/418.1, 348/422.1, 375/240.04, 375/240.12, 375/240.24
• US Class Current: 382/232
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/122 Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/164 : Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 : the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 : the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/177 : the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/192 : the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: H04N 21/23406 : involving management of server-side video buffer
• CPC Class Codes: H04N 21/23418 : involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23439 : for generating different versions
• CPC Class Codes: H04N 21/25825 : involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25858 : involving client software characteristics, e.g. OS identifier
• CPC Class Codes: H04N 21/44209 : Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4621 : Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6379 : directed to encoder , e.g. for requesting a lower encoding rate

Abstract

A video compression system includes a compression module to compress each of a plurality of segments of an input signal using an initial quality setting. A rate calculation module calculates, for each compressed segment, a data rate for an output signal that would result from adding a compressed segment to the output signal. A selection module automatically selects, in response to the calculated data rate deviating from a target range, a quality setting for each segment that results in a data rate this is within the target range when a segment compressed using the automatically-selected quality setting is added to the output signal.

Claims

1. A video compression method comprising:

compressing a segment of an input signal using an initial quality setting;

calculating a data rate for an output signal that would result from adding the compressed segment to the output signal; and

in response to the calculated data rate exceeding a target rate, recompressing the segment using an automatically-selected quality setting that produces a lower data rate than the calculated data rate when the recompressed segment is added to the output signal.

2. The method of claim 1, further comprising:

in response to the calculated data rate being lower than the target rate, recompressing the segment using an automatically-selected quality setting that produces a higher data rate than the calculated data rate when the recompressed segment is added to the output signal.

3. The method of claim 1, wherein the automatically-selected quality setting comprises a quality quantizer.

4. The method of claim 1, wherein the automatically-selected quality setting comprises at least one of a frame size and a frame rate.

5. The method of claim 1, wherein the segment comprises a sub-frame.

6. The method of claim 1, wherein the initial quality setting comprises an automatically-selected quality setting for a previous segment.

7. The method of claim 1, wherein automatically selecting comprises selecting a quality setting that is a function of the difference between the calculated data rate and the target rate.

8. The method of claim 1, wherein automatically selecting comprises selecting a next numerically higher or lower quality setting depending on whether the calculated data rate is higher or lower than the target rate.

9. The method of claim 1, wherein automatically selecting comprises using an artificial intelligence (AI) system to select the quality setting based on one or more characteristics of the segment.

10. A video compression method comprising:

for each of a plurality of segments of an input signal;

compressing a segment using an initial quality setting;

calculating a data rate for an output signal that would result from adding the compressed segment to the output signal; and

in response to the calculated data rate deviating from a target range;

automatically selecting a quality setting that results in a calculated data rate within the target range when a segment compressed using the automatically-selected quality setting is added to the output signal; and

recompressing the segment using the automatically-selected quality setting.

11. The method of claim 10, wherein the automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

12. The method of claim 10, wherein automatically selecting comprises selecting a quality setting that is a function of the distance between the calculated data rate and the target range.

13. The method of claim 10, wherein automatically selecting comprises selecting a next numerically higher or lower quality setting depending on whether the calculated data rate is higher or lower than the target range.

14. The method of claim 10, wherein automatically selecting comprises using an artificial intelligence (AI) system to select the quality setting based on one or more characteristics of the segment.

15. A video compression method comprising:

obtaining an input signal comprising a plurality of segments;

automatically selecting different quality settings to respectively compress at least two of the segments, wherein the quality settings for each segment are automatically selected to maintain within a target range a data rate of an output signal to which the compressed segments are to be added;

compressing the segments using the automatically selected quality settings; and

adding the compressed segments to the output data signal.

16. The method of claim 15, wherein an automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

17. The method of claim 15, wherein automatically selecting comprises:

testing a plurality of different automatically-selected quality settings for compressing a segment; and

selecting one of the tested quality settings that is to produce a data rate within the target range when the segment is compressed using the selected setting and added to the output signal.

18. The method of claim 15, wherein automatically selecting comprises:

testing, for an established time period, a plurality of different automatically-selected quality settings for compressing a segment; and

selecting the tested quality setting that produces the closest data rate to the target range in response to the established time period expiring.

19. The method of claim 17, wherein each successive automatically-selected quality setting to be tested is a function of the distance between the target range and a calculated data rate for a previous automatically-selected quality setting.

20. The method of claim 15, wherein automatically selecting comprises using an artificial intelligence (AI) system to select the quality setting based on one or more characteristics of the segment.

21. The method of claim 15, wherein the AI system is selected from the group consisting of a neural network and an expert system.

22. The method of claim 20, wherein the one or more characteristics are selected from the group consisting of motion characteristics and color characteristics.

23. The method of claim 15, further comprising adjusting the target range in response to constraints of a destination system for receiving the output signal.

24. The method of claim 15, further comprising adjusting the target range in response to conditions of a transmission channel to a destination system for receiving the output signal.

25. A video compression method comprising:

compressing a segment using an initial quality setting;

calculating a data rate for an output signal that would result from adding the compressed segment to the output signal;

while the calculated data rate deviates from a target range, automatically selecting a different quality setting that results in a new calculated data rate that is closer to the target range; and

in response to an automatically-selected quality setting resulting in a data rate that is within the target range, compressing the segment using the automatically-selected quality setting.

26. The method of claim 25, wherein the automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

27. The method of claim 25, wherein automatically selecting comprises using an artificial intelligence (AI) system to select the quality setting based on one or more characteristics of the segment.

28. The method of claim 27, wherein the AI system is selected from the group consisting of a neural network and an expert system.

29. The method of claim 27, wherein each successive automatically-selected quality setting is a function of the distance between the target range and a calculated data rate for a previous automatically-selected quality setting.

30. The method of claim 25, further comprising adjusting the target range in response to one of constraints of a destination system for receiving the output signal and conditions of a transmission channel to the destination system.

31. A video compression system comprising:

an input module to receive an input signal comprising a plurality of segments;

a compression module to compress a segment using an initial quality setting;

a rate calculation module to calculate a data rate for an output signal that would result from adding the compressed segment to the output signal;

wherein the compression module, in response to the calculated data rate exceeding a target rate, is to recompress the segment using an automatically-selected quality setting that produces a lower data rate than the calculated data rate when the recompressed segment is added to the output signal.

32. The system of claim 31, wherein the compression module, in response to the calculated data rate being lower than the target rate, is to recompress the segment using an automatically-selected quality setting that produces a higher data rate than the calculated data rate when the recompressed segment is added to the output signal.

33. The system of claim 31, wherein the automatically-selected quality setting comprises a quality quantizer.

34. The system of claim 31, wherein the automatically-selected quality setting comprises at least one of a frame size and a frame rate.

35. The system of claim 31, wherein the segment comprises a sub-frame.

36. The system of claim 31, wherein the initial quality setting comprises an automatically-selected quality setting for a previous segment.

37. The system of claim 31, further comprising a selection module to automatically select a quality setting that is a function of the difference between the calculated data rate and the target rate.

38. The system of claim 31, further comprising a selection module to automatically select a next numerically higher or lower quality setting depending on whether the calculated data rate is higher or lower than the target rate.

39. The system of claim 31, further comprising a selection module that is to use an artificial intelligence (AI) system to automatically select the quality setting based on one or more characteristics of the segment.

40. A video compression system comprising:

a compression module to compress each of a plurality of segments of an input signal using an initial quality setting;

a rate calculation module to calculate, for each compressed segment, a data rate for an output signal that would result from adding a compressed segment to the output signal; and

a selection module to automatically select, in response to the calculated data rate deviating from a target range, a quality setting for each segment that results in a data rate this is within the target range when a segment compressed using the automatically-selected quality setting is added to the output signal.

41. The system of claim 40, wherein the automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

42. The system of claim 40, wherein the selection module is to automatically select a quality setting that is a function of the difference between the calculated data rate for a segment and the target range.

43. The system of claim 40, wherein the selection module is to automatically select a next numerically higher or lower quality setting depending on whether the calculated data rate for a segment is higher or lower than the target range.

44. The system of claim 40, wherein the selection module is to use an artificial intelligence (AI) system to automatically select the quality setting based on one or more characteristics of each segment.

45. A video compression system comprising:

an input module to obtain an input signal comprising a plurality of segments;

a selection module to automatically select different quality settings to respectively compress at least two of the segments, wherein the quality settings for each segment are automatically selected to maintain within a target range a data rate of an output signal to which the compressed segments are to be added;

a compression module to compress the segments using the automatically selected quality settings; and

an output module to add the compressed segments to the output data signal.

46. The system of claim 45, wherein an automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

47. The system of claim 45, wherein the selection module is to test a plurality of different automatically-selected quality settings for compressing a segment and select one of the tested quality settings that is to produce a data rate within the target range when the segment is compressed using the selected setting and added to the output signal.

48. The system of claim 47, wherein the selection module is to test, for an established time period, a plurality of different automatically-selected quality settings for compressing a segment and select the tested quality setting that produces the closest data rate to the target range in response to the established time period expiring.

49. The system of claim 47, wherein each successive automatically-selected quality setting to be tested is a function of the difference between a target range and a calculated data rate for a previous automatically-selected quality setting.

50. The system of claim 45, wherein the selection module is to use an artificial intelligence (AI) system to automatically select the quality setting based on one or more characteristics of the segment.

51. The system of claim 45, wherein the AI system is selected from the group consisting of a neural network and an expert system.

52. The system of claim 50, wherein the one or more characteristics are selected from the group consisting of motion characteristics and color characteristics.

53. The system of claim 45, wherein the selection module is to adjust the target range in response to constraints of a destination system for receiving the output signal.

54. The system of claim 45, wherein the selection module is to adjust the target range in response to conditions of a transmission channel to a destination system for receiving the output signal.

55. A video compression system comprising:

a compression module to compress a segment using an initial quality setting;

a rate calculation module to calculate a data rate for an output signal that would result from adding the compressed segment to the output signal;

a selection module to automatically select, while the calculated data rate deviates from a target range, a different quality setting that results in a new calculated data rate that is closer to the target range;

wherein the compression module, in response to an automatically-selected quality setting resulting in a data rate that is within the target range, is to compress the segment using the automatically-selected quality setting.

56. The system of claim 55, wherein the automatically-selected quality setting comprises at least one of a quality quantizer, a frame size, and a frame rate.

57. The system of claim 55, wherein the selection module is to use an artificial intelligence (AI) system to automatically select the quality setting based on one or more characteristics of the segment.

58. The system of claim 57, wherein the AI system is selected from the group consisting of a neural network and an expert system.

59. The system of claim 57, wherein the selection module is to choose each successive automatically-selected quality setting based on a function of the distance between the target range and a calculated data rate for a previous automatically-selected quality setting.

60. The system of claim 55, wherein the selection module is to adjust the target range in response to one of constraints of a destination system for receiving the output signal and conditions of a transmission channel to the destination system.

61. A computer program product comprising:

a computer-readable medium having stored therein

program instructions for obtaining an input signal comprising a plurality of segments;

program instructions for automatically selecting different quality settings to respectively compress at least two of the segments, wherein the quality settings for each segment are automatically selected to maintain within a target range a data rate of an output signal to which the compressed segments are to be added;

program instructions for compressing the segments using the automatically selected quality settings; and

program instructions for adding the compressed segments to the output data signal.