System and method for compressing portions of a media signal using different codecs

• US 8,064,515 B2
• Filed: 08/19/2009
• Issued: 11/22/2011
• Est. Priority Date: 09/26/2001
• Status: Expired due to Fees

• Current Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Original Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Inventors: Ingraham, Robert W., Wilkinson, John E., Reznick, Lawrence S., Prock, Jack A., Reynolds, Jodie L., Mabey, Danny L.
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US12/544,102
• Publication Number:
  US 20090310671A1
• Time in Patent Office: 825 Days
• Field of Search: 375/240, 375/240.01, 375/240.12
• US Class Current: 375/240.01
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25825 : involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25858 : involving client software characteristics, e.g. OS identifier
• CPC Class Codes: H04N 21/44209 : Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4621 : Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6379 : directed to encoder , e.g. for requesting a lower encoding rate

Abstract

An input module obtains a media signal to be communicated to a destination system, after which an identification module identifies a plurality of scenes within the media signal. A selection module automatically selects different codecs from a codec library to respectively compress at least two of the scenes. The codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate. A compression module then compresses the scenes using the automatically selected codecs, after which an output module delivers the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

Claims

1. A media compression method comprising:

obtaining a media signal to be communicated to a destination system;

identifying a plurality of scenes within the media signal;

automatically selecting different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

compressing the scenes using the automatically selected codecs; and

delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

2. The method of claim 1, wherein the codecs are selected from the group consisting of discrete cosine transform (DCT) codecs, fractal codecs, and wavelet codecs.

3. The method of claim 1, wherein automatically selecting further comprises:

identifying a plurality of characteristics of a scene; and

searching for a codec in the library that is associated with the identified characteristics of the scene.

4. The method of claim 3, wherein the characteristics are selected from the group consisting of motion characteristics and color characteristics.

5. The method of claim 4, wherein searching further comprises using an Artificial Intelligence (Al) system to locate a codec associated with the identified characteristics of a scene.

6. The method of claim 3, wherein searching further comprises searching for an association between the identified characteristics and a set of parameters to be used with the automatically selected codec;

wherein compressing further comprises compressing the scene using the automatically selected codec with the associated set of parameters; and

wherein delivering further comprises delivering the compressed scene to the destination system with an indication of which codec and which set of parameters were used to compress the scene.

7. The method of claim 1, wherein automatically selecting comprises:

testing at least a subset of the codecs of the codec library on a scene; and

automatically selected the codec that produces a highest compression quality for the scene according to a set of criteria without exceeding the target data rate.

8. The method of claim 7, wherein testing further comprises testing codecs of the codec library on the scene using different sets of parameters and automatically selecting the codec and set of parameters that produce a highest compression quality for the scene according to a set of criteria without exceeding the target data rate;

wherein compressing further comprises compressing the scene using the automatically selected codec with the automatically selected parameters; and

wherein delivering further comprises delivering the compressed scene to the destination system with an indication of which codec and set of parameters were used to compress the scene.

9. The method of claim 8, further comprising:

identifying a plurality of characteristics of a scene; and

associating the automatically selected codec and the automatically selected set of parameters with the identified characteristics of the scene.

10. The method of claim 1, wherein automatically testing further comprises:

storing a baseline snapshot of the scene; and

for each codec to be tested;

compressing the scene at or below the target data rate using one of the codecs in the library;

decompressing the scene using the same codec; and

comparing the quality of the decompressed scene with the baseline snapshot according to the set of criteria.

11. The method of claim 10, wherein comparing further comprises comparing the quality according to a Peak Signal to Noise Ratio (PSNR).

12. The method of claim 10, wherein comparing further comprises comparing the quality according to a Just Noticeable Difference (JND) value.

13. The method of claim 1, further comprising:

identifying a plurality of characteristics of a scene; and

associating the identified characteristics of the scene with the automatically selected codec.

14. The method of claim 1, further comprising adjusting the target data rate in response to constraints of the destination system.

15. The method of claim 1, further comprising adjusting the target data rate in response to conditions of a transmission channel to the destination system.

16. The method of claim 1, further comprising adjusting the target data rate in response to a message from the destination system.

17. The method of claim 1, wherein identifying further comprises detecting a scene change in response to one frame of the media signal being sufficiently different from a previous frame.

18. The method of claim 1, wherein delivering comprises one of streaming each compressed scene to the destination system through a network or storing each compressed scene on a storage medium.