System and method for compressing portions of a media signal using different codecs

• US 20040086039A1
• Filed: 10/23/2003
• Published: 05/06/2004
• Est. Priority Date: 09/26/2001
• Status: Active Grant

• Current Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Original Assignee: Interact Devices (Mad Catz Interactive Incorporated)
• Inventors: Ingraham, Robert W., Wilkinson, John E., Reznick, Lawrence S., Prock, Jack A., Reynolds, Jodie L., Mabey, Danny L.
• Granted Patent: US 7,599,434 B2
• Time in Patent Office: Days
• US Class Current: 375/240.01
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25825 : involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25858 : involving client software characteristics, e.g. OS identifier
• CPC Class Codes: H04N 21/44209 : Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4621 : Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6379 : directed to encoder , e.g. for requesting a lower encoding rate

Abstract

An input module obtains a media signal to be communicated to a destination system, after which an identification module identifies a plurality of scenes within the media signal. A selection module automatically selects different codecs from a codec library to respectively compress at least two of the scenes. The codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate. A compression module then compresses the scenes using the automatically selected codecs, after which an output module delivers the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

Claims

1. A media compression method comprising:

obtaining a media signal to be communicated to a destination system;

identifying a plurality of scenes within the media signal;

automatically selecting different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

compressing the scenes using the automatically selected codecs; and

delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

2. The method of claim 1, wherein the codecs are selected from the group consisting of discrete cosine transform (DCT) codecs, fractal codecs, and wavelet codecs.

3. The method of claim 1, wherein a first automatically selected codec comprises a discrete cosine transform (DCT) codec and a second automatically selected codec comprises a fractal codec.

4. The method of claim 1, wherein a first automatically selected codec comprises a discrete cosine transform (DCT) codec and a second automatically selected codec comprises a wavelet codec.

5. The method of claim 1, wherein automatically selecting further comprises:

identifying a plurality of characteristics of a scene; and

searching for a codec in the library that is associated with the identified characteristics of the scene.

6. The method of claim 5, wherein the characteristics are selected from the group consisting of motion characteristics and color characteristics.

7. The method of claim 6, wherein searching further comprises using an Artificial Intelligence (AI) system to locate a codec associated with the identified characteristics of a scene.

8. The method of claim 7, wherein the AI system comprises a neural network.

9. The method of claim 7, wherein the AI system comprises an expert system.

10. The method of claim 1, wherein automatically selecting further comprises:

testing at least a subset of the codecs of the codec library on a scene; and

automatically selected the codec that produces a highest compression quality for the scene according to a set of criteria without exceeding the target data rate.

11. The method of claim 10, wherein testing further comprises:

storing a baseline snapshot of the scene; and

for each codec to be tested;

compressing the scene at or below the target data rate using one of the codecs in the library;

decompressing the scene using the same codec; and

comparing the quality of the decompressed scene with the baseline snapshot according to the set of criteria.

12. The method of claim 11, wherein comparing further comprises comparing the quality according to a Peak Signal to Noise Ratio (PSNR).

13. The method of claim 11, wherein comparing further comprises comparing the quality according to a Just Noticeable Difference (JND) value.

14. The method of claim 11, further comprising:

identifying a plurality of characteristics of a scene; and

associating the identified characteristics of the scene with the automatically selected codec.

15. The method of claim 1, further comprising adjusting the target data rate in response to constraints of the destination system.

16. The method of claim 1, further comprising adjusting the target data rate in response to conditions of a transmission channel to the destination system.

17. The method of claim 1, further comprising adjusting the target data rate in response to a message from the destination system.

18. The method of claim 5, wherein searching further comprises searching for an association between the identified characteristics and a set of parameters to be used with the automatically selected codec;

wherein compressing further comprises compressing the scene using the automatically selected codec with the associated set of parameters; and

wherein delivering further comprises delivering the compressed scene to the destination system with an indication of which codec and which set of parameters were used to compress the scene.

19. The method of claim 10, wherein testing further comprises testing codecs of the codec library on the scene using different sets of parameters and automatically selecting the codec and set of parameters that produce a highest compression quality for the scene according to a set of criteria without exceeding the target data rate;

wherein compressing further comprises compressing the scene using the automatically selected codec with the automatically selected parameters; and

wherein delivering further comprises delivering the compressed scene to the destination system with an indication of which codec and set of parameters were used to compress the scene.

20. The method of claim 19, further comprising:

identifying a plurality of characteristics of a scene; and

associating the automatically selected codec and the automatically selected set of parameters with the identified characteristics of the scene.

21. The method of claim 1, wherein identifying further comprises detecting a scene change in response to one frame of the media signal being sufficiently different from a previous frame.

22. The method of claim 1, wherein identifying further comprises detecting a scene change in response to the passage of a fixed period of time.

23. The method of claim 1, wherein delivering further comprises streaming each compressed scene to the destination system through a network.

24. The method of claim 1, wherein delivering further comprises storing each compressed scene on a storage medium.

25. The method of claim 1, wherein at least one codec in the library has an associated licensing cost, and wherein selecting further comprises automatically selecting the codec having the least licensing cost in response to two or more codecs producing substantially the same quality of compressed output for a scene.

26. A media compression method comprising:

obtaining a media signal to be communicated to a destination system;

automatically selecting different codecs from a codec library to compress at least two of the segments of the media signal, wherein the codecs are automatically selected to produce a highest compression quality for the respective segments without exceeding a target data rate;

compressing the segments using the automatically selected codecs; and

delivering the compressed segments to the destination system with an indication of which codec was used to compress each segment.

27. A media compression method comprising:

providing a library of codecs, at least one codec having an associated licensing cost;

obtaining a media signal to be communicated to a destination system;

identifying a plurality of scenes within the media signal;

automatically selecting different codecs from the codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality at the lowest licensing cost for the respective scenes according to a set of criteria without exceeding a target data rate;

compressing the scenes using the automatically selected codecs; and

delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

28. A method for communicating a media signal comprising:

selectively compressing at least two scenes of a media signal using different codecs from a codec library, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate; and

delivering each compressed scene to a destination system with an indication of which codec was used to compress each scene.

29. A media decompression method comprising:

receiving a media signal comprising a first scene compressed using a first codec and a second scene compressed using a second codec, wherein the first and second codecs are automatically selected from a codec library based on which codec produces a highest compression quality for each scene according to a set of criteria without exceeding a target data rate decompressing the first scene using the first indicated codec; and

decompressing the second scene using the second indicated codec.

30. The method of claim 29, further comprising presenting the first and second decompressed scenes to a user.

31. A media compression system comprising:

an input module to obtain a media signal to be communicated to a destination system;

an identification module to identify a plurality of scenes within the media signal;

a selection module to automatically select different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

a compression module to compress the scenes using the automatically selected codecs; and

an output module to deliver the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

32. The system of claim 31, wherein the codecs are automatically selected from the group consisting of discrete cosine transform (DCT) codecs, fractal codecs, and wavelet codecs.

33. The system of claim 31, wherein a first automatically selected codec comprises a block codec and a second automatically selected codec comprises a fractal codec.

34. The system of claim 31, wherein a first automatically selected codec comprises a block codec and a second automatically selected codec comprises a wavelet codec.

35. The system of claim 31, wherein the identification module is to identify a plurality of characteristics of a scene;

and

wherein the selection module is to search for a codec in the library that is associated with the identified characteristics of the scene.

36. The system of claim 35, wherein the characteristics are selected from the group consisting of motion characteristics and color characteristics.

37. The system of claim 36, wherein the selection module comprises an Artificial Intelligence (AI) system to locate a codec associated with the identified characteristics of a scene.

38. The system of claim 37, wherein the AI system comprises a neural network.

39. The system of claim 37, wherein the AI system comprises an expert system.

40. The system of claim 31, wherein the selection module is to test at least a subset of the codecs of the codec library on a scene and automatically select the codec that produces a highest compression quality for the scene according to a set of criteria without exceeding the target data rate.

41. The system of claim 40, wherein the selection module is to store a baseline snapshot of the scene and, for each codec to be tested, have the scene compressed at or below the target data rate using one of the codecs in the library, have the scene decompressed using the same codec, and compare the quality of the decompressed scene with the baseline snapshot according to the set of criteria.

42. The system of claim 41, wherein the selection module is to compare the quality according to a Peak Signal to Noise Ratio (PSNR).

43. The system of claim 41, wherein the selection module is to compare the quality according to a Just Noticeable Difference (JND) value.

44. The system of claim 41, wherein the identification module is to identify a plurality of characteristics of a scene;

and

wherein the selection module is to associate the identified characteristics of the scene with the automatically selected codec.

45. The system of claim 31, wherein the selection module is to adjust the target data rate in response to constraints of the destination system.

46. The system of claim 31, wherein the selection module is to adjust the target data rate in response to conditions of a transmission channel to the destination system.

47. The system of claim 31, wherein the selection module is to adjust the target data rate in response to a message from the destination system.

48. The system of claim 35, wherein the selection module is to search for an association between the identified characteristics and a set of parameters to be used with the automatically selected codec;

wherein the compression module is to compress the scene using the automatically selected codec with the associated set of parameters; and

wherein the output module is to deliver the compressed scene to the destination system with an indication of which codec and which set of parameters were used to compress the scene.

49. The system of claim 40, wherein the selection module is to test the codecs of the codec library on the scene using different sets of parameters and automatically select the codec and set of parameters that produce a highest compression quality for the scene according to a set of criteria without exceeding the target data rate;

wherein the compression module is to compress the scene using the automatically selected codec with the automatically selected parameters; and

wherein the output module is to deliver the compressed scene to the destination system with an indication of which codec and set of parameters were used to compress the scene.

50. The system of claim 49, wherein the identification module is to identify a plurality of characteristics of a scene;

and

wherein the selection module is to associate the automatically selected codec and the automatically selected set of parameters with the identified characteristics of the scene.

51. The system of claim 31, wherein the identification module is to detect a scene change in response to one frame of the media signal being sufficiently different from a previous frame.

52. The system of claim 31, wherein the identification module is to detect a scene change in response to the passage of a fixed period of time.

53. The system of claim 31, wherein the output module is to stream each compressed scene to the destination system through a network.

54. The system of claim 31, wherein the output module is to store each compressed scene on a storage medium.

55. The system of claim 31, wherein at least one codec in the library has an associated licensing cost, and wherein the selection module is to automatically select the codec having the least licensing cost in response to two or more codecs producing substantially the same quality of compressed output for a scene.

56. A media compression system comprising:

an input module to obtain a media signal to be communicated to a destination system;

a selection module to automatically select different codecs from a codec library to respectively compress at least two of the segments of the media signal, wherein the codecs are automatically selected to produce a highest compression quality for the respective segments without exceeding a target data rate;

a compression module to compress the segments using the automatically selected codecs; and

an output module to deliver the compressed segments to the destination system with an indication of which codec was used to compress each segment.

57. A media compression system comprising:

a library of codecs, at least one codec having an associated licensing cost;

an input module to obtain a media signal to be communicated to a destination system;

an identification module to identify a plurality of scenes within the media signal;

a selection module to automatically select different codecs from the codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality at the lowest licensing cost for the respective scenes according to a set of criteria without exceeding a target data rate;

a compression module to compress the scenes using the automatically selected codecs; and

an output module to deliver the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

58. A system for communicating a media signal comprising:

a compression module to selectively compress at least two scenes of a media signal using different codecs from a codec library, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate; and

an output module to deliver each compressed scene to a destination system with an indication of which codec was used to compress each scene.

59. A media decompression system comprising:

an input module to receive a media signal comprising a first scene compressed using a first codec and a second scene compressed using a second codec, wherein the first and second codecs are automatically selected from a codec library based on which codec produces a highest compression quality for each scene according to a set of criteria without exceeding a target data rate; and

a decompression module to decompress the first scene using the first indicated codec and to decompress the second scene using the second indicated codec.

60. The system of claim 59, further comprising a presentation module to present the first and second decompressed scenes to a user.

61. A computer program product on a computer-readable medium, comprising:

program code for obtaining a media signal to be communicated to a destination system;

program code for identifying a plurality of scenes within the media signal;

program code for automatically selecting different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

program code for compressing the scenes using the automatically selected codecs; and

program code for delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

62. A media compression apparatus comprising:

means for obtaining a media signal to be communicated to a destination system;

means for identifying a plurality of scenes within the media signal;

means for automatically selecting different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

means for compressing the scenes using the automatically selected codecs; and

means for delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

63. A computer data signal embodied in a transmission medium, comprising:

a code segment including instructions for obtaining a media signal to be communicated to a destination system;

a code segment including instructions for identifying a plurality of scenes within the media signal;

a code segment including instructions for automatically selecting different codecs from a codec library to compress at least two of the scenes, wherein the automatically selected codecs are to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

a code segment including instructions for compressing the scenes using the automatically selected codecs; and

a code segment including instructions for delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene.

64. A media compression method comprising:

obtaining a media signal to be communicated to a destination system;

identifying a plurality of scenes within the media signal;

automatically selecting different codecs from a codec library to respectively compress at least two of the scenes, wherein the codecs are automatically selected to produce a highest compression quality for the respective scenes according to a set of criteria without exceeding a target data rate;

compressing the scenes using the automatically selected codecs;

delivering the compressed scenes to the destination system with an indication of which codec was used to compress each scene;

receiving each compressed scene and indication of a codec at the destination system;

decompressing each compressed scene using the indicated codec; and

presenting the decompressed scenes to a user of the destination system.