System and method for embedding multimedia processing information in a multimedia bitstream

• US 20050281289A1
• Filed: 06/21/2004
• Published: 12/22/2005
• Est. Priority Date: 06/21/2004
• Status: Abandoned Application

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Lee, Yu Chung, Huang, Jau Hsiung, Huang, Ho Chao
• Application Number:
  US10/873,097
• Publication Number:
  US 20050281289A1
• Time in Patent Office: Days
• US Class Current: 370/484
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Abstract

Systems and methods for embedding multimedia processing information in a multimedia bitstream to form a hybrid multimedia bitstream having data representing multimedia processing information as well data representing a multimedia signal. The embedded multimedia processing information may be extracted from the multimedia bitstream by an executable module to assist in processing the multimedia bitstream in subsequent steps.

Claims

1. A method for digital multimedia processing comprising:

providing a multimedia bitstream having multimedia content representing a multimedia signal;

determining at least one property of the multimedia signal useful for processing the multimedia content;

formatting the at least one property into at least one information data block;

embedding the at least one information data block into a plurality of multimedia data blocks to produce a hybrid multimedia data stream;

extracting the multimedia processing information from the multimedia bitstream; and

processing the multimedia bitstream based on the extracted multimedia processing information.

2. A method for digital multimedia processing comprising:

providing a multimedia bitstream having multimedia content representing a multimedia signal; and

embedding multimedia processing information useful for processing the multimedia content within the multimedia bitstream.

3. The method of claim 2, further including the steps of:

determining at least one property of the multimedia signal useful for processing the multimedia content; and

formatting the at least one property into at least one information data block;

wherein the step of embedding multimedia processing information further includes embedding the at least one information data block into a plurality of multimedia data blocks to produce a hybrid multimedia data stream.

4. The method of claim 3, wherein the multimedia signal includes a video signal, and wherein the step of determining at least one property of the multimedia signal useful for processing the multimedia content comprises at least one of the following:

determining an amount of motion in at least one segment of the video signal;

determining a probability of a scene change in at least one segment of the video signal, and determining a corresponding location of the scene change in the multimedia bitstream;

determining if the video signal is interlaced;

determining if the video signal has been altered;

determining if the video signal includes a video watermark;

determining if the video signal has been enhanced;

determining if the video signal has been blurred;

determining the color saturation of the video signal;

determining the contrast level of video signal;

determining the brightness level of video signal;

determining positions of video in which faces or eyes are located;

determining the level of blockiness in the video;

determining frame complexity in the video;

detecting skin colors in the video;

detecting animation in the video; and

detecting frame orientation in the video.

5. The method of claim 2, wherein the step of embedding multimedia processing information comprises multiplexing a bitstream representing the multimedia signal with the multimedia processing information useful for processing the multimedia content.

6. The method of claim 2, further including:

extracting the multimedia processing information from the multimedia bitstream; and

processing the multimedia bitstream based on the extracted multimedia processing information.

7. The method of claim 2, wherein the step of embedding multimedia processing information useful for processing the multimedia content within the multimedia bitstream includes any one of the following:

embedding bits representing multimedia processing information directly into the multimedia bitstream;

or

embedding a pattern of bits representing multimedia processing information into the multimedia bitstream without altering the perceivable multimedia content.

8. The method of claim 2, wherein the step of embedding multimedia processing information useful for processing the multimedia content within the multimedia bitstream includes any one of the following:

embedding the multimedia processing information at the end of the multimedia bitstream;

embedding the multimedia processing information at the beginning of the multimedia bitstream;

or

embedding the multimedia processing information between two data blocks in the multimedia bitstream.

9. The method of claim 2, wherein the multimedia bitstream is any one of:

an MPEG-1 file, an MPEG-2 file, an MPEG-4 file, an H.264 file, a 3GPP bitstream, a 3GPP-2 bitstream, an SD-Video bitstream, an HD-Video bitstream, a DVD multimedia bitstream, a VCD multimedia bitstream, an HD-DVD multimedia bitstream, a DTV/HDTV multimedia bitstream, a WAV bitstream, a DV bitstream, a QuickTime bitstream, a CDA bitstream, an MP3 bitstream, an MP2 bitstream, a WMA bitstream, a WMV bitstream, an ASF bitstream, or an AVI file.

10. The method of claim 2, further including:

detecting if the multimedia bitstream contains embedded multimedia processing information.

11. The method of claim 10, further including:

identifying the embedded multimedia processing information in the multimedia bitstream; and

determining if additional multimedia processing information is necessary to process the multimedia bitstream, and wherein upon detecting additional multimedia processing information is necessary to process the multimedia bitstream, analyzing the multimedia bitstream to determine the additional multimedia processing information.

12. The method of claim 11, wherein upon determining the additional multimedia processing information, embedding the additional multimedia processing information into the multimedia bitstream.

13. The method of claim 10, further including:

identifying the embedded multimedia processing information in the multimedia bitstream; and

determining if additional multimedia processing information is necessary to process the multimedia bitstream;

wherein upon detecting that additional multimedia processing information is not necessary to process the multimedia bitstream, extracting the embedded multimedia processing information.

14. The method of claim 13, further including:

processing the multimedia content using the extracted multimedia processing information.

15. The method of claim 10, and wherein upon detecting that multimedia processing information is not embedded within the multimedia bitstream, analyzing the multimedia bitstream to determine multimedia processing information useful for processing the multimedia content;

wherein the step of embedding the multimedia processing information includes embedding the multimedia processing information determined from analyzing the multimedia bitstream.

16. The method of claim 10, wherein upon detecting that the multimedia bitstream contains embedded multimedia processing information, extracting the multimedia processing information from the multimedia bitstream.

17. A computer readable medium having a computer program for digital multimedia processing comprising:

a first code segment for providing a multimedia bitstream having multimedia content representing a multimedia signal; and

a second code segment for embedding multimedia processing information useful for processing the multimedia content within the multimedia bitstream.

18. The computer readable medium of claim 17, further including:

a third code segment for determining at least one property of at least one of the multimedia signal useful for processing the multimedia content; and

a fourth code segment for formatting the at least one property into at least one information data block;

wherein the second code segment for embedding multimedia processing information further includes embedding the at least one information data block into a plurality of multimedia data blocks to produce a hybrid multimedia bitstream.

19. The computer readable medium of claim 17, further including:

a third code segment for extracting the multimedia processing information from the multimedia bitstream; and

a fourth code segment for processing the multimedia bitstream based on the extracted multimedia processing information.

20. The computer readable medium of claim 17, further including:

a third code segment for detecting if the multimedia bitstream contains embedded multimedia processing information.

21. The computer readable medium of claim 20, further including

a fourth code segment for extracting the multimedia processing information from the stream of multimedia data upon the third code segment detecting that the multimedia bitstream contains embedded multimedia processing information.

22. A system for processing digital multimedia comprising:

an executable module for embedding multimedia processing information within a multimedia bitstream, wherein the multimedia processing information is useful for processing multimedia content.

23. The system of claim 22, wherein the system further includes:

an analyzing module for determining the multimedia processing information useful for processing the multimedia content within the multimedia bitstream.

24. The system of claim 23, wherein the system further includes:

an executable module for extracting the multimedia processing information from the multimedia bitstream; and

a multimedia processing module configured to use the extracted multimedia processing information for processing the multimedia content.

25. The system of claim 24, further including:

a demultiplexer for separating a data stream having the multimedia processing information from a hybrid multimedia bitstream.

26. The system of claim 24, further including:

a multiplexer for combining a data stream having the multimedia processing information with the multimedia bitstream to form a hybrid multimedia bitstream.

27. A system for processing digital multimedia comprising:

an executable module for extracting multimedia processing information from a multimedia bitstream, wherein the extracted multimedia processing information is useful for processing multimedia content.

28. The system of claim 27, further including:

an analyzing module configured to analyze the multimedia bitstream for additional multimedia processing information.

29. The system of claim 28, further including:

an executable module configured to embed the extracted multimedia processing information and the additional multimedia processing information within the multimedia bitstream.

30. The system of claim 27, further including:

a multimedia processing module configured to process multimedia content within the multimedia bitstream using the extracted multimedia processing information.