System and method for embedding scene change information in a video bitstream

• US 20060059510A1
• Filed: 09/13/2004
• Published: 03/16/2006
• Est. Priority Date: 09/13/2004
• Status: Abandoned Application

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Huang, Jau Hsiung, Huang, Ho Chao, Sheng, Dueg Uei
• Application Number:
  US10/939,564
• Publication Number:
  US 20060059510A1
• Time in Patent Office: Days
• US Class Current: 725/32
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

Systems and methods for embedding scene change information in a multimedia bitstream to form a hybrid multimedia bitstream having data representing scene change information as well data representing a multimedia signal. The embedded scene change information may be extracted from the multimedia bitstream by an executable module to assist in manipulating the multimedia bitstream in subsequent steps.

Claims

1. A method for processing a multimedia bitstream comprising:

providing a multimedia bitstream having multimedia content representing a multimedia signal;

analyzing the multimedia bitstream for characteristics of the multimedia signal useful for determining a scene change;

determining scene change information based on the characteristics of the multimedia signal useful for determining the scene change;

embedding the scene change information into the multimedia bitstream to produce a hybrid multimedia data stream;

extracting the scene change information from the multimedia bitstream; and

manipulating the multimedia bitstream based on the extracted scene change information.

2. The method of claim 1, further comprising:

embedding the characteristics of the multimedia signal useful for determining the scene change in the multimedia bitstream.

3. A method for processing a multimedia bitstream comprising:

providing a multimedia bitstream having multimedia content representing a multimedia signal; and

embedding scene change information within the multimedia bitstream, the scene change information indicating a scene change that logically defines portions of video corresponding to continuous video frames.

4. The method of claim 3, wherein the step of embedding scene change information includes at least one of the following:

embedding information representing a location in the multimedia signal where the scene change occurs;

embedding information into a portion of the multimedia bitstream, the information indicating that that the portion includes the scene change;

embedding a scene change type in the multimedia signal; and

embedding information representing a likelihood that a particular location in the multimedia signal corresponds to the scene change.

5. The method of claim 3, further including the steps of:

acquiring the scene change information; and

formatting the scene change information into at least one information data block;

wherein the step of embedding scene change information further includes embedding the at least one information data block into a plurality of multimedia data blocks to produce a hybrid multimedia data stream.

6. The method of claim 5, wherein the multimedia signal includes a video signal, and wherein the step of acquiring the scene change information includes determining scene change information based on the characteristics of the multimedia signal including at least one of the following steps:

determining an amount of motion in at least one segment of the video signal;

determining if the video signal is interlaced;

determining if the video signal has been altered;

determining if the video signal includes a video watermark;

determining the color saturation of the video signal;

determining the contrast level of video signal;

determining the brightness level of video signal;

determining positions of video in which faces or eyes are located;

determining frame complexity in the video;

detecting skin colors in the video;

detecting the level of sound associated with the video signal;

detecting animation in the video;

detecting discontinuity in the video;

detecting the differences between a first video frame and a second video frame; and

detecting frame orientation in the video.

7. The method of claim 3, wherein the step of embedding scene change information comprises multiplexing the scene change information with the content representing the multimedia signal.

8. The method of claim 3, further including:

extracting the scene change information from the multimedia bitstream; and

manipulating the multimedia bitstream based on the extracted scene change information.

9. The method of claim 8, wherein the step of manipulating the multimedia bitstream includes partitioning the multimedia bitstream into segments based on the scene change information.

10. The method of claim 3, wherein the step of embedding scene change information within the multimedia bitstream includes any one of the following:

multiplexing bits representing the scene change information with the content representing the multimedia signal;

embedding bits representing scene change information into the multimedia bitstream;

or

embedding a pattern of bits representing scene change information into the multimedia bitstream without altering the perceivable multimedia content.

11. The method of claim 3, further including:

extracting information determined from a prior analysis of the multimedia bitstream from the multimedia bitstream; and

analyzing the extracted information to determine the scene change information.

12. The method of claim 3, further including:

detecting if the multimedia bitstream contains embedded scene change information.

13. The method of claim 12, further including:

identifying the scene change information in the multimedia bitstream; and

determining if additional scene change information is necessary to manipulate the multimedia bitstream, and wherein upon detecting additional scene change information is necessary to manipulate the multimedia bitstream, acquiring the additional scene change information.

14. The method of claim 13, wherein upon acquiring the additional scene change information, embedding the additional scene change information into the multimedia bitstream.

15. The method of claim 12, further including:

identifying the embedded scene change information in the multimedia bitstream; and

determining if additional scene change information is necessary to manipulate the multimedia bitstream;

wherein upon detecting that additional scene change information is not necessary to manipulate the multimedia bitstream, extracting the embedded scene change information.

16. The method of claim 15, further including:

manipulating the multimedia content using the extracted scene change information.

17. The method of claim 12, and wherein upon detecting that scene change information is not embedded within the multimedia bitstream, acquiring the scene change information;

wherein the step of embedding the scene change information includes embedding the scene change information determined from acquiring the multimedia bitstream.

18. The method of claim 12, wherein upon detecting that the multimedia bitstream contains embedded scene change information, extracting the scene change information from the multimedia bitstream.

19. A computer readable medium having a computer program for processing a multimedia bitstream comprising:

a first code segment for providing a multimedia bitstream having multimedia content representing a multimedia signal; and

a second code segment for embedding scene change information within the multimedia bitstream, the scene change information indicating a scene change that logically defines portions of video corresponding to continuous video frames.

20. The computer readable medium of claim 19, further including:

a third code segment for acquiring the scene change information; and

a fourth code segment for formatting the scene change information into at least one information data block;

wherein the second code segment for embedding scene change information further includes embedding the at least one information data block into a plurality of multimedia data blocks to produce a hybrid multimedia data stream.

21. The computer readable medium of claim 19, further including:

a third code segment for extracting the scene change information from the multimedia bitstream; and

a fourth code segment for manipulating the multimedia bitstream based on the extracted scene change information.

22. The computer readable medium of claim 19, further including:

a third code segment for detecting if the multimedia bitstream contains embedded scene change information.

23. The computer readable medium of claim 22, further including

a fourth code segment for extracting the scene change information from the multimedia bitstream upon the third code segment detecting that the multimedia bitstream contains embedded scene change information.

24. A system for processing a multimedia bitstream comprising:

an executable module for embedding scene change information within a multimedia bitstream, the multimedia bitstream including content representing a multimedia signal, the scene change information indicating a scene change that logically defines portions of video corresponding to continuous video frames.

25. The system of claim 24, wherein the system further includes:

an analyzing module for determining the scene change information.

26. The system of claim 24, wherein the system further includes:

an executable module for extracting the scene change information from the multimedia bitstream; and

an executable module configured to use the extracted multimedia scene change information to manipulate the multimedia bitstream.

27. The system of claim 26, further including:

a demultiplexer for separating a data stream having the scene change information from a hybrid multimedia bitstream.

28. The system of claim 26, further including:

a multiplexer for combining a data stream having the scene change information with the multimedia bitstream to form a hybrid multimedia bitstream.

29. A system for processing a multimedia bitstream comprising:

an executable module configured to detect scene change information embedded in a multimedia bitstream; and

an executable module configured to extract the scene change information from the multimedia bitstream.

30. The system of claim 29, further including:

an executable module configured to acquire additional scene change information.

31. The system of claim 30, further including:

an executable module configured to embed the extracted scene change information and the additional scene change information within the multimedia bitstream.

32. The system of claim 29, further including:

a multimedia editing module configured to manipulate multimedia content within the multimedia bitstream using the scene change information.

33. The system of claim 29, further including:

an executable module configured to detect information embedded in the multimedia bitstream that is useful for determining a scene change; and

an executable module configured to extract the information embedded in the multimedia bitstream that is useful for determining the scene change.

34. A system for processing a multimedia bitstream comprising:

an executable module for extracting information determined from a prior analysis of the multimedia bitstream from the multimedia bitstream;

an executable module for determining scene change information by using the extracted information from the prior analysis; and

an executable module for embedding the scene change information in the multimedia bitstream.