Apparatus and method for embedding content information in a video bit stream

• US 20060078292A1
• Filed: 10/12/2004
• Published: 04/13/2006
• Est. Priority Date: 10/12/2004
• Status: Active Grant

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Huang, Jau Hsiung, Huang, Ho Chao, Tseng, Wen Chin
• Granted Patent: US 7,706,663 B2
• Time in Patent Office: Days
• US Class Current: 386/343
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

Systems and methods for deriving content information about a work of multimedia content and embedding the derived content information in a multimedia bitstream to form a hybrid multimedia bitstream are disclosed. The embedded derived content information may be extracted from the multimedia bitstream by an executable module to assist in compressing the performance duration of the multimedia bitstream.

Claims

1. A method of processing a given work of multimedia content, the method comprising the steps of:

analyzing at least a portion of the given work to derive content information therefrom, wherein the derived content information includes information for modifying the performance duration of the given work;

formatting the derived content information into a specific format;

embedding the formatted derived content information into a digital stream comprising the given work.

2. The method of claim 1, further including the step of:

using the derived content information to modify the performance duration of the given work.

3. The method of claim 1, further including the steps of:

receiving a desired performance parameter;

categorizing segments of the work based at least in part upon information in the derived content information;

using the desired performance parameter and the derived content information to play the given work in approximate accordance with the desired performance parameter.

4. The method of claim 3, wherein the desired performance parameter includes a desired performance duration, and wherein when the given work is played, the actual performance duration of the given work is approximately equal to the desired performance duration.

5. The method of claim 3, wherein the desired performance parameter includes a desired average playback rate ({overscore (ν

)}_D), and wherein when the given work is played, the actual average playback rate ({overscore (ν

)}_A) of the given work is approximately equal to the desired average playback rate ({overscore (ν

)}_D).

6. The method of claim 1, further including the step of:

reformatting the given work from a first format to a second format, wherein at least a portion of the derived content information is determined while reformatting the given work.

7. The method of claim 6, further including the step of:

storing the reformatted given work and the derived content information.

8. The method of claim 6, wherein prior to storing the given work, the derived content information is embedded within the reformatted given work.

9. A method of processing a given work of multimedia content, the method comprising the steps of:

receiving the given work, the given work having derived content information embedded therein, the derived content information includes information for modifying the performance duration of the given work;

receiving a desired performance parameter; and

using the derived content information and the desired performance parameter to play the given work in approximate accordance with the desired performance parameter.

10. The method of claim 9, wherein the desired performance parameter includes a desired performance duration, and wherein when the given work is played, the actual performance duration of the given work is approximately equal to the desired performance duration.

11. The method of claim 9, wherein the desired performance parameter includes a desired average playback rate, and wherein when the given work is played, the actual average playback rate of the given work is approximately equal to the desired average playback rate.

12. The method of claim 9, wherein the step of using the derived content information further includes the step of:

temporally compressing the performance duration of the given work by playing segments of the given work at variable playback rates.

13. The method of claim 12, further including the step of:

determining whether the derived content information is sufficient for temporally compressing the performance duration;

responsive to determining the derived content information is not sufficient, analyzing the content of the given work to determine additional derived content information, and wherein the additional derived content information is used in temporally compressing the given work.

14. The method of claim 13, further including the step of:

embedding the additional derived content information into the given work.

15. The method of claim 14, further including the step of:

storing the given work with the additional derived content information embedded therein.

16. The method of claim 12, wherein the step of temporally compressing the performance duration further includes the steps of:

categorizing segments of the given work based at least in part upon the derived content information;

heirarchizing the categorized segments from a first classification to a last classification;

associating a first playback rate (ν

₁) with the first classification of segments and a second playback rate (ν

₂) with the last classification of segments, wherein the second playback rate (ν

₂) is faster than the first playback rate (ν

₁).

17. The method of claim 16, further including the step of:

associating a third playback rate (ν

₃) with a third classification of segments, the third classification interposing the first and last hierarchized classifications and the third playback rate (ν

₃) being less than the second playback rate (ν

₂).

18. An apparatus for providing a work of multimedia content, the apparatus comprising:

a memory have a content derivation module stored therein;

a processor in communication with the memory, the processor implements the content derivation module to derive content information from the given work and to embed the derived content information into the work, wherein the derived content information includes information for modifying the performance duration of the given work.

19. The apparatus of claim 18, wherein the apparatus is a computer.

20. The apparatus of claim 18, wherein the memory further includes a converter module for reformatting the given work from a first format to a second format, wherein at least a portion of the derived content information is determined during reformatting the given work.

21. The apparatus of claim 18, wherein the memory further includes a temporal compression module that utilizes the derived content information to associate a first playback rate (ν

₁) with a first segment of the given work and a second playback rate (ν

₂) with a second segment of the given work.

22. The apparatus of claim 18, wherein the memory further includes a temporal compression module that utilizes the derived content information to categorize segments of the given work using derived content information, wherein the temporal compression module hierarchizes the categorized segments from a first classification to a last classification, and associates playback rates with the categorized segments based upon the classifications.

23. The apparatus of claim 18, wherein the given work of includes frames of video content, wherein the content derivation module analyzes the frames of video content to determine the amount of motion depicted within the frames, and wherein frame motion information is included in the derived content information.

24. The apparatus of claim 23, wherein frame motion information includes information associated with motion vectors for frames.

25. The apparatus of claim 18, wherein the given work of multimedia content includes audio content, wherein the content derivation module analyzes audio content, wherein the derived content information includes results of the audio analysis.

26. The apparatus of claim 25, wherein the derived content information includes an indicator that a segment of the work is a commercial based upon audio analysis.

27. An apparatus for providing a work of multimedia content, the apparatus comprising:

a memory have a content derivation module stored therein;

a processor in communication with the memory, the processor receives a given work having derived content information embedded therein and implements the content derivation module to modify the performance duration of the given work.

28. The apparatus of claim 27, wherein the apparatus is a computer.

29. The apparatus of claim 27, wherein the processor is adapted to receive a desired performance parameter, and the processor utilizes the desired performance parameter in conjunction with the derived content information to provide the given work in approximate accordance with the desired performance parameter.

30. The apparatus of claim 27, wherein the memory further includes a temporal compression module that associates a first playback rate (ν

₁) with a first segment of the given work and a second playback rate (ν

₂) with a second segment of the given work.

31. The apparatus of claim 27, wherein the memory further includes a temporal compression module that categorizes segments of the given work using derived content information, hierarchizes the categorized segments from a first classification to a last classification, and associates playback rates with the categorized segments based upon the classifications.

32. The apparatus of claim 27, wherein the given work of includes frames of video content, wherein the memory further includes a temporal compression module that compresses frames based upon the amount of motion depicted within the frames.

33. The apparatus of claim 32, wherein the temporal compression module utilizes the derived content information to determine the amount of motion depicted within a given frame based at least in part upon motion vectors associated with the frame.

34. The apparatus of claim 27, wherein the derived content information includes audio information about the given work, wherein the memory further includes a temporal compression module that utilizes the audio information included in the derived content information to temporally compress the performance duration of the given work.

35. The apparatus of claim 27, wherein the given work of multimedia content includes frames, wherein the memory further includes a temporal compression module that utilizes the desired performance parameter and the derived content information to determine which frames of the given work are to be provided upon playback and which frames are not to be provided, wherein temporal compression module utilizes the desired performance parameter and the derived content information to determine variable playback rates (ν

) for the frames that are to be provided upon playback, wherein upon playback the provided frames are played back in approximate accordance with the desired performance parameter.

36. The apparatus of claim 35, wherein the frames that are not provided include frames of commercials.

37. The apparatus of claim 35, wherein the frames that are not provided includes at least one frame selected from a set of frames consisting of frames of trailers, frames of titles, and frames of credits.

38. A program embodied in a computer readable medium, the program comprising:

logic configured to analyze at least a portion of a given work to derive content information therefrom, wherein the derived content information includes information for modifying the performance duration of the given work;

logic configured to format the derived content information into a specific format;

logic configured to embed the formatted derived content information into a digital stream comprising the given work.

39. The program of claim 38, further including:

logic configured to use the derived content information to modify the performance duration of the given work.

40. The program of claim 38, further including:

logic configured to receive a desired performance parameter;

logic configured to categorize segments of the work based at least in part upon information in the derived content information;

logic configured to use the desired performance parameter and the derived content information to play the given work in approximate accordance with the desired performance parameter.

41. The program of claim 40, wherein the desired performance parameter includes a desired performance duration, and wherein when the given work is played, the actual performance duration of the given work is approximately equal to the desired performance duration.

42. The program of claim 40, wherein the desired performance parameter includes a desired average playback rate ({overscore (ν

)}_D), and wherein when the given work is played, the actual average playback rate ({overscore (ν

)}_A) of the given work is approximately equal to the desired average playback rate ({overscore (ν

)}_D).

43. The program of claim 38, further including:

logic configured to reformat the given work from a first format to a second format, wherein at least a portion of the derived content information is determined while reformatting the given work.

44. The program of claim 43, further including:

logic configured to store the reformatted given work and the derived content information.

45. The method of claim 44, further including:

logic configured to embed the derived content information into the give work prior to storing the given work.

46. A program embodied in a computer readable medium, the program comprising:

logic configured to receive a given work having derived content information embedded therein, wherein the derived content information includes information for modifying the performance duration of the given work;

logic configured to receive a desired performance parameter; and

logic configured to use the derived content information and the desired performance parameter to play the given work in approximate accordance with the desired performance parameter.

47. The program of claim 46, wherein the desired performance parameter includes a desired performance duration, and wherein when the given work is played, the actual performance duration of the given work is approximately equal to the desired performance duration.

48. The program of claim 46, wherein the desired performance parameter includes a desired average playback rate, and wherein when the given work is played, the actual average playback rate of the given work is approximately equal to the desired average playback rate.

49. The program of claim 48, wherein the logic configured to use the derived content information further includes:

logic configured to temporally compress the performance duration of the given work by playing segments of the given work at variable playback rates.

50. The program of claim 49, further including:

logic configured to determine whether the derived content information is sufficient for temporally compressing the performance duration;

logic configured to analyze the content of the given work to determine additional derived content information, wherein the additional derived content information is used in temporally compressing the given work.

51. The program of claim 50, further including:

logic configured to embed the additional derived content information into the given work

52. program of claim 51, further including:

logic configured to store the given work with the additional derived content information embedded therein.

53. The program of claim 49, wherein the logic configured to temporally compress the performance duration further includes:

logic configured to categorize segments of the given work based at least in part upon the derived content information;

logic configured to heirarchize the categorized segments from a first classification to a last classification;

logic configured to associate a first playback rate (ν

₁) with the first classification of segments and a second playback rate (ν

₂) with the last classification of segments, wherein the second playback rate (ν

₂) is faster than the first playback rate (ν

₁).

54. The program of claim 53, further including:

logic configured to associate a third playback rate (ν

₃) with a third classification of segments, the third classification interposing the first and last hierarchized classifications and the third playback rate (ν

₃) being less than the second playback rate (ν

₂).