System and method of processing MPEG streams for storyboard and rights metadata insertion

• US 20020033842A1
• Filed: 05/07/2001
• Published: 03/21/2002
• Est. Priority Date: 09/15/2000
• Status: Active Grant

• Current Assignee: Hulu LLC (The Walt Disney Company)
• Original Assignee: International Business Machines Corporation
• Inventors: Zetts, John Mark
• Granted Patent: US 6,760,042 B2
• Time in Patent Office: Days
• US Class Current: 345/719
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/23611 Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate synchronisation arrangements in time-division multiplex systems using bit stuffing for systems with different or fluctuating information rates H04J3/073
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/2541 Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/4346 involving stuffing data, e.g. packets or bytes synchronisation arrangements in time-division multiplex systems with different or fluctuating information rates H04J3/073
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/835 Generation of protective data, e.g. certificates protecting software against unauthorised usage in a vending or licensing environment G06F21/10
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A method, apparatus and article of manufacture is provided for storyboard thumbnail and video rights metadata insertion, for preventing unauthorized use of restricted video frames of a previously encoded MPEG video file. The method has a step for inserting video rights metadata in the timecode packet of the affected video frame of the MPEG video file; a step for inserting thumbnail status metadata in the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file, allowing automatic recreation of a storyboard file from the MPEG video file; a step for updating the video rights metadata in a video catalog record, and in the timecode packet of the affected video frame of the MPEG video file; and a step for updating the thumbnail status metadata in a video catalog record, and in the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file.

Claims

1. A method for storyboard thumbnail and video rights metadata insertion, for preventing unauthorized use of restricted video-frames of a previously encoded MPEG video file, wherein each video frame header of the MPEG video file including a compressed timecode packet having an identifying signature, an absolute and a relative SMPTE timecode of the frame, and a picture type and reference, the method comprising the following steps:

(a) if an incorporation of video rights metadata of an MPEG video file frame requested, inserting video rights metadata flags in predetermined fields of the timecode packet of the affected video frame of the MPEG video file;

(b) if an incorporation of thumbnail status metadata requested for a selected video storyboard thumbnail, inserting thumbnail status metadata flags in predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file, allowing automatic recreation of a storyboard file from the MPEG video file;

(c) if a modification of a selected video rights metadata requested, updating accordingly the video rights metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the video rights metadata flags in the predetermined fields of the timecode packet of the affected video frame of the MPEG video file; and

(d) if a modification of a selected video storyboard thumbnail status metadata requested, updating accordingly the thumbnail status metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the thumbnail status metadata flags in the predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file,

thereby preserving the MPEG compliance and compressed audio/video data of the MPEG video file, while maintaining the MPEG video file'"'"'s original frame presentation timing.

2. The method according to claim 1, wherein the steps (a) and (c) further comprising the following steps:

using a custom-built GUI for creating a video rights edit decision list (EDL) of restricted frames, useable during a video file editing session for preventing unauthorized use of restricted video frames; and

using the video rights EDL for inserting or updating the video rights metadata flags of the affected video frame of the MPEG video file.

3. The method according to claim 1, wherein the updating steps (c) and (d) further comprising the step of locating the timecode packet of the affected video frame of the MPEG video file randomly by binary search, using the video frame'"'"'s nearest GOP header byte offset obtained through a GOP offset table lookup.

4. The method according to claim 1, wherein the video rights metadata being selected from a group comprising full rights, limited rights, no rights, or expired rights.

5. The method according to claim 1, wherein the timecode packet being inserted in a user data packet of the video frame, between a picture start header and a first slice header.

6. A system for storyboard thumbnail and video rights metadata insertion, for preventing unauthorized use of restricted video frames of a previously encoded MPEG video file, wherein each video frame header of the MPEG video file including a compressed timecode packet having an identifying signature, an absolute and a relative SMPTE timecode of the frame, and a picture type and reference, comprising:

a computer coupled to an electronic storage device for storing the MPEG video file;

programming means, performed by the computer, for inserting video rights metadata flags in predetermined fields of the timecode packet of the affected video frame of the MPEG video file;

programming means, performed by the computer, for inserting thumbnail status metadata flags in predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file, allowing automatic recreation of a storyboard file from the MPEG video file;

programming means, performed by the computer, for updating accordingly the video rights metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the video rights metadata flags in the predetermined fields of the timecode packet of the affected video frame of the MPEG video file; and

programming means, performed by the computer, for updating accordingly the thumbnail status metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the thumbnail status metadata flags in the predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file,

thereby preserving the MPEG compliance and compressed audio/video data of the MPEG video file, while maintaining the MPEG video file'"'"'s original frame presentation timing.

7. The system according to claim 6, further comprising a custom-built GUI means, useable for creating a video rights edit decision list (EDL) of restricted frames, wherein the rights EDL means being useable during a video file editing session for preventing unauthorized use of restricted video frames, and for inserting or updating the video rights metadata flags of the affected video frame of the MPEG video file.

8. The system according to claim 6, further comprising means for locating the timecode packet of the affected video frame of the MPEG video file randomly by binary search, using the video frame'"'"'s nearest GOP header byte offset obtained through a GOP offset table lookup.

9. The system according to claim 6, wherein the video rights metadata being selected from a group comprising full rights, limited rights, no rights, or expired rights.

10. The system according to claim 6, wherein the timecode packet being located in a user data packet of the video frame, between a picture start header and a first slice header.

11. A program storage device readable by a computer tangibly embodying a program of instructions executable by the computer to perform method steps for storyboard thumbnail and video rights metadata insertion, for preventing unauthorized use of restricted video frames of a previously encoded MPEG video file, wherein each video frame header of the MPEG video file including a compressed timecode packet having an identifying signature, an absolute and a relative SMPTE timecode of the frame, and a picture type and reference, and the MPEG video file stored in an electronic storage device coupled to the computer, the method comprising the following steps:

(a) if an incorporation of video rights metadata of an MPEG video file frame requested, inserting video rights metadata flags in predetermined fields of the timecode packet of the affected video frame of the MPEG video file;

(b) if an incorporation of thumbnail status metadata requested for a selected video storyboard thumbnail, inserting thumbnail status metadata flags in predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file, allowing automatic recreation of a storyboard file from the MPEG video file;

(c) if a modification of a selected video rights metadata requested, updating accordingly the video rights metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the video rights metadata flags in the predetermined fields of the timecode packet of the affected video frame of the MPEG video file; and

(d) if a modification of a selected video storyboard thumbnail status metadata requested, updating accordingly the thumbnail status metadata in a video catalog record corresponding to the MPEG video file, and updating accordingly the thumbnail status metadata flags in the predetermined fields of the timecode packet of the selected video storyboard thumbnail frame of the MPEG video file,

thereby preserving the MPEG compliance and compressed audio/video data of the MPEG video file, while maintaining the MPEG video file'"'"'s original frame presentation timing.

12. The method according to claim 11, wherein the steps (a) and (c) further comprising the following steps:

using a custom-built GUI for creating a video rights edit decision list (EDL) of restricted frames, useable during a video file editing session for preventing unauthorized use of restricted video frames; and

using the video rights EDL for inserting or updating the video rights metadata flags of the affected video frame of the MPEG video file.

13. The method according to claim 11, wherein the updating steps (c) and (d) further comprising the step of locating the timecode packet of the affected video frame of the MPEG video file randomly by binary search, using the video frame'"'"'s nearest GOP header byte offset obtained through a GOP offset table lookup.

14. The method according to claim 11, wherein the video rights metadata being selected from a group comprising full rights, limited rights, no rights, or expired rights.

15. The method according to claim 11, wherein the timecode packet being inserted in a user data packet of the video frame, between a picture start header and a first slice header.