Methods and systems for network based video clip processing and management

• US 9,871,842 B2
• Filed: 03/15/2013
• Issued: 01/16/2018
• Est. Priority Date: 12/08/2012
• Status: Active Grant

• Current Assignee: Evertz Microsystems Ltd. (Evertz Technologies Limited)
• Original Assignee: Evertz Microsystems Ltd. (Evertz Technologies Limited)
• Inventors: Silvestri, Vince
• Primary Examiner(s): Osman, Ramy M
• Application Number:
  US13/837,579
• Publication Number:
  US 20140164636A1
• Time in Patent Office: 1,768 Days
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 67/62 Establishing a time schedule for servicing the requests
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/85 Assembly of content; Generation of multimedia applications

Abstract

Methods and system for managing media clips over a data network. Media streams may be received over a data network and stored by a storage server. Metadata regarding the media streams may be generated and stored at a metadata server. A control station can retrieve media frames originating in the stored media streams from the storage server, based on metadata. Media frames from multiple media streams can be retrieved and displayed in synchronization, based on respective timecodes.

Claims

1. A method of managing media clips over a data network, the method comprising:

transmitting one or more metadata items to a metadata database, the one or more metadata items being related to a media clip record for a media clip;

querying the metadata database using the one or more metadata items to retrieve the media clip record, the media clip record identifying (i) one or more transformations and (ii) one or more media streams corresponding to the media clip, each media stream comprising a plurality of media frames and a plurality of timecode references corresponding to the plurality of media frames;

subsequently querying a storage server to retrieve one or more media frames corresponding to the one or more identified media streams by transmitting the corresponding timecode references, wherein the one or more media frames are retrievable based on the corresponding timecode references;

applying the at least one identified transformation to at least one retrieved media frame to generate at least one transformed media frame; and

generating an output media clip based on the one or more retrieved media frames including the at least one transformed media frame.

2. The method of claim 1, wherein the at least one transformation comprises cropping the at least one media frame.

3. The method of claim 1, wherein the at least one transformation comprises panning the at least one media frame.

4. The method of claim 1, further comprising arranging the one or more retrieved media frames including the at least one transformed media frame in a pre-determined sequence before generating the output media clip.

5. The method of claim 1, wherein the one or more retrieved media frames are received at a control station.

6. The method of claim 5, wherein subsequently querying the storage server to retrieve one or more media frames corresponding to the one or more media streams comprises retrieving media frames corresponding to at least two media streams, wherein the method further comprises displaying a first set of media frames corresponding to a first media stream and at least one additional set of media frames corresponding to at least one additional media stream.

7. The method of claim 6, wherein the first media stream is displayed in synchronization with the at least one additional media stream, based on respective timecode references of the media frames comprised within the first media stream and the at least one additional media stream.

8. The method of claim 6, wherein the first set of media frames corresponding to the first media stream is displayed in a first viewport, wherein the at least one additional set of media frames corresponding to the at least one additional media stream is also displayed in the first viewport, and wherein the at least one additional set of media frames is displayed while maintaining continuity with the first set of media frames based on respective timecode references of the media frames comprised within the first media stream and the at least one additional media stream.

9. The method of claim 6, wherein the first set of media frames corresponding to the first media stream is displayed in a first viewport and wherein the at least one additional set of media frames corresponding to the at least one additional media stream is displayed in a second viewport.

10. The method of claim 1, further comprising:

receiving a request for the media clip from a control station prior to querying the metadata database; and

transmitting the output media clip to an output node identified in the request.

11. A system for managing media clips, the system comprising:

a data network;

a metadata database containing a plurality of media clip records corresponding to a plurality of media clips;

a storage server containing a plurality of media streams and media frames; and

a control station comprising a processor coupled to a memory, the processor being configured to;

transmit one or more metadata items to a metadata database, the one or more metadata items being related to a media clip record for a corresponding media clip;

query the metadata database using the one or more metadata items to retrieve the media clip record, the media clip record identifying (i) one or more transformations and (ii) one or more media streams corresponding to the media clip, each media stream comprising a plurality of media frames and a plurality of timecode references corresponding to the plurality of media frames;

subsequently query the storage server to retrieve one or more media frames corresponding to the one or more identified media streams by transmitting the corresponding timecode references, wherein the one or more media frames are retrievable based on the corresponding timecode references;

apply the at least one identified transformation to at least one retrieved media frame to generate at least one transformed media frame; and

generate an output media clip based on the one or more media frames including the at least one transformed media frame.

12. The system of claim 11, wherein the at least one transformation comprises cropping the at least one media frame.

13. The system of claim 11, wherein the at least one transformation comprises panning the at least one media frame.

14. The system of claim 11, wherein the processor is further configured to arrange the one or more retrieved media frames including the at least one transformed media frame in a pre-determined sequence before generating the output media clip.

15. The system of claim 11, wherein the one or more retrieved media frames are received at a control station.

16. The system of claim 15, wherein the processor is configured to query the storage server to retrieve media frames corresponding to at least two media streams, and wherein the processor is further configured to display a first set of media frames corresponding to a first media stream and at least one additional set of media frames corresponding to at least one additional media stream.

17. The system of claim 16, wherein the processor is configured to display the first media stream in synchronization with the at least one additional media stream, based on respective timecode references of the media frames comprised within the first media stream and the at least one additional media stream.

18. The system of claim 16, wherein the processor is configured to display the first set of media frames corresponding to the first media stream in a first viewport, wherein the processor is configured to display the at least one additional set of media frames corresponding to the at least one additional media stream also in the first viewport, and wherein the processor is configured to display the at least one additional set of media frames while maintaining continuity with the first set of media frames based on respective timecode references of the media frames comprised within the first media stream and the at least one additional media stream.

19. The system of claim 16, wherein the processor is configured to display the first set of media frames corresponding to the first media stream in a first viewport and wherein the processor is configured to display the at least one additional set of media frames corresponding to the at least one additional media stream in a second viewport.

20. The system of claim 11, wherein the request comprises an identifier for an output node for displaying the output media clip, and wherein the processor is configured to transmit the output media clip to the output node identified in the request.

21. A method of generating an output media clip over a data network, the method comprising:

retrieving a media clip record corresponding to a media clip from a metadata server based on one or more metadata items, wherein the one or more metadata items relate to the media clip record, the media clip record identifying a first media stream stored on a storage server, a first start-time marker associated with the first media stream, a first stop-time marker associated with the first media stream, and a transformation;

retrieving a portion of the first media stream from the storage server, the portion being defined by the first start-time marker and the first stop-time marker;

applying the transformation identified in the media clip record to the retrieved portion of the first media stream; and

generating the output media clip at an output node comprising the transformed portion of the first media stream.

22. The method of claim 21, wherein:

the media clip record further identifies a second media stream stored in the storage server, a second start-time marker associated with the second media stream, and a second stop-time marker associated with the second media stream, and the method further comprises;

retrieving a portion of the second media stream from the storage server, the portion being defined by the second start-time marker and the second stop-time marker; and

concatenating the retrieved portion of the first media stream and the retrieved portion of the second media stream.