Methods and systems for network based video clip generation and management

• US 10,078,695 B2
• Filed: 04/11/2012
• Issued: 09/18/2018
• Est. Priority Date: 04/11/2011
• Status: Active Grant

• Current Assignee: Evertz Microsystems Ltd. (Evertz Technologies Limited)
• Original Assignee: Evertz Microsystems Ltd. (Evertz Technologies Limited)
• Inventors: Silvestri, Vincent, Patel, Rakesh
• Primary Examiner(s): Bates, Kevin T
• Assistant Examiner(s): Huang, Chen-Liang
• Application Number:
  US13/444,630
• Publication Number:
  US 20120317302A1
• Time in Patent Office: 2,351 Days
• Field of Search: 709231
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04N 21/231 Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739

Abstract

Methods and system for managing media clips over a data network. Media streams may be received over a data network and stored by a storage server. Metadata regarding the media streams may be generated and stored at a metadata server. A control station can retrieve media frames originating in the stored media streams from the storage server, based on metadata. Media frames from multiple media streams can be retrieved and displayed in synchronization, based on respective timecodes.

Claims

1. A method of managing media clips over a data network, the method comprising:

receiving a plurality of original media streams corresponding to a single event from a plurality of media sources, wherein each original media stream comprises a plurality of media frames;

for each of the plurality of original media streams, determining a timecode for the corresponding original media stream, the timecode comprising a plurality of timecode references corresponding respectively to the plurality of media frames, wherein each timecode reference is a timing reference associated with a point in time on a timebase, and wherein all timecode references associated with the original media stream are referenced to the timebase;

determining whether timecode references for at least two original media streams received from at least two different media sources are referenced to a common timebase;

for each of the plurality of original media streams having timecode references referenced to the common timebase, storing the original media stream at a storage server;

if the timecode references for the at least two original media streams are not referenced to the common timebase, then for each original media stream that is not referenced to the common timebase;

generating new timecode references referenced to the common timebase,

generating a modified media stream corresponding to the original media stream and comprising the corresponding new timecode references; and

storing the modified media stream at a storage server;

for each stored media stream, generating at least one stored metadata record in a metadata database, each stored metadata record comprising a stored media stream identifier corresponding to the stored media stream, one or more metadata tags, wherein each stored media stream is referenced to the common timebase;

searching the metadata database, by submitting a first request comprising a queried metadata item, and receiving a first response comprising one or more queried metadata records wherein the one or more metadata tag in each queried metadata record matches the queried metadata item;

generating and transmitting, subsequently and automatically to the storage server, a second request for one or more retrieved media streams, each retrieved media stream identified by a corresponding stored media stream identifier, wherein the one or more retrieved media streams are referenced to a common timebase; and

receiving a second response to the second request, the second response comprising the one or more retrieved media streams.

2. The method of claim 1, wherein the two or more media frames share a common timecode reference.

3. The method of claim 1, wherein the metadata item is received from a control station.

4. The method of claim 1, wherein the plurality of media frames is associated with the respective media stream when it is stored.

5. The method of claim 1, further comprising generating a unique identifier for each media frame.

6. The method of claim 1, wherein the timecode is identified from the media stream.

7. The method of claim 1, wherein the plurality of media sources comprises at least one camera.

8. The method of claim 1, wherein the plurality of media sources comprises at least one media encoder.

9. The method of claim 1, wherein the plurality of media streams are live streams.

10. The method of claim 1, further comprising:

receiving a request for at least one media clip from a control station;

retrieving the at least one media clip in response to the request; and

transmitting the at least one media clip to an output node identified in the request.

11. The method of claim 10, wherein the at least one media clip comprises two or more selected media clips associated with two or more media streams.

12. The method of claim 11, wherein the timecodes of the selected media clips are referenced to the common timebase.

13. The method of claim 12, wherein respective media frames of the selected media clips share a common timecode reference.

14. The method of claim 10, wherein the output node is at the control station.

15. The method of claim 10, wherein the output node is at a second storage server.

16. The method of claim 15, wherein the second storage server is a remote storage server.

17. The method of claim 1, further comprising:

receiving a request for at least one proxy media dip from a control station;

retrieving at least one media clip that corresponds to the at least one proxy media clip in response to the request;

transcoding the at least one media clip to generate the at least one proxy media clip; and

transmitting the at least one proxy media clip to an output node identified in the request.

18. The method of claim 17, wherein the request identifies the at least one media clip.

19. The method of claim 17, wherein the request comprises one or more requested timecode references corresponding to the at least one media clip.

20. The method of claim 17, wherein the request comprises a requested media stream identifier corresponding to the media stream of the at least one media clip.

21. The method of claim 17, wherein the request is received via a control network.

22. The method of claim 17, wherein the control network is a part of the data network.

45. The method of claim 1, wherein the timecode references for each of the plurality of media streams received from the plurality of media source are determined relative to the common timebase.

23. A system for managing media clips, the system comprising:

a data network;

a plurality of media sources;

a metadata server; and

a storage server coupled to the metadata server via the data network, wherein the storage server is configured to;

receive a plurality of original media streams corresponding to a single event from the plurality of media sources, wherein each original media stream comprises a plurality of media frames; and

a controller configured to;

for each of the plurality of original media streams,

determine a timecode for the corresponding original media stream, the timecode comprising a plurality of timecode references corresponding respectively to the plurality of media frames,

wherein each timecode reference is a timing reference associated with a point in time on a timebase, and wherein all timecode references associated with the original media stream are referenced to the timebase;

determine whether timecode references for at least two media streams received from at least two different media sources are referenced to a common timebase;

for each of the original media streams having timecode references referenced to the common timebase, store the original media stream in the storage server; and

if the timecode references for the at least two original media streams are not referenced to the common timebase, then for each of the plurality of original media streams that is not referenced to the common timebase;

generate new timecode references referenced to the common timebase; and

generate a modified media stream corresponding to the original media stream and comprising the corresponding new timecode references; and

store the plurality of modified media streams in the storage server;

for each stored media stream, generating at least one stored metadata record in a metadata database, each stored metadata record comprising a stored media stream identifier corresponding to the stored media stream, one or more metadata tags, wherein each stored media stream is referenced to the common timebase;

searching the metadata database, by submitting a first request comprising a queried metadata item, and receiving a first response comprising one or more queried metadata records wherein the one or more metadata tag in each queried metadata record matches the queried metadata item;

generating and transmitting, subsequently and automatically to the storage server, a second request for one or more retrieved media streams, each retrieved media stream identified by a corresponding stored media stream identifier, wherein the one or more retrieved media streams are referenced to a common timebase; and

receiving a second response to the second request, the second response comprising the one or more retrieved media streams.

24. The system of claim 23, wherein the two or more media frames share a common timecode reference.

25. The system of claim 23, further comprising a control station, wherein the metadata item is received from the control station.

26. The system of claim 23 wherein the plurality of media frames is associated with the respective media stream when it is stored.

27. The system of claim 23, wherein the controller is further configured to generate a unique identifier for each media frame.

28. The system of claim 23, wherein the timecode is identified from the media stream.

29. The system of claim 23, wherein the plurality of media sources comprises at least one camera.

30. The system of claim 23, wherein the plurality of media sources comprises at least one media encoder.

31. The system of claim 23, wherein the plurality of media streams are live streams.

32. The system of claim 23, wherein the controller is further configured to:

receive a request for at least one media clip from a control station;

retrieve the at least one media clip in response to the request from the metadata server and the storage server; and

transmit the at least one media clip to an output node identified in the request.

33. The system of claim 32, wherein the at least one media clip comprises two or more selected media clips associated with two or more media streams.

34. The system of claim 33, wherein the timecodes of the selected media clips are referenced to the common timebase.

35. The system of claim 34, wherein respective media frames of the selected media clips share a common timecode reference.

36. The system of claim 32, wherein the output node is at the control station.

37. The system of claim 32, wherein the output node is at a second storage server.

38. The system of claim 37, wherein the second storage server is a remote storage server.

39. The system of claim 23, wherein the controller is further configured to:

receive a request for at least one proxy media clip from a control station;

retrieve at least one media clip that corresponds to the at least one proxy media clip in response to the request from the metadata server and the storage server;

transcode the at least one media clip to generate the at least one proxy media clip; and

transmit the at least one proxy media clip to an output node identified in the request.

40. The system of claim 39, wherein the request identifies the at least one media clip.

41. The system of claim 39, wherein the request comprises one or more requested timecode references corresponding to the at least one media clip.

42. The system of claim 39, wherein the request comprises a requested media stream identifier corresponding to the media stream of the at least one media clip.

43. The system of claim 39, further comprising a control network, wherein the request is received via the control network.

44. The system of claim 43, wherein the control network is a part of the data network.

46. The system of claim 23, wherein the timecode references for each of the plurality of media streams received from the plurality of media source are determined relative to the common timebase.