System and method for tying audio and video watermarks of live and recorded events for simulcasting alternative audio commentary to an audio channel or second screen

• US 9,426,336 B2
• Filed: 03/20/2014
• Issued: 08/23/2016
• Est. Priority Date: 10/02/2013
• Status: Active Grant

• Current Assignee: Fansmit, Inc.
• Original Assignee: Fansmit, LLC
• Inventors: Savare, Matthew Richard, Sherwin, Jeffrey
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): NEWLIN, TIMOTHY R
• Application Number:
  US14/220,586
• Publication Number:
  US 20150092106A1
• Time in Patent Office: 887 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 5/04 Synchronising for television systems using pulse code modulation H04N7/56

Abstract

An alternative content system receives a primary content data stream and a secondary content data stream associated with an event. The alternative content system provides an alternative content data stream associated with the event. The alternative content system extracts a primary content identifier from the primary content data stream. The alternative content system identifies an alternative content identifier based on the alternative content data stream. The alternative content system synchronizes the alternative content data stream to the primary content data stream based on the alternative content identifier and the primary content identifier. The alternative content system transmits the synchronized alternative content data stream based on the primary content identifier.

Claims

1. A method comprising:

receiving, by a processing device, a direct primary content data stream and a secondary content data stream, both the direct primary content data stream and the secondary content data stream associated with an event, the direct primary content data stream comprising a direct primary content identifier;

receiving, by the processing device from an alternative content system, an alternative content data stream corresponding to the event, the alternative content data stream comprising an alternative content identifier and an indirect primary content identifier, the indirect primary content identifier associated with an indirect primary content data stream associated with the event, the indirect primary content identifier and the indirect primary content data stream corresponding to the direct primary content identifier and the direct primary content data stream, respectively, as received by the alternative content system, wherein the alternative content data stream is synchronized to the indirect primary content data stream;

extracting the direct primary content identifier from the direct primary content data stream;

extracting the alternative content identifier and the indirect primary content identifier from the alternative content data stream;

synchronizing, by the processing device, the indirect primary content data stream with the alternative content data stream based on the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier, wherein the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier comprise digital watermarks or digital fingerprints;

replacing the secondary content data stream with the synchronized alternative content data stream; and

transmitting the synchronized direct primary content data stream and the synchronized alternative content data stream.

2. The method of claim 1, further comprising:

receiving a second alternative content data stream corresponding to the event;

identifying a second alternative content identifier based on the second alternative content data stream;

synchronizing, by the processing device, the second alternative content data stream to the primary content data stream based on the second alternative content identifier and the direct primary content identifier, respectively; and

transmitting the synchronized second alternative content data stream.

3. The method of claim 1, wherein the direct primary content identifier uniquely identifies a portion of the primary content data stream, the indirect primary content identifier uniquely identifies a portion of the indirect primary content data stream, and the alternative content identifier uniquely identifies a portion of the alternative content data stream.

4. The method of claim 1, wherein at least one of the direct primary content data stream, the indirect primary content data stream, or the alternative content data stream corresponds to one of a video data stream, an audio data stream, or a metadata stream corresponding to the video data stream or the audio data stream.

5. The method of claim 1, wherein the alternative content data stream is a second alternative audio commentary stream.

6. The method of claim 5, wherein the second alternative audio commentary stream is a color commentary data stream or a play-by-play commentary stream.

7. The method of claim 1, wherein the event is a live or recorded sporting event, live or recorded an entertainment event, or a live or recorded video game.

8. A computer system, comprising:

a memory;

a processing device, coupled to the memory, the processing device to;

receive a direct primary content data stream and a secondary content data stream, both the direct primary content data stream and the secondary content data stream associated with an event, the direct primary content data stream comprising a direct primary content identifier;

receive an alternative content data stream corresponding to the event, the alternative content data stream comprising an alternative content identifier and an indirect primary content identifier, the indirect primary content identifier associated with an indirect primary content data stream associated with the event, the indirect primary content identifier and the indirect primary content data stream corresponding to the direct primary content identifier and the direct primary content data stream, respectively, as received by the alternative content system, wherein the alternative content data stream is synchronized to the indirect primary content data stream;

extract the direct primary content identifier from the direct primary content data stream;

extract the alternative content identifier and the indirect primary content identifier from the alternative content data stream;

synchronize the indirect primary content data stream with the alternative content data stream based on the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier, wherein the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier comprise digital watermarks or digital fingerprints;

replace the secondary content data stream with the synchronized alternative content data stream; and

transmit the synchronized direct primary content data stream and the synchronized alternative content data stream.

9. The system of claim 8, further comprising:

receiving a second alternative content data stream corresponding to the event;

identifying a second alternative content identifier based on the second alternative content data stream;

synchronizing the second alternative content data stream to the primary content data stream based on the second alternative content identifier and the direct primary content identifier, respectively; and

transmitting the synchronized second alternative content data stream.