Time synchronizing of distinct video and data feeds that are delivered in a single mobile IP data network compatible stream

• US 9,571,902 B2
• Filed: 06/13/2013
• Issued: 02/14/2017
• Est. Priority Date: 12/13/2006
• Status: Active Grant

• Current Assignee: DIRECTV, LLC (AT&T, Inc.)
• Original Assignee: Quickplay Media Inc (AT&T, Inc.)
• Inventors: Walker, Torin, Martinez, Michael M.
• Primary Examiner(s): Sheleheda, James R
• Application Number:
  US13/917,078
• Publication Number:
  US 20140053214A1
• Time in Patent Office: 1,342 Days
• Field of Search: 725/90, 725/95
• US Class Current: 1/1
• CPC Class Codes: G06F 16/487 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 21/1011 to devices
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/0244 Optimization
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: H04H 20/26 Arrangements for switching distribution systems
• CPC Class Codes: H04H 60/91 Mobile communication networks for accessing the Internet H04H60/85
• CPC Class Codes: H04L 65/1059 End-user terminal functionalities specially adapted for real-time communication
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/30 : Profiles
• CPC Class Codes: H04N 21/2187 : Live feed
• CPC Class Codes: H04N 21/23424 : involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2343 : involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2365 : Multiplexing of several video streams
• CPC Class Codes: H04N 21/242 : Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/2665 : Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/6112 : involving terrestrial transmission, e.g. DVB-T
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6408 : Unicasting
• CPC Class Codes: H04N 21/64322 : IP
• CPC Class Codes: H04N 21/8547 : involving timestamps for synchronizing content

Abstract

Multiple video and/or content feeds are combined and synchronized in real-time into a single mobile IP data network compatible stream for presenting as a coherent display on a mobile device.

Claims

1. A method comprising:

accessing with a server a plurality of distinct video feeds;

accessing time stamp information for at least a portion of the plurality of distinct video feeds;

determining by comparing each time stamp information to a reference clock a relative order of, and a relative time difference among, the portion of the plurality of distinct video feeds;

determining a synchronizing point in each of the plurality of distinct video feeds at which each is synchronized relative to the reference clock; and

combining the plurality of distinct video feeds to form a single stream comprising a plurality of synchronized distinct feeds based on the determined synchronizing point, the single stream including a plurality of video feeds and a single audio feed associated with one of the plurality of video feeds, and wherein each of the plurality of distinct video feeds are separately managed such that only users with specific rights may view a rights-protected feed.

2. The method of claim 1, further comprising encoding the single video stream to form a composite mobile device compatible stream, wherein combining the plurality of distinct video feeds includes sub-sampling each of the distinct video feeds so that the composite mobile device compatible stream takes no more bandwidth than one of the distinct video feeds.

3. The method of claim 1, wherein the single video stream comprising a plurality of synchronized distinct video feeds comprises a mosaic of the plurality of the distinct video feeds.

4. The method of claim 1, further comprising replacing the rights-protected feed for an unauthorized user in the single stream with other content.

5. The method of claim 1, further comprising replacing the rights-protected feed for an unauthorized user in the single stream with an advertisement.

6. The method of claim 1, wherein at least one of the plurality of distinct video feeds provides content associated with another one of the one of the plurality of distinct video feeds, the at least one of the plurality of distinct video feeds is not synchronized to ensure fine grain coherency.

7. A method comprising:

accessing with a server a plurality of distinct feeds;

accessing a feed clock associated with a source of at least one of the plurality of distinct feeds;

accessing a reference clock;

determining by comparing the feed clock to the reference clock latency between the at least one of the portion of the plurality of distinct feeds and the reference clock;

determining a synchronizing point in each of the plurality of distinct feeds based on the determined latency at which each is synchronized relative to the reference clock;

aligning the synchronizing point in each of the plurality of distinct feeds to facilitate delivery of synchronized feeds; and

combining the plurality of distinct feeds to form a single stream comprising a plurality of synchronized distinct feeds, based on the determined synchronizing point, the single stream including a plurality of video feeds and a single audio feed associated with one of the plurality of video feeds, and wherein each of the plurality of distinct video feeds are separately managed such that only users with specific rights may view a rights-protected feed.

8. The method of claim 7, wherein a synchronization point is a video frame.

9. The method of claim 7, further comprising encoding the single video stream to form a composite mobile device compatible stream, wherein combining the plurality of distinct feeds includes sub-sampling each of the distinct feeds so that the composite mobile device compatible stream takes no more bandwidth than one of the distinct feeds.

10. The method of claim 7, wherein the single stream comprising a plurality of synchronized distinct feeds comprises a mosaic of the plurality of the distinct video feeds.

11. The method of claim 7, further comprising replacing the rights-protected feed for an unauthorized user in the single stream with other content.

12. The method of claim 7, further comprising replacing the rights-protected feed for an unauthorized user in the single stream with an advertisement.

13. The method of claim 7, wherein at least one of the plurality of distinct feeds provides content associated with another one of the one of the plurality of distinct feeds, the at least one of the plurality of distinct feeds is not synchronized to ensure fine grain coherency.

14. A method comprising:

receiving a single stream comprising a plurality of distinct feeds, the single stream including a plurality of video feeds and a single audio feed associated with one of the plurality of video feeds, wherein at least one of the plurality of distinct video feeds are separately managed for digital rights, and wherein each of the plurality of distinct video feeds are separately managed such that only users with specific rights may view a rights-protected feed;

receiving distinct feed data time information in a side channel associated with the stream;

determining by comparing the time information for each of the distinct feeds a relative order of, and a relative time difference among, the plurality of distinct feeds;

determining a synchronizing point in each of the plurality of distinct feeds at which each is synchronized; and

presenting the plurality of distinct feeds synchronized in time based on the synchronizing point.

15. The method of claim 14, wherein the synchronizing point in each of the plurality of distinct feeds is associated with a single time value.

16. The method of claim 14, wherein the single stream is presented as a mosaic of the plurality of the distinct video feeds.

17. The method of claim 14, further comprising presenting other content for the rights-protected feed for an unauthorized user in the single video stream.

18. The method of claim 14, further comprising presenting an advertisement for the rights-protected feed for an unauthorized user in the single video stream.

19. The method of claim 14, wherein at least one of the plurality of distinct feeds provides content associated with another one of the one of the plurality of distinct feeds, the at least one of the plurality of distinct feeds is not synchronized to ensure fine grain coherency.